moreorless
09-26-2005, 05:21 PM
Hi
I've managed to set a cron job for the periodic reindexing on my website. It appears to be functioning as a new spider log is produced each time the job runs. However, the reindexing does not appear to get beyond the first page. The days, links and depth have been set to 0, 20 and 20 respectively in the config file, so that doesn't appear to be the issue.
Any help with this problem will be greatly appreciated.
The spider log generated each time the process runs contains the following information:
Spidering in progress...
-----------------------------
SITE : http://www.otsi.nsw.gov.au/
Exclude paths :
- awstats/
- bus/stats.php
- cgi-bin/
- cp/
- components/
- FAQ/
- ferry/stats.php
- images/
- media/
- phpdig/
- rail/stats.php
- templates/
- webalizer/
- calendar.php
- login.html
XDuplicate of an existing document
1:http://www.otsi.nsw.gov.au/
(time : 00:00:00)
+
level 1...
(time : 00:00:00)
No link in temporary table
links found : 1
Optimizing tables...
Indexing complete !
Thanks
I've managed to set a cron job for the periodic reindexing on my website. It appears to be functioning as a new spider log is produced each time the job runs. However, the reindexing does not appear to get beyond the first page. The days, links and depth have been set to 0, 20 and 20 respectively in the config file, so that doesn't appear to be the issue.
Any help with this problem will be greatly appreciated.
The spider log generated each time the process runs contains the following information:
Spidering in progress...
-----------------------------
SITE : http://www.otsi.nsw.gov.au/
Exclude paths :
- awstats/
- bus/stats.php
- cgi-bin/
- cp/
- components/
- FAQ/
- ferry/stats.php
- images/
- media/
- phpdig/
- rail/stats.php
- templates/
- webalizer/
- calendar.php
- login.html
XDuplicate of an existing document
1:http://www.otsi.nsw.gov.au/
(time : 00:00:00)
+
level 1...
(time : 00:00:00)
No link in temporary table
links found : 1
Optimizing tables...
Indexing complete !
Thanks