olivier
02-11-2005, 01:24 AM
Hello,
I installed phpdig this week and the index is working well for many sites.
I have a problem with one site. It is a TikiWiki.
PHPDig index only the first page and it seems that this site is locked very quickly.
- I am using the spider from the shell, so it is not a problem of timeout from my browser.
- I tried to remove the "locked" in the administration pannel for this site without effect. The site become locked when the spider start (which seems normal) but then stick to locked.
- I tried also to browse this site from my server with lynx without problem.
Do you have any ideas?
Here is the log from my spyder.log file:
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+ *http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+2:http://test.toto.net/tikiwiki/tiki-user_information.php?view_user=test
(time : 00:00:45)
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+ *http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
Thanks,
Olivier.
I installed phpdig this week and the index is working well for many sites.
I have a problem with one site. It is a TikiWiki.
PHPDig index only the first page and it seems that this site is locked very quickly.
- I am using the spider from the shell, so it is not a problem of timeout from my browser.
- I tried to remove the "locked" in the administration pannel for this site without effect. The site become locked when the spider start (which seems normal) but then stick to locked.
- I tried also to browse this site from my server with lynx without problem.
Do you have any ideas?
Here is the log from my spyder.log file:
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+ *http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+2:http://test.toto.net/tikiwiki/tiki-user_information.php?view_user=test
(time : 00:00:45)
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+ *http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
Thanks,
Olivier.