Hello,
I installed phpdig this week and the index is working well for many sites.
I have a problem with one site. It is a TikiWiki.
PHPDig index only the first page and it seems that this site is locked very quickly.
- I am using the spider from the shell, so it is not a problem of timeout from my browser.
- I tried to remove the "locked" in the administration pannel for this site without effect. The site become locked when the spider start (which seems normal) but then stick to locked.
- I tried also to browse this site from my server with lynx without problem.
Do you have any ideas?
Here is the log from my spyder.log file:
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
+ *
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
+2:
http://test.toto.net/tikiwiki/tiki-u...view_user=test
(time : 00:00:45)
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
+ *
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
*
http://test.toto.net/ Locked*
Thanks,
Olivier.