PDA

View Full Version : Script running on its own?


druesome
10-25-2003, 10:23 PM
Hi,

Yesterday, I ran the spider to crawl one site. But then something weird happened. When I checked back, I refreshed the admin page and saw that four sites were being crawled at the same time because their URL's had the *locked* symbol beside them. Is this supposed to happen?

Rolandks
10-26-2003, 10:15 AM
CGI-Time-out at first indexing ! The big problem of phpdig:
In the current version the spider try to index the complete site. If you have NO root-server (webspace at provider) you can't change the CGI-timeout from the Webserver. Default in Apache and IIS
it is 300 Sec. But in 300 Seconds spider.php is NOT indexing > 100 Sites. so you get CGI-Timeout - URL's had the *locked*

Feature Solution: The spider.php must stop and start a new Session, before 300 Seconds, because this is default in all Webservers with Save_mode.

-Roland-