|
Download -
PHP Reference -
Links -
Demo 1.8.9 RC1 -
API
License - Credits - Copying - Changelog - Documentation |
|
|
03-14-2004, 12:03 AM
|
#1 |
|
Green Mole
Join Date: Mar 2004
Location: Russia
Posts: 21
|
Logical bug and stopping spidering
When browser stops by user or timeout at the time of retrieving of urls some urls won't be save cause page was marked as indexed and won't be search again for links after refreshing. Am I right? So it's not a problem when you have no limit of time and start spidering by command line, but for browser or timeout...
|
|
|
 |
| Thread Tools | |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Do i need help or is it a bug? | se7en | Troubleshooting | 2 | 03-16-2006 06:23 AM |
| Spider Crawl stopping too early | X-Warlock | Troubleshooting | 5 | 05-19-2005 07:01 AM |
| Bug when spidering | julien | Troubleshooting | 3 | 03-01-2005 10:21 PM |
| Bug when spidering subdomains | cybercox | Bug Tracker | 1 | 03-31-2004 11:48 PM |
| "tempspider" table fills itself without stopping | laurentxav | Troubleshooting | 1 | 01-21-2004 09:09 AM |
