Hi. The script should keep crawling as long as it finds links at the given level within a certain time. The set_time_limit(86400); in the spider.php file is for one day. More information about set_time_limit can be found here.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
|