![]() |
Problem with spidering with url tex list :-(
When I start spidering via shell like:
php -f /home/.../spider.php http://www.123.cl the site is enterely indexed... works perfectly. But when this url is in a text file with other urls, the site is not indexed... any site is not indexed... (the content is not indexed ...but the urls are registered in the temporaly table with 0 links, My settings are Links per=0, Depth=0) What's wrong?, the url text file must be in a specific format? |
Hi. The text file should have one URL per line.
|
All times are GMT -8. The time now is 01:23 PM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.