claudiomet
09-01-2004, 02:02 PM
When I start spidering via shell like:
php -f /home/.../spider.php http://www.123.cl
the site is enterely indexed... works perfectly.
But when this url is in a text file with other urls, the site is not indexed... any site is not indexed... (the content is not indexed ...but the urls are registered in the temporaly table with 0 links, My settings are Links per=0, Depth=0)
What's wrong?, the url text file must be in a specific format?
php -f /home/.../spider.php http://www.123.cl
the site is enterely indexed... works perfectly.
But when this url is in a text file with other urls, the site is not indexed... any site is not indexed... (the content is not indexed ...but the urls are registered in the temporaly table with 0 links, My settings are Links per=0, Depth=0)
What's wrong?, the url text file must be in a specific format?