Problem with spidering with url tex list :-(

claudiomet · 09-01-2004, 02:02 PM

When I start spidering via shell like:

php -f /home/.../spider.php http://www.123.cl

the site is enterely indexed... works perfectly.

But when this url is in a text file with other urls, the site is not indexed... any site is not indexed... (the content is not indexed ...but the urls are registered in the temporaly table with 0 links, My settings are Links per=0, Depth=0)

What's wrong?, the url text file must be in a specific format?

Charter · 09-07-2004, 03:32 PM

Hi. The text file should have one URL per line.

09-01-2004, 02:02 PM	#1
claudiomet Green Mole Join Date: Aug 2004 Location: Chile Posts: 13	Problem with spidering with url tex list :-( When I start spidering via shell like: php -f /home/.../spider.php http://www.123.cl the site is enterely indexed... works perfectly. But when this url is in a text file with other urls, the site is not indexed... any site is not indexed... (the content is not indexed ...but the urls are registered in the temporaly table with 0 links, My settings are Links per=0, Depth=0) What's wrong?, the url text file must be in a specific format? __________________ http://claudiomet.phpnet.us

09-07-2004, 03:32 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. The text file should have one URL per line. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Spidering problem	mark40	Troubleshooting	1	08-28-2007 04:06 AM
Mod-rewrite = spidering / URL problems	jcnorris	Troubleshooting	1	10-26-2006 09:38 AM
Problem Spidering	Trallis	Troubleshooting	6	11-02-2005 07:58 AM
Problem Spidering...	dogfish	Troubleshooting	1	02-26-2005 06:38 PM
spidering problem	nathansc	How-to Forum	3	06-17-2004 03:25 PM