Help Please: Problems to spider... just one site

1001studio · 06-28-2004, 05:16 AM

Hello,

I'm spidering sites and with 20 of them I've had no problems. But the last... it returns always strange issue.
It spider always and only the home page and page linked to home page.
No way to spider other subdirectories that are not linked to home page.

It return me this error
unable to parse url (http:/www
Please note the unique slash before www

in

in /mydomain/admin/robot_functions.php on line 361

Any ideas?

Thank you

vinyl-junkie · 06-28-2004, 04:41 PM

Welcome to the forum, 1001studio.

My guess is that you have a broken link on one of your pages. Run it through Web Link Validator and see if that turns up anything.

Hope this helps.

06-28-2004, 05:16 AM	#1
1001studio Green Mole Join Date: Jun 2004 Location: Italy Posts: 6	Help Please: Problems to spider... just one site Hello, I'm spidering sites and with 20 of them I've had no problems. But the last... it returns always strange issue. It spider always and only the home page and page linked to home page. No way to spider other subdirectories that are not linked to home page. It return me this error unable to parse url (http:/www Please note the unique slash before www in in /mydomain/admin/robot_functions.php on line 361 Any ideas? Thank you

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
some problems with spider	gim	Troubleshooting	4	11-25-2005 06:31 AM
problems indexing site.	sfbell	Troubleshooting	1	09-30-2004 09:36 AM
cannot spider own site - others yes	web newsroom	Troubleshooting	1	05-23-2004 03:32 PM
spider entire site	summitmn	Troubleshooting	1	05-03-2004 04:30 PM
Problems spidering dynamic site	Ph0nK	Troubleshooting	1	01-13-2004 03:39 PM

06-28-2004, 04:41 PM	#2
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Welcome to the forum, 1001studio. My guess is that you have a broken link on one of your pages. Run it through Web Link Validator and see if that turns up anything. Hope this helps.