PhpDig.net - View Single Post

digdug · 10-02-2006, 07:09 PM

Hello,

Guess what?

It works now. And the culprit is: robots.txt

I deleted it and the spidering worked like a charm.

Thanks Charter and alexandercer for your help!

10-02-2006, 07:09 PM	#7
digdug Green Mole Join Date: Sep 2006 Posts: 6	Hello, Guess what? It works now. And the culprit is: robots.txt I deleted it and the spidering worked like a charm. Thanks Charter and alexandercer for your help!