PhpDig.net - View Single Post

Chris2 · 02-20-2004, 05:53 PM

it's widely discussed around here already... the "just recently indexed problem", now i've followed all the threads, understood only half of it and finally just did two things:

hit "delete site" and "update form" on the admin/index.php page serveral times... (that surely wasn't it)

and:

rewrote my robots.txt:

problem: there was just a single space in fron of "User-Agent:" in the first line...

and see, jump, enjoy:

it's running again...

so to anyone who is getting crazy as well: check the robots.txt syntax, some spider engines may accept minor faults, others don't!

02-20-2004, 05:53 PM	#1
Chris2 Green Mole Join Date: Jan 2004 Posts: 3	indexing problem?? it's widely discussed around here already... the "just recently indexed problem", now i've followed all the threads, understood only half of it and finally just did two things: hit "delete site" and "update form" on the admin/index.php page serveral times... (that surely wasn't it) and: rewrote my robots.txt: problem: there was just a single space in fron of "User-Agent:" in the first line... and see, jump, enjoy: it's running again... so to anyone who is getting crazy as well: check the robots.txt syntax, some spider engines may accept minor faults, others don't!