PDA

View Full Version : Meta Robots = NoIndex, or already indexed : No content indexed


jerrywin5
04-06-2005, 01:27 PM
How can I figure out why a URI is not being indexed?

I indexed a site and got the following results and cannot understand why.

SITE : http://www.oldironinn.com/
Exclude paths :
- @NONE@
+499:http://www.oldironinn.com/
(time : 00:46:03)
+ + + + + + +
level 1...
Meta Robots = NoIndex, or already indexed : No content indexed
500:http://www.oldironinn.com/rooms.html
(time : 00:46:11)

Meta Robots = NoIndex, or already indexed : No content indexed
501:http://www.oldironinn.com/cottage.html
(time : 00:46:14)

Meta Robots = NoIndex, or already indexed : No content indexed
502:http://www.oldironinn.com/calendar.html
(time : 00:46:17)

Meta Robots = NoIndex, or already indexed : No content indexed
503:http://www.oldironinn.com/photos.html
(time : 00:46:20)

Meta Robots = NoIndex, or already indexed : No content indexed
504:http://www.oldironinn.com/cookbook.html
(time : 00:46:23)

Meta Robots = NoIndex, or already indexed : No content indexed
505:http://www.oldironinn.com/bike.html
(time : 00:46:26)

Meta Robots = NoIndex, or already indexed : No content indexed
506:http://www.oldironinn.com/directions.html
(time : 00:46:30)

No link in temporary table
links found : 499

Charter
04-06-2005, 02:43 PM
Look at the HTML source from those pages to see the following tag:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

Looks like they don't want you to index their content. :eek: ;)

jerrywin5
04-06-2005, 02:50 PM
Thank you and I'm sorry I didn't see that. I thought for sure I looked at the source as well as checked for a robots.txt file but I guess I am wrong.

Anyway, Thanks!