PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   How-to Forum (http://www.phpdig.net/forum/forumdisplay.php?f=33)
-   -   Meta Robots = NoIndex, or already indexed : No content indexed (http://www.phpdig.net/forum/showthread.php?t=1957)

jerrywin5 04-06-2005 01:27 PM

Meta Robots = NoIndex, or already indexed : No content indexed
 
How can I figure out why a URI is not being indexed?

I indexed a site and got the following results and cannot understand why.

SITE : http://www.oldironinn.com/
Exclude paths :
- @NONE@
+499:http://www.oldironinn.com/
(time : 00:46:03)
+ + + + + + +
level 1...
Meta Robots = NoIndex, or already indexed : No content indexed
500:http://www.oldironinn.com/rooms.html
(time : 00:46:11)

Meta Robots = NoIndex, or already indexed : No content indexed
501:http://www.oldironinn.com/cottage.html
(time : 00:46:14)

Meta Robots = NoIndex, or already indexed : No content indexed
502:http://www.oldironinn.com/calendar.html
(time : 00:46:17)

Meta Robots = NoIndex, or already indexed : No content indexed
503:http://www.oldironinn.com/photos.html
(time : 00:46:20)

Meta Robots = NoIndex, or already indexed : No content indexed
504:http://www.oldironinn.com/cookbook.html
(time : 00:46:23)

Meta Robots = NoIndex, or already indexed : No content indexed
505:http://www.oldironinn.com/bike.html
(time : 00:46:26)

Meta Robots = NoIndex, or already indexed : No content indexed
506:http://www.oldironinn.com/directions.html
(time : 00:46:30)

No link in temporary table
links found : 499

Charter 04-06-2005 02:43 PM

Look at the HTML source from those pages to see the following tag:
Code:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
Looks like they don't want you to index their content. :eek: ;)

jerrywin5 04-06-2005 02:50 PM

Thank you and I'm sorry I didn't see that. I thought for sure I looked at the source as well as checked for a robots.txt file but I guess I am wrong.

Anyway, Thanks!


All times are GMT -8. The time now is 03:53 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.