|
Found Problem
Here is what the problem was, Which makes no sense.
The website had a robot.txt file in the that only had this line.
Disallow: 4.15.191.215
I had webmaster remove the robots.txt and it indexed fine.
How come the Disallow: is causing a problem with the sipder?
Thank You,
2-Surf.net
|