bloodjelly
07-17-2004, 01:18 PM
I just opened up a website about a week ago (http://www.moodsites.com) and already Cyveillance has accessed it and ignored my robots.txt file. I have a bot trap on the front page (a small link to a page that's excluded in robots.txt) and they went right to it. I've decided to ban them from the site for wasting my bandwidth and time. Anyone else notice these guys in their logs? Here's a good thread with some .htaccess code explaining how to institute the ban:
http://www.webmasterworld.com/forum11/1976.htm
and this was the IP address they used to access my site: 63.148.99.234
grrrr....fighting back!:)
http://www.webmasterworld.com/forum11/1976.htm
and this was the IP address they used to access my site: 63.148.99.234
grrrr....fighting back!:)