Blocking particular hosts or domains?
Is there an easy way I can blog particular hosts or domains from being index by the spider? I run it and it does my site ok, but then it runs off and starts hitting another host on the same domain name and I get a bunch of stuff I don't want.
thanks! |
All times are GMT -8. The time now is 12:59 AM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.