Blocking particular hosts or domains?
Is there an easy way I can blog particular hosts or domains from being index by the spider? I run it and it does my site ok, but then it runs off and starts hitting another host on the same domain name and I get a bunch of stuff I don't want.
thanks!
|