Go Back > PhpDig Forums > How-to Forum

Thread Tools
Old 06-09-2006, 12:49 PM   #1
Green Mole
Join Date: Jun 2006
Location: Massachooosets
Posts: 1
Question Blocking particular hosts or domains?

Is there an easy way I can blog particular hosts or domains from being index by the spider? I run it and it does my site ok, but then it runs off and starts hitting another host on the same domain name and I get a bunch of stuff I don't want.

cewyattjr is offline   Reply With Quote

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Maximum Hosts? pgzn The Mole Hole 0 07-13-2006 04:35 PM
Blocking domains richwilson How-to Forum 0 03-29-2006 07:02 AM
Less hosts than I put noel Troubleshooting 1 11-06-2005 02:08 PM
Limiting the search to certain hosts lighthouse Mod Requests 1 03-11-2004 03:30 PM
Indexing links inside hosts bazarin How-to Forum 3 02-23-2004 10:35 AM

All times are GMT -8. The time now is 12:49 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.