PDA

View Full Version : restrict ad links


webweever
02-05-2006, 02:08 PM
When I'm spidering phpdig always follows sponsor links and indexes those also, is there anyway I can restrict what links phpdig spiders for?

Such as restricting it to a domain where it would spider only links in a particular domain.