|
restrict ad links
When I'm spidering phpdig always follows sponsor links and indexes those also, is there anyway I can restrict what links phpdig spiders for?
Such as restricting it to a domain where it would spider only links in a particular domain. |
| All times are GMT -8. The time now is 02:42 PM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.