PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 02-05-2006, 02:08 PM   #1
webweever
Green Mole
 
Join Date: Jan 2006
Posts: 1
restrict ad links

When I'm spidering phpdig always follows sponsor links and indexes those also, is there anyway I can restrict what links phpdig spiders for?

Such as restricting it to a domain where it would spider only links in a particular domain.
webweever is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Un restrict to sub directories gooseman How-to Forum 2 11-11-2004 03:32 PM
Many sites indexed - how to restrict search results to just one or two ? ciaran@clissman How-to Forum 2 05-27-2004 01:11 AM
Restrict Spidering to new pages only bushpilot How-to Forum 1 05-01-2004 08:07 AM


All times are GMT -8. The time now is 07:34 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.