PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   How-to Forum (http://www.phpdig.net/forum/forumdisplay.php?f=33)
-   -   Spider External links to a depth of 1 (1.8.3) (http://www.phpdig.net/forum/showthread.php?t=1462)

kenazo 10-20-2004 06:28 AM

Spider External links to a depth of 1 (1.8.3)
 
I just upgraded to 1.8.3 and even after reading a ton of posts before (1.6.3) and again now I can't seem to get a clear answer on this question.

Basically what I want to do is spider external links from the spidered domain to a depth of one. The page I want to spider is basically a collection of links pointing to other pages. I want to crawl that page, find all those links, and follow them but only spider the page the link points to. I don't want to pick up external links of that linked page as then the spider just keeps going on and on.

Is this possible?

Thanks :)


All times are GMT -8. The time now is 11:52 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.