|
Download -
PHP Reference -
Links -
Demo 1.8.9 RC1 -
API
License - Credits - Copying - Changelog - Documentation |
|
|
10-20-2004, 06:28 AM
|
#1 |
|
Green Mole
Join Date: Mar 2004
Posts: 5
|
Spider External links to a depth of 1 (1.8.3)
I just upgraded to 1.8.3 and even after reading a ton of posts before (1.6.3) and again now I can't seem to get a clear answer on this question.
Basically what I want to do is spider external links from the spidered domain to a depth of one. The page I want to spider is basically a collection of links pointing to other pages. I want to crawl that page, find all those links, and follow them but only spider the page the link points to. I don't want to pick up external links of that linked page as then the spider just keeps going on and on. Is this possible? Thanks 
|
|
|
 |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| "search depth" and "links per" features | laurentxav | How-to Forum | 1 | 01-12-2005 07:27 PM |
| spidering external links | websearch | How-to Forum | 1 | 01-11-2005 08:39 AM |
| Wildcard for banned external links? | Slider | How-to Forum | 5 | 12-19-2004 08:07 AM |
| Admin approval for spider to index external URLs | jerrywin5 | Mod Requests | 0 | 03-29-2004 09:37 PM |
| Searching external domains/links | kenazo | How-to Forum | 3 | 03-14-2004 02:55 PM |
