|
If I index the first link, I will index all elks lodges rather than just the lodge I intend to index. I need the spider to crawl that page and any links found on that page. I don't want it to crawl the entire directory that the page is in.
If I index the second link, I will index all pages in the ~Scott_Michaud directory. Instead, I want to index the page Aroostook_War.html and all pages that it links to in that directory.
Unfortunately, I have many situations like this.
|