Indexing file and down

jerrywin5 · 03-12-2005, 08:33 AM

I read the thread titled "Subdirectories but not higher directories" found here.

I need to take this a little further. I want to index pages on a remote server in a directory but only the page that I specify and the pages it links to in the same directory and in sub directories. Here are two examples:

http://www.elks.org/lodges/home.cfm?LodgeNumber=835
http://members.tripod.com/~Scott_Mic...stook-War.html

Thank you!

Charter · 03-15-2005, 09:14 AM

That thread should get you what you want, unless I'm misunderstanding.

jerrywin5 · 03-16-2005, 09:51 AM

If I index the first link, I will index all elks lodges rather than just the lodge I intend to index. I need the spider to crawl that page and any links found on that page. I don't want it to crawl the entire directory that the page is in.

If I index the second link, I will index all pages in the ~Scott_Michaud directory. Instead, I want to index the page Aroostook_War.html and all pages that it links to in that directory.

Unfortunately, I have many situations like this.

Charter · 04-06-2005, 01:12 PM

http://www.phpdig.net/forum/showthread.php?t=1852

03-12-2005, 08:33 AM	#1
jerrywin5 Orange Mole Join Date: Mar 2004 Posts: 48	Indexing file and down I read the thread titled "Subdirectories but not higher directories" found here. I need to take this a little further. I want to index pages on a remote server in a directory but only the page that I specify and the pages it links to in the same directory and in sub directories. Here are two examples: http://www.elks.org/lodges/home.cfm?LodgeNumber=835 http://members.tripod.com/~Scott_Mic...stook-War.html Thank you!

03-15-2005, 09:14 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	That thread should get you what you want, unless I'm misunderstanding. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

04-06-2005, 01:12 PM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	http://www.phpdig.net/forum/showthread.php?t=1852 __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Problem with indexing from text file	bloodjelly	Troubleshooting	9	04-19-2004 03:56 PM
indexing from command line with text file	Wayne McBryde	Troubleshooting	8	01-12-2004 05:56 PM

03-16-2005, 09:51 AM	#3
jerrywin5 Orange Mole Join Date: Mar 2004 Posts: 48	If I index the first link, I will index all elks lodges rather than just the lodge I intend to index. I need the spider to crawl that page and any links found on that page. I don't want it to crawl the entire directory that the page is in. If I index the second link, I will index all pages in the ~Scott_Michaud directory. Instead, I want to index the page Aroostook_War.html and all pages that it links to in that directory. Unfortunately, I have many situations like this.