Indexing outside root domain

T3D · 10-25-2003, 11:31 PM

Hello,

could anybody provide me the info how to allow the spider to jump domain names aka following all links.

Would be great if somebody could let me know how to do this

Charter · 10-28-2003, 07:19 PM

Hi. Do you mean that your page has links to a third party domain that you'd lik to crawl?

T3D · 10-29-2003, 07:51 AM

yes, that's what i mean. I would like to be able to crawl third party sites too (I am aware of the high traffic / sql load this will cause)

jimigisme · 10-31-2003, 08:20 AM

In the robots_function.php
Change phpdigCompareDomains($url1,$url2)
-
-
-
-
-
else {
return true;
Change the last line from False to True.....

T3D · 11-03-2003, 11:54 AM

Thanks a lot

Charter · 03-14-2004, 02:57 PM

Hi. Also see this post.

10-25-2003, 11:31 PM	#1
T3D Green Mole Join Date: Oct 2003 Posts: 3	Indexing outside root domain Hello, could anybody provide me the info how to allow the spider to jump domain names aka following all links. Would be great if somebody could let me know how to do this

10-28-2003, 07:19 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Do you mean that your page has links to a third party domain that you'd lik to crawl? __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

03-14-2004, 02:57 PM	#6
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Also see this post. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Script not indexing - host doesn't allow remote/root access	tyhand	Troubleshooting	1	07-18-2005 04:48 PM
my root is not being indexed!	ivmedia	Troubleshooting	1	06-26-2005 02:52 AM
indexing defined domain suffix	vispa	How-to Forum	3	02-23-2005 04:34 AM
Spidering sub-directories as the root	bloodjelly	Mod Requests	8	07-15-2004 08:12 PM
infinite loop when indexing sub-domain	janhsh	Bug Tracker	1	05-26-2004 04:55 PM

10-29-2003, 07:51 AM	#3
T3D Green Mole Join Date: Oct 2003 Posts: 3	yes, that's what i mean. I would like to be able to crawl third party sites too (I am aware of the high traffic / sql load this will cause)

10-31-2003, 08:20 AM	#4
jimigisme Green Mole Join Date: Sep 2003 Posts: 10	In the robots_function.php Change phpdigCompareDomains($url1,$url2) - - - - - else { return true; Change the last line from False to True.....

11-03-2003, 11:54 AM	#5
T3D Green Mole Join Date: Oct 2003 Posts: 3	Thanks a lot