Exlude sites from Search

Surffritze · 10-04-2004, 01:42 AM

Hi there,

i just got a probleme here with phpdig. I did all the installing and config stuff but couldn't find an option to exclude a complete site from indexing.

Any help?

vinyl-junkie · 10-04-2004, 03:20 AM

Perhaps this is what you're looking for.

Surffritze · 10-04-2004, 04:49 AM

sry, but this doesn't realy match my problem.

I wil describe it a little bit better. The Problem is, that my site is based on framesets. And i wan't to exclude the content shown in the bottom- and top-frame. The sites should be spidered, because of the Links (Navigation) in this Frames, but i don't want them to be listed as a searchresult.

Charter · 10-04-2004, 10:34 AM

If you don't want a site to be spidered, then try sticking the domain name in BANNED in the config file. If you want to crawl the navigation links, but don't want to have the keywords indexed, then see this thread.

Surffritze · 10-05-2004, 04:44 AM

THX, i solved the problem by banning parts of the url

10-04-2004, 01:42 AM	#1
Surffritze Green Mole Join Date: Oct 2004 Posts: 7	Exlude sites from Search Hi there, i just got a probleme here with phpdig. I did all the installing and config stuff but couldn't find an option to exclude a complete site from indexing. Any help?

10-04-2004, 10:34 AM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	If you don't want a site to be spidered, then try sticking the domain name in BANNED in the config file. If you want to crawl the navigation links, but don't want to have the keywords indexed, then see this thread. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Exlude and Include Not Working	mokele	Troubleshooting	1	04-06-2006 12:16 AM
search form sites	guskoul	Troubleshooting	7	08-03-2004 12:55 PM
How to search all sites at once?	digitalje5u5	How-to Forum	2	08-03-2004 04:57 AM
Many sites indexed - how to restrict search results to just one or two ?	ciaran@clissman	How-to Forum	2	05-27-2004 01:11 AM
Add search depth limit to the sites table	peter	Mod Requests	0	01-03-2004 09:14 PM

10-04-2004, 03:20 AM	#2
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Perhaps this is what you're looking for.

10-04-2004, 04:49 AM	#3
Surffritze Green Mole Join Date: Oct 2004 Posts: 7	sry, but this doesn't realy match my problem. I wil describe it a little bit better. The Problem is, that my site is based on framesets. And i wan't to exclude the content shown in the bottom- and top-frame. The sites should be spidered, because of the Links (Navigation) in this Frames, but i don't want them to be listed as a searchresult.

10-05-2004, 04:44 AM	#5
Surffritze Green Mole Join Date: Oct 2004 Posts: 7	THX, i solved the problem by banning parts of the url