View Full Version : Exlude sites from Search
Surffritze
10-04-2004, 01:42 AM
Hi there,
i just got a probleme here with phpdig. I did all the installing and config stuff but couldn't find an option to exclude a complete site from indexing.
Any help?
vinyl-junkie
10-04-2004, 03:20 AM
Perhaps this (http://www.phpdig.net/forum/showthread.php?t=363) is what you're looking for. :)
Surffritze
10-04-2004, 04:49 AM
sry, but this doesn't realy match my problem.
I wil describe it a little bit better. The Problem is, that my site is based on framesets. And i wan't to exclude the content shown in the bottom- and top-frame. The sites should be spidered, because of the Links (Navigation) in this Frames, but i don't want them to be listed as a searchresult.
Charter
10-04-2004, 10:34 AM
If you don't want a site to be spidered, then try sticking the domain name in BANNED in the config file. If you want to crawl the navigation links, but don't want to have the keywords indexed, then see this (http://www.phpdig.net/forum/showthread.php?t=763) thread.
Surffritze
10-05-2004, 04:44 AM
THX, i solved the problem by banning parts of the url
vBulletin® v3.7.3, Copyright ©2000-2025, Jelsoft Enterprises Ltd.