Go Back > PhpDig Forums > Troubleshooting

Thread Tools
Old 01-13-2004, 01:08 AM   #1
Green Mole
Join Date: Dec 2003
Posts: 11
'Duplicate' Search Results


I've noticed that PHPDig seems to not be able to differeniate between nearly identical(I say nearly, because they appear identical to my human eyes) documents located on a website.

If one document is located in say /worldwide/ and another in /about_us/ they both come up in a search result with identical percentages.

Additionally, documents that are generated dynamically but are identical also give multiple duplicate results.

For example:


Both are listed as results(they differ by the region variable in the URL).

This behavior is understandable, since they are slightly different(from a machines perspective).

However, is there a way to increase the criteria used to judge duplicate documents to filter out highly similar documents as well?

Say if they share 90% of the same content?

Thanks in advance,


For reference, you may see for yourself this behavior at:

Search for "cleaning standards" as a good example.

Several pages into the search, you'll see some examples of pseudo-duplicates.

Last edited by siliconkibou; 01-13-2004 at 01:10 AM.
siliconkibou is offline   Reply With Quote
Old 01-13-2004, 09:00 AM   #2
Head Mole
Charter's Avatar
Join Date: May 2003
Posts: 2,539
Hi. You might try modifying the $md5 variable talked about in this thread.
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Restricting search results by URL at the search form level innerfire How-to Forum 3 08-01-2005 09:36 AM
No most searched terms, biggest results, most 0 results, last search queries, etc. jongag1 How-to Forum 6 04-22-2005 11:43 AM
Too many duplicate link, someone help please! warrence Troubleshooting 1 09-07-2004 05:26 PM
Duplicate/Similar search results? ChadK How-to Forum 3 08-20-2004 07:07 AM
Indexing duplicate descriptions and keywords causing false search results jerrywin5 Mod Requests 3 05-04-2004 09:27 AM

All times are GMT -8. The time now is 06:43 AM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.