Sorry about the late reply,
I can't even open that screen (it's too big) I run out of virtual memory on my computer (besides the minimum 15 minutes to open.
Like I said the site is HUUUGGGEEE.
Any way, I'm playing around with a robots.txt file but that doenst seem to work. Even though I told it to exclude all it still seems to take a look at the ones I already did.
So a couple of questions:
A) Whats the excludes table - can I place parts I don't want reindexed in this table?
B) Is there a way to make it not recheck the stuff I already did?
C) Last but not least, the only solution I can see is multple installs of phpdig (each with there own database) of course I don't like this answer and If I did this is there a way to have phpdig still search through these databases and give one result page?
I know I'm asking alot but I'm hoping there is a solution to searching my Huge archaic website.
Thanks
Eric McClary
www.recordernews.com