What is the best practice for re-indexing?
 

I have PHPDIG integrated with my site and it is working out great.

Since I have full control of the site, periodic manual indexing works fine.

I am wondering what is the most efficient method for reindexing. The admin panel instructions indicate picking a "large" links per depth number and setting the links per page to zero. This seems to cause the spider to work for a long time with almost all of the later scans turning up as duplicates.

Everything on the site is within 3 clicks of the top level index page, so my guess is that setting the depth to 3 or 4 would be sufficient to catch everything.

On a similar thought, is there any advantage to cleaning out the index before re-indexing? The results seem to be fine whether it is done or not but I thought there might be some efficiencies associated with clearing the database table.

Thanks for you help.