View Single Post
Old 02-11-2004, 10:52 PM   #6
RPIEL
Green Mole
 
Join Date: Feb 2004
Posts: 7
Hi Charter,

Thank you for your answer.
I get the better results in building a special page for the indexing process.

This page has a robots meta tag with "noindex, follow" content.

Because the parts of the site I want to index can be retrieved by a simple query on my database, building this special page was easy.
Now I only need a depth of 1 for spidering process and it runs very fast.
All the pages I want to be indexed are retrieved just one time.

I think it is always (when possible), a good solution to build special pages in order to index the site. The path can be simplified and this will avoid to test a lot of pages to see if there are doublons.

For three I have to make some tests.

Sincerely,

RĂ©gis
RPIEL is offline   Reply With Quote