Richie
01-18-2004, 12:31 PM
Hi,
i have an archive containing about 90.000 *.htm - files in a directory and about 800 index pages linking them. a quick calculation on the actual indexing speed and the number of files leads me to about 40 days indexing those files.
is there an opportunity to index the site faster? the server load is extraordinary low, so there seems to bee enough overhead, but i did not find any opportunity to raise spidering speed or to spider with more than one instance.
As there are a)index files, b)thread indexes and c)messages, i have to put depth to 2.
Any Ideas? is phpdig still useful on a site of this size or should i better search for an other search engine?
thx in advance,
Richie
i have an archive containing about 90.000 *.htm - files in a directory and about 800 index pages linking them. a quick calculation on the actual indexing speed and the number of files leads me to about 40 days indexing those files.
is there an opportunity to index the site faster? the server load is extraordinary low, so there seems to bee enough overhead, but i did not find any opportunity to raise spidering speed or to spider with more than one instance.
As there are a)index files, b)thread indexes and c)messages, i have to put depth to 2.
Any Ideas? is phpdig still useful on a site of this size or should i better search for an other search engine?
thx in advance,
Richie