PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   Troubleshooting (http://www.phpdig.net/forum/forumdisplay.php?f=22)
-   -   Again, indexing speed (http://www.phpdig.net/forum/showthread.php?t=409)

Richie 01-18-2004 12:31 PM

Again, indexing speed
 
Hi,

i have an archive containing about 90.000 *.htm - files in a directory and about 800 index pages linking them. a quick calculation on the actual indexing speed and the number of files leads me to about 40 days indexing those files.

is there an opportunity to index the site faster? the server load is extraordinary low, so there seems to bee enough overhead, but i did not find any opportunity to raise spidering speed or to spider with more than one instance.

As there are a)index files, b)thread indexes and c)messages, i have to put depth to 2.

Any Ideas? is phpdig still useful on a site of this size or should i better search for an other search engine?

thx in advance,

Richie

Richie 01-18-2004 11:21 PM

- sorry -
ignore. It was the problem of the index pahes with a lot of links. Actually, phpdig spiders about a message 1-2 seconds, and i guess it could be finisted tomorrow morning.


All times are GMT -8. The time now is 01:10 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.