View Single Post
Old 09-23-2004, 12:40 PM   #1
bluntman
Green Mole
 
Join Date: Sep 2004
Posts: 2
Indexing slow.... no, _really_ slow

Hi all,

I'm spidering a Windows 2000 server based site with several thousand pages on it. The indexing seems to be going really slowly. I don't mean 3-4 seconds, as most everyone else seems to be calling slow. It is taking over 1 minute for each page to index.

The results are the same whether I run the spider from the Windows 2000 host or an external Linux machine. The Linux machine does seem to run better in other respects (spidering doesn't stop from the web interface, etc), but it still takes the same amount of time.

Does anyone have any idea how to troubleshoot this?

Thanks
bluntman is offline   Reply With Quote