PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 01-18-2004, 12:31 PM   #1
Richie
Green Mole
 
Join Date: Jan 2004
Posts: 2
Again, indexing speed

Hi,

i have an archive containing about 90.000 *.htm - files in a directory and about 800 index pages linking them. a quick calculation on the actual indexing speed and the number of files leads me to about 40 days indexing those files.

is there an opportunity to index the site faster? the server load is extraordinary low, so there seems to bee enough overhead, but i did not find any opportunity to raise spidering speed or to spider with more than one instance.

As there are a)index files, b)thread indexes and c)messages, i have to put depth to 2.

Any Ideas? is phpdig still useful on a site of this size or should i better search for an other search engine?

thx in advance,

Richie
Richie is offline   Reply With Quote
Old 01-18-2004, 11:21 PM   #2
Richie
Green Mole
 
Join Date: Jan 2004
Posts: 2
- sorry -
ignore. It was the problem of the index pahes with a lot of links. Actually, phpdig spiders about a message 1-2 seconds, and i guess it could be finisted tomorrow morning.
Richie is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Spider indexing/request speed/rate - How to change? JAB Creations How-to Forum 1 09-07-2005 05:46 AM
Indexing are very slow, how can i speed up? ossi01 Troubleshooting 2 05-06-2005 03:26 AM
How to increase indexing speed sf44 How-to Forum 0 01-28-2005 03:57 AM
Anything to speed up spidering jinkas Mod Requests 0 08-25-2004 02:07 PM
Speed up phpdig? Konstantine Mod Requests 0 03-13-2004 10:31 PM


All times are GMT -8. The time now is 03:54 PM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.