Hello CHARTER,
I would like to know what's your opinion about these questions :
1°) I think indexed +- 2500 sites, do you think it is realist or it isn't possible with PHPDIG ?
2°) If it is possible, how many days will you put, first to reindex a site, me I would put 30 days and you ?
3°) In order to do something "realist", what do you think, with
Number Level Dept : 20
Link for each DEPT : 50 ?? much or less ?
I tried to illimited link but it took too much time to index.
4°) A problem I don't find the answer, when it is spidering, crawling, can I put a new link ,or have I to wait that it stops crawling ?
5°) Is ist possible to have more than one spider whit shell command , what I have to do ?
6°) I have a big problem when he is spidering forums, he always find 100 links yet indexed, one link new, after 100 links yet indexed, one link new...etc... what can I do for that, it spend a lot of time for nothing ?
7°) When using shell command are all the informations in the config file are using by shell spider ?
sorry for my english
Thank you !
Noël