PhpDig.net - Cronjob and index problem

PhpDig.net (http://www.phpdig.net/forum/index.php)

- Troubleshooting (http://www.phpdig.net/forum/forumdisplay.php?f=22)

- - Cronjob and index problem (http://www.phpdig.net/forum/showthread.php?t=1706)

PHP Code:


		
			
define('SPIDER_MAX_LIMIT',2000); //max recurse levels in spider

define('RESPIDER_LIMIT',5); //recurse respider limit for update

define('LINKS_MAX_LIMIT',20); //max links per each level

define('RELINKS_LIMIT',5); //recurse links limit for an update

Try setting RESPIDER_LIMIT and RELINKS_LIMIT to 2000 and 20 respectively.

I will try this tonigh.
After a few days of test and read the documentation, the concept behind these setting (recurse link, etc) are not so clear. Why use 2000 instead of 20, why use sleep(5) when sleep (2) work really fine, etc... mst I keep the t.t files under text_content when indeing is done? etc...

One thing I notice, is that my ISP update the cronjob every 30 minutes, on my other ISP it's every minute... :bang: I had saved a lot of time and frustration when I know this! And offcourse, isn't documented into the ISP online help...

So, I continue with my test. I will let you know.

Exist a tutorial abour fine tuning of the setting we discuss? I found a cron tutorial, but nothing else.
BTW, it's really impressive. I've a site with 3400 indexed pages, 696'500 keywords. Excellent.

Regards, Dom