PhpDig.net - View Single Post - "Update One Page" Updating The Whole Database

Charter · 08-08-2004, 11:04 AM

Hi. I'm not sure this classifies as a bug or rather unexpected behavior.

If you change one page, should the spider just index that one page but not follow links, even if the links changed? I guess I can see it both ways. Maybe it should only reindex the one page regardless of links.

Anyway, if you want to crawl just one page, type the URI in the text box and set search depth to zero and links per to one from the main page of the admin panel.

If search depth and/or links per are not set, such as in the admin panel subpages or from shell, then the following constants are considered:

PHP Code:


			
define('SPIDER_MAX_LIMIT',20);

define('RESPIDER_LIMIT',5);

define('LINKS_MAX_LIMIT',20);

define('RELINKS_LIMIT',5);

If there is no 'Links' value set for the site on the 'Update sites' page of the admin control panel, these could be set to zero, zero, one, one respectively to only crawl one page.

If there is a 'Links' value set for the site on the 'Update sites' page of the admin control panel, and that value is one, these could be set to zero, zero, whatever, whatever respectively to only crawl one page.

If you want to stop the spider in a nice way, open a new browser and keep clicking the delete button, without selecting a site, until the spider stops. Once the tempspider table stays empty, the spider should stop.

08-08-2004, 11:04 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. I'm not sure this classifies as a bug or rather unexpected behavior. If you change one page, should the spider just index that one page but not follow links, even if the links changed? I guess I can see it both ways. Maybe it should only reindex the one page regardless of links. Anyway, if you want to crawl just one page, type the URI in the text box and set search depth to zero and links per to one from the main page of the admin panel. If search depth and/or links per are not set, such as in the admin panel subpages or from shell, then the following constants are considered: PHP Code: `define('SPIDER_MAX_LIMIT',20); define('RESPIDER_LIMIT',5); define('LINKS_MAX_LIMIT',20); define('RELINKS_LIMIT',5);` If there is no 'Links' value set for the site on the 'Update sites' page of the admin control panel, these could be set to zero, zero, one, one respectively to only crawl one page. If there is a 'Links' value set for the site on the 'Update sites' page of the admin control panel, and that value is one, these could be set to zero, zero, whatever, whatever respectively to only crawl one page. If you want to stop the spider in a nice way, open a new browser and keep clicking the delete button, without selecting a site, until the spider stops. Once the tempspider table stays empty, the spider should stop. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.