If you are using the update sites option in the admin panel, then clicking check marks reindexes the content already there. To find new content, use the textbox on the main admin panel page, and enter a link to an updated page. Alternatively, you can use the forceall option when running a cron job or provide a link to an updated page. If you want to index more, rather than less, content then set LIMIT_TO_DIRECTORY to false and PHPDIG_IN_DOMAIN to true in the config file, and then from the admin panel, use a large search depth, links per of zero, and choose the no option. Also, in the config file there are the following search depth and links per options:
Code:
define('SPIDER_MAX_LIMIT',20); // max (re)index search depth - used for shell and admin panel dropdown
define('RESPIDER_LIMIT',5); // max update search depth - only used for browser, not used for shell
define('LINKS_MAX_LIMIT',20); // max (re)index links per - used for shell and admin panel dropdown
define('RELINKS_LIMIT',5); // max update links per - only used for browser, not used for shell