Hi. In the config file change the following to ten:
PHP Code:
define('SPIDER_MAX_LIMIT',10); //max recurse levels in sipder
define('SPIDER_DEFAULT_LIMIT',10); //default value
define('RESPIDER_LIMIT',10); //recurse limit for update
Then place the full URLs in a list.txt file, one per line.
Finally run the following command at the shell prompt, changing the paths and slashes as needed:
Code:
/path/to/php -f /path/to/spider.php /path/to/list.txt >> spider.log
The spider.log file will contain the indexing information.