index via shell

Nosmada · 12-23-2003, 11:23 AM

I am timing out in the browser so I want to index via the shell. The script is located outside my cgi-bin and in the regular httpdocs folder.

I want to index 10 levels deep and have allready run it in the browser a couple of times and have a few directories indexed.

How do I do this? I read a similar question in the forum but it I didn't quite get it.

Nosmada · 12-23-2003, 12:10 PM

By the way I tried the documentation and nothing happens when I run what is in the docs in my command prompt?

Charter · 12-23-2003, 09:23 PM

Hi. In the config file change the following to ten:

PHP Code:


			
define('SPIDER_MAX_LIMIT',10);          //max recurse levels in sipder

define('SPIDER_DEFAULT_LIMIT',10);      //default value

define('RESPIDER_LIMIT',10);            //recurse limit for update

Then place the full URLs in a list.txt file, one per line.

Finally run the following command at the shell prompt, changing the paths and slashes as needed:

Code:

/path/to/php -f /path/to/spider.php /path/to/list.txt >> spider.log

The spider.log file will contain the indexing information.

12-23-2003, 11:23 AM	#1
Nosmada Orange Mole Join Date: Dec 2003 Posts: 32	index via shell I am timing out in the browser so I want to index via the shell. The script is located outside my cgi-bin and in the regular httpdocs folder. I want to index 10 levels deep and have allready run it in the browser a couple of times and have a few directories indexed. How do I do this? I read a similar question in the forum but it I didn't quite get it. __________________ Nosmada

12-23-2003, 12:10 PM	#2
Nosmada Orange Mole Join Date: Dec 2003 Posts: 32	By the way I tried the documentation and nothing happens when I run what is in the docs in my command prompt? __________________ Nosmada

12-23-2003, 09:23 PM	#3
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. In the config file change the following to ten: PHP Code: `define('SPIDER_MAX_LIMIT',10); //max recurse levels in sipder define('SPIDER_DEFAULT_LIMIT',10); //default value define('RESPIDER_LIMIT',10); //recurse limit for update` Then place the full URLs in a list.txt file, one per line. Finally run the following command at the shell prompt, changing the paths and slashes as needed: Code: /path/to/php -f /path/to/spider.php /path/to/list.txt >> spider.log The spider.log file will contain the indexing information. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
shell indexing problem	Patrick_2a	Troubleshooting	1	11-06-2005 10:30 AM
Shell command no indexing	noel	Troubleshooting	3	10-27-2005 10:22 AM
updating the index via the shell	liquidice	How-to Forum	1	08-31-2004 10:58 AM
Shell Spidering	CrazyCanuck	Troubleshooting	3	04-20-2004 09:56 AM
Shell mode not working	bloodjelly	Troubleshooting	8	04-08-2004 04:43 PM