Excellent results using Putty SSH client and nohup command

claudiomet · 09-29-2004, 09:40 AM

I have an url text with more than 10.000 URLS. The Cron Jobs via cpanel doesn't work well (always 0 pages indexed and very slow indexing... and via web browser was worst), Now I'm using Putty SSH client and in the console I write:

cd $HOME/public_html/admin
nohup php -f spider.php urls.txt &

And I closed mi session and turned off my PC. (It was the last week)...

Now I check the nohup.out file and the spidering was very fast, a lot of pages indexed and no problems...

vinyl-junkie · 09-29-2004, 06:10 PM

Thanks for the report on that. I'm in the process of moving my site to another hosting company where, among other things, I'll have shell access for the first time. My new host recommends Putty SSH, so I think I'll give that a try.

AllKnightAccess · 09-30-2004, 02:17 PM

What about something that will work fast using a Mac? I am getting very slow indexing. Maybe around 1 minute per page.

09-29-2004, 09:40 AM	#1
claudiomet Green Mole Join Date: Aug 2004 Location: Chile Posts: 13	Excellent results using Putty SSH client and nohup command I have an url text with more than 10.000 URLS. The Cron Jobs via cpanel doesn't work well (always 0 pages indexed and very slow indexing... and via web browser was worst), Now I'm using Putty SSH client and in the console I write: cd $HOME/public_html/admin nohup php -f spider.php urls.txt & And I closed mi session and turned off my PC. (It was the last week)... Now I check the nohup.out file and the spidering was very fast, a lot of pages indexed and no problems... __________________ http://claudiomet.phpnet.us

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Client question: intelligent ranking	lukemack	How-to Forum	5	11-07-2005 11:40 AM
No most searched terms, biggest results, most 0 results, last search queries, etc.	jongag1	How-to Forum	6	04-22-2005 10:43 AM
SSH alternative?	ark2424	How-to Forum	1	12-07-2004 02:33 AM
Client IP address	griffinmt	Coding & Tutorials	3	05-23-2004 10:30 AM
Can I close Putty during command line indexing?	Nosmada	How-to Forum	7	01-23-2004 03:46 PM

09-29-2004, 06:10 PM	#2
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Thanks for the report on that. I'm in the process of moving my site to another hosting company where, among other things, I'll have shell access for the first time. My new host recommends Putty SSH, so I think I'll give that a try.

09-30-2004, 02:17 PM	#3
AllKnightAccess Green Mole Join Date: Sep 2004 Posts: 25	What about something that will work fast using a Mac? I am getting very slow indexing. Maybe around 1 minute per page.