Hello,
I've a web site I wish index with this great tool:
www.john-howe.com
No problem with the web interface with a depth of 5000, execpt it' stop after 30 minutes (once after 1 Hours 23 minutes).
I read some post in this forum, i try to get it from a cronjobs, I try my crontab on my host where I am with john-howe.com
No way, it won't work... ;o(
I try from my personnal web site:
www.metadelic.com on my cpanel with this synthax:
Code:
php -f http://www.john-howe.com/admin/spider.php http://www.john-howe.com
I recieve this error:
Code:
No input file specified
ok, after a few post, I try:
Code:
wget http://www.john-howe.com/admin/spider.php http://www.john-howe.com
and receive this per email:
Code:
Subject: Cron <metadeco@server857> wget http://www.john-howe.com/admin/spider.php http://www.john-howe.com All headers
--13:22:00-- http://www.john-howe.com/admin/spider.php
=> `spider.php.3'
Resolving www.john-howe.com... done.
Connecting to www.john-howe.com[213.131.229.3]:80... connected.
HTTP request sent, awaiting response... 404 Not Found
13:22:01 ERROR 404: Not Found.
--13:22:01-- http://www.john-howe.com/
=> `index.html.6'
Connecting to www.john-howe.com[213.131.229.3]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
0K .......... ......... 54.50 KB/s
13:22:01 (54.50 KB/s) - `index.html.6' saved [19587]
FINISHED --13:22:01--
Downloaded: 19,587 bytes in 1 files
I'm disapointed, why a error 404?....
So how can I index the whole site?
Any suggestion.
A lot of thx for your help and times,
Dominique Javet