View Full Version : more probs
michabis101
03-30-2004, 07:01 AM
now i get that
Spidering in progress...
--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@
Notice: Undefined variable: revisit_after in d:\marde\phpdig\admin\spider.php on line 374
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table
--------------------------------------------------------------------------------
links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.
Charter
03-30-2004, 07:18 AM
Hi. Just stick:
$revisit_after = '';
right after:
$tag = '';
in the spider.php file.
michabis101
03-30-2004, 07:48 AM
no more error but still this
Spidering in progress...
--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table
--------------------------------------------------------------------------------
links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.
Charter
03-30-2004, 08:25 AM
Hi. Uncomment //print $answer."<br>\n"; in robot_functions.php and then index and see what's onscreen.
michabis101
03-30-2004, 08:28 AM
Spidering in progress...
HTTP/1.1 404 Object Not Found
HTTP/1.1 403 Access Forbidden
HTTP/1.1 403 Access Forbidden
HTTP/1.1 404 Object Not Found
--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@
HTTP/1.1 403 Access Forbidden
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table
--------------------------------------------------------------------------------
links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.
Charter
03-30-2004, 08:45 AM
>> HTTP/1.1 403 Access Forbidden
The 403 error means forbidden, not allowed, go away, so you can't crawl that site.
michabis101
03-30-2004, 08:46 AM
okok i'll never be able to dig this site
Charter
03-30-2004, 08:53 AM
Hi. Some people just don't want their site crawled by certain bots.
Can't blame them: their site, their resources, their bandwidth. ;)
michabis101
03-30-2004, 08:55 AM
yeah i see. hehe
thank you very much for your help and your time, all works number one!
vBulletin® v3.7.3, Copyright ©2000-2025, Jelsoft Enterprises Ltd.