![]() |
more probs
now i get that
Spidering in progress... -------------------------------------------------------------------------------- SITE : http://www.blizzard.com/ Exclude paths : - @NONE@ Notice: Undefined variable: revisit_after in d:\marde\phpdig\admin\spider.php on line 374 1:http://www.blizzard.com/ (time : 00:00:07) No link in temporary table -------------------------------------------------------------------------------- links found : 1 http://www.blizzard.com/ Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface. |
Hi. Just stick:
PHP Code:
PHP Code:
|
no more error but still this
Spidering in progress... -------------------------------------------------------------------------------- SITE : http://www.blizzard.com/ Exclude paths : - @NONE@ 1:http://www.blizzard.com/ (time : 00:00:07) No link in temporary table -------------------------------------------------------------------------------- links found : 1 http://www.blizzard.com/ Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface. |
Hi. Uncomment //print $answer."<br>\n"; in robot_functions.php and then index and see what's onscreen.
|
Spidering in progress...
HTTP/1.1 404 Object Not Found HTTP/1.1 403 Access Forbidden HTTP/1.1 403 Access Forbidden HTTP/1.1 404 Object Not Found -------------------------------------------------------------------------------- SITE : http://www.blizzard.com/ Exclude paths : - @NONE@ HTTP/1.1 403 Access Forbidden 1:http://www.blizzard.com/ (time : 00:00:07) No link in temporary table -------------------------------------------------------------------------------- links found : 1 http://www.blizzard.com/ Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface. |
>> HTTP/1.1 403 Access Forbidden
The 403 error means forbidden, not allowed, go away, so you can't crawl that site. |
okok i'll never be able to dig this site
|
Hi. Some people just don't want their site crawled by certain bots.
Can't blame them: their site, their resources, their bandwidth. ;) |
yeah i see. hehe
thank you very much for your help and your time, all works number one! |
All times are GMT -8. The time now is 12:27 PM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.