PDA

View Full Version : more probs


michabis101
03-30-2004, 08:01 AM
now i get that

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@

Notice: Undefined variable: revisit_after in d:\marde\phpdig\admin\spider.php on line 374
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter
03-30-2004, 08:18 AM
Hi. Just stick:

$revisit_after = '';

right after:

$tag = '';

in the spider.php file.

michabis101
03-30-2004, 08:48 AM
no more error but still this

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter
03-30-2004, 09:25 AM
Hi. Uncomment //print $answer."<br>\n"; in robot_functions.php and then index and see what's onscreen.

michabis101
03-30-2004, 09:28 AM
Spidering in progress...
HTTP/1.1 404 Object Not Found
HTTP/1.1 403 Access Forbidden
HTTP/1.1 403 Access Forbidden
HTTP/1.1 404 Object Not Found

--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@
HTTP/1.1 403 Access Forbidden
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter
03-30-2004, 09:45 AM
>> HTTP/1.1 403 Access Forbidden

The 403 error means forbidden, not allowed, go away, so you can't crawl that site.

michabis101
03-30-2004, 09:46 AM
okok i'll never be able to dig this site

Charter
03-30-2004, 09:53 AM
Hi. Some people just don't want their site crawled by certain bots.

Can't blame them: their site, their resources, their bandwidth. ;)

michabis101
03-30-2004, 09:55 AM
yeah i see. hehe

thank you very much for your help and your time, all works number one!