PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   Troubleshooting (http://www.phpdig.net/forum/forumdisplay.php?f=22)
-   -   more probs (http://www.phpdig.net/forum/showthread.php?t=750)

michabis101 03-30-2004 07:01 AM

more probs
 
now i get that

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@

Notice: Undefined variable: revisit_after in d:\marde\phpdig\admin\spider.php on line 374
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter 03-30-2004 07:18 AM

Hi. Just stick:
PHP Code:

$revisit_after ''

right after:
PHP Code:

$tag ''

in the spider.php file.

michabis101 03-30-2004 07:48 AM

no more error but still this

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter 03-30-2004 08:25 AM

Hi. Uncomment //print $answer."<br>\n"; in robot_functions.php and then index and see what's onscreen.

michabis101 03-30-2004 08:28 AM

Spidering in progress...
HTTP/1.1 404 Object Not Found
HTTP/1.1 403 Access Forbidden
HTTP/1.1 403 Access Forbidden
HTTP/1.1 404 Object Not Found

--------------------------------------------------------------------------------
SITE : http://www.blizzard.com/
Exclude paths :
- @NONE@
HTTP/1.1 403 Access Forbidden
1:http://www.blizzard.com/
(time : 00:00:07)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://www.blizzard.com/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter 03-30-2004 08:45 AM

>> HTTP/1.1 403 Access Forbidden

The 403 error means forbidden, not allowed, go away, so you can't crawl that site.

michabis101 03-30-2004 08:46 AM

okok i'll never be able to dig this site

Charter 03-30-2004 08:53 AM

Hi. Some people just don't want their site crawled by certain bots.

Can't blame them: their site, their resources, their bandwidth. ;)

michabis101 03-30-2004 08:55 AM

yeah i see. hehe

thank you very much for your help and your time, all works number one!


All times are GMT -8. The time now is 12:27 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.