View Single Post
Old 03-30-2004, 05:08 AM   #2
renehaentjens
Orange Mole
 
Join Date: Nov 2003
Posts: 69
Here's the result with print $answer."<br>\n"; - no Forbiddens.
I also tried the hosts file modifs (some at least), the new robot_functions, I checked tempspider, it's empty...


Spidering in progress...
HTTP/1.1 404 Not Found
HTTP/1.1 200 OK
Date: Tue, 30 Mar 2004 14:06:16 GMT
Server: Apache/1.3.27 (Win32) PHP/4.3.3
X-Powered-By: PHP/4.3.3
Expires: Mon, 26 Jul 1997 05:00:00 GMT
Content-Type: text/html

HTTP/1.1 200 OK
Date: Tue, 30 Mar 2004 14:06:17 GMT
Server: Apache/1.3.27 (Win32) PHP/4.3.3
X-Powered-By: PHP/4.3.3
Expires: Mon, 26 Jul 1997 05:00:00 GMT
Content-Type: text/html

HTTP/1.1 404 Not Found

--------------------------------------------------------------------------------
SITE : http://cordoba.ugent.be/
Exclude paths :
- @NONE@
HTTP/1.1 200 OK
Date: Tue, 30 Mar 2004 14:06:17 GMT
Server: Apache/1.3.27 (Win32) PHP/4.3.3
X-Powered-By: PHP/4.3.3
Expires: Mon, 26 Jul 1997 05:00:00 GMT
Content-Type: text/html

1:http://cordoba.ugent.be/LW02AC/document/Refs/Theses/
(time : 00:00:02)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://cordoba.ugent.be/LW02AC/document/Refs/Theses/
Optimizing tables...
Indexing complete !
__________________
René Haentjens, Ghent University
renehaentjens is offline   Reply With Quote