should I be careful with how high I set the search depth?
Even with the search depth set as one for both freebsd.org and rbhs.ath.cx, i get the following output.
%php -f spider.php forceall
47723: old priority 0, new priority 18
Spidering in progress...
-----------------------------
SITE :
http://rbhs.ath.cx/
Exclude paths :
- @NONE@
No link in temporary table
links found : 0
-----------------------------
SITE :
http://freebsd.org/
Exclude paths :
- @NONE@
No link in temporary table
links found : 0
Optimizing tables...
Indexing complete !
%
perhaps something is wrong in my configuration.
I read over the other thread you linked me too and couldn't find anything in there that would seem to have fixed this problem.
Weird...it seems to correctly crawl if I add a URI via the command line
%php -f spider.php
http://maggiv8.funpic.de/
47732: old priority 0, new priority 18
Spidering in progress...
-----------------------------
SITE :
http://maggiv8.funpic.de/
Exclude paths :
- @NONE@
+1:
http://maggiv8.funpic.de/
(time : 00:00:07)
+ + +
level 1...
+2:
http://maggiv8.funpic.de/phpinfo.php
(time : 00:00:28)
+3:
http://maggiv8.funpic.de/search.php
(time : 00:00:35)
+4:
http://maggiv8.funpic.de/www/
(time : 00:00:40)
+ + + + + + + + + + + +
level 2...
.....