Spider not finding anything.

[nvahalik]

I'm trying to spider a site I'm typing in the site http://www.mysite.com/subdir/

I want it to go through everything, not just subdir/ but it never finds any links follow. Is there a debug mode to watch what the spider is doing?

I have also edited the config file:
define('LIMIT_TO_DIRECTORY',false);

[nvahalik]

Output of spider.php (using web interface):
Spidering in progress... [Stop spider]
SITE : http://www2.mysite.com
Exclude paths :
- @NONE@
1:http://www2.mysite.com/
(time : 00:00:05)
No link in temporary table
links found : 1
http://www2.mysite.com/
Optimizing tables...
Indexing complete ! [Back] to admin interface.

[Dave A]

I have seen these type of results before if the depth and number of links has not been set before you index a web site, perhaps you should check the settings in the admin panel for what depth and number of links to be indexed.
One other thing to try is to use the update site feature which sometimes re indexes better the second time around, it will just mark a red cross by the page if it has already been indexed.
When I fisrt index a web site I go in quite shallow and follow it up a while later with amuch deper index.
Give it another try it should be okay