Spider process does not do anything
 

I'm encountering a problem getting the spider to work. Creating a robots.txt file did not seem to help.

Here is my robots.txt:

User-agent: *
Disallow: /include/

When I tell it to spider localhost or the hostname of the local server (depth=5) always results in this:

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://localhost/
Exclude paths :
- include/

There are no CPU cycles being used and the page is fully loaded. What else can I check? How will I know that the spider process is actually doing something?

Thanks

Hi. Try this thread.

I took a look at the article and I don't think that is the problem. I have a single web server with one NIC. I'm trying to spider the local web server, but I never see any results. I don't see any progress on the page (which also says it is "Done") and it will sit there forever doing nothing. I tried spidering some other sites but nothing happens with those either.

What else is there that I can check?

acidelic
In config.php set up define('USE_IS_EXECUTABLE_COMMAND','0');

(It is the best search script!)

That did the trick!!! The spider page didn't load, but if I refresh the admin page I can see the counts going up. And I can actual search for things on the site. Thanks for your help Siava!