PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 04-27-2004, 09:58 AM   #1
acidelic
Green Mole
 
Join Date: Apr 2004
Posts: 4
Unhappy Spider process does not do anything

I'm encountering a problem getting the spider to work. Creating a robots.txt file did not seem to help.

Here is my robots.txt:

User-agent: *
Disallow: /include/

When I tell it to spider localhost or the hostname of the local server (depth=5) always results in this:

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://localhost/
Exclude paths :
- include/

There are no CPU cycles being used and the page is fully loaded. What else can I check? How will I know that the spider process is actually doing something?

Thanks
acidelic is offline   Reply With Quote
Old 05-01-2004, 07:32 AM   #2
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
Hi. Try this thread.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Old 05-10-2004, 09:26 AM   #3
acidelic
Green Mole
 
Join Date: Apr 2004
Posts: 4
I took a look at the article and I don't think that is the problem. I have a single web server with one NIC. I'm trying to spider the local web server, but I never see any results. I don't see any progress on the page (which also says it is "Done") and it will sit there forever doing nothing. I tried spidering some other sites but nothing happens with those either.

What else is there that I can check?
acidelic is offline   Reply With Quote
Old 05-12-2004, 02:33 AM   #4
Siava
Green Mole
 
Join Date: May 2004
Location: Russia (Saint-Petersbrg)
Posts: 16
Thumbs up

acidelic
In config.php set up define('USE_IS_EXECUTABLE_COMMAND','0');

(It is the best search script!)
Siava is offline   Reply With Quote
Old 05-12-2004, 04:48 AM   #5
acidelic
Green Mole
 
Join Date: Apr 2004
Posts: 4
Cool

That did the trick!!! The spider page didn't load, but if I refresh the admin page I can see the counts going up. And I can actual search for things on the site. Thanks for your help Siava!
acidelic is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Spidering process hanhand Troubleshooting 1 07-04-2004 04:03 PM


All times are GMT -8. The time now is 12:23 PM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.