PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 04-18-2006, 09:03 AM   #1
themitch
Green Mole
 
Join Date: Apr 2006
Posts: 2
Another problem with spidering I'm afraid

Hi

I have been happily using phpDig on my localhost website while I develop it, now I have moved it online and it doesn't appear to be spidering?!?

Usual symptoms:

Spidering in progress... [Stop spider]
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.


Host : 1 entries
Pages : 0 entries
Index : 0 entries
Keywords : 0 entries
Temporary Table : 0 entries

I am running:
Apache/1.3.34 (Unix) mod_auth_passthrough/1.8 mod_log_bytes/1.2 PHP/4.4.2 FrontPage/5.0.2.2635 mod_ssl/2.8.25 OpenSSL/0.9.7a
mySql 4.1.18
PhpDig v.1.8.8


I have read through the forum and checked as much as I can:

1. My ABSOLUTE_SCRIPT_PATH is correct as are the other DEFINES:

define('ABSOLUTE_SCRIPT_PATH','/home/jwedding/public_html/search');
define('LIMIT_TO_DIRECTORY',false);
define('PHPDIG_SESSID_REMOVE',true);
define('PHPDIG_IN_DOMAIN',true);

"Search" is what I renamed the phpdig directory and was working fine on localhost. I also moved the search.php files to my www.domain.com directory and made the necessary changes required. As I say, this all worked fine on my local server!?

2. I'm not sure if my server is 'load-balanced' or not.

3. allow_url_fopen is ON and safe_mode is OFF

I have not checked the 'mb_ereg_replace' as I'm not sure where to find it?

Anything else I can do?

Thanks in advance.

Martin
themitch is offline   Reply With Quote
Old 04-18-2006, 11:22 AM   #2
fire59
Green Mole
 
Join Date: Apr 2006
Posts: 3
I have the same problem.
fire59 is offline   Reply With Quote
Old 04-18-2006, 02:09 PM   #3
themitch
Green Mole
 
Join Date: Apr 2006
Posts: 2
Well now I have a dilemma!

After trying EVERYTHING I gave up on phpDig ... although I had invested quite a lot in customising it and integrating it.

I installed iSearch locally, got that to work fine ... uploaded it to my webserver only to be faced with the same No index problem. Grrrrrr!

After reading their forums I realised the problem ... for iSearch and for phpDig.

I had a robots.txt on my site (because I didn't want google to index me while I was in development), and phpDig/iSearch adhere to that. Doh!

The second problem was permissioning on the admin/temp and /text_content directories. They were setup as 755 and needed to be 777.

I removed my robots.txt and chmod'd the two directories and voila ... both iSearch and phpDig work.

Now I have to decide which one I want to go with ... iSearch or phpDig. At first glances I like them both, although phpDig seems to have a nicer look to it.

Hmmmm. Anyway, hope this helps you!

Martin
themitch is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Spidering problem mark40 Troubleshooting 1 08-28-2007 04:06 AM
Problem with spidering tomjed Troubleshooting 0 02-09-2006 02:50 AM
Spidering problem please help KaZ Troubleshooting 1 12-05-2005 06:59 AM
Problem Spidering Trallis Troubleshooting 6 11-02-2005 07:58 AM
Problem Spidering jmitchell Troubleshooting 3 12-29-2004 05:42 PM


All times are GMT -8. The time now is 05:52 PM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.