Strange indexing problem on my site
 

I have installed phpDig, all seems well. If I index my MAIN site (Site 1):

http://www.lowcarbnexus.com

It seems to "lock" and I get no results.

I then try one of my other sites (different server) and it works fine (Site 2):

http://www.drbillbailey.net

Site 1 is on Red Hat Enterprise Linux 3.0

Site 2 is on Red Hat Linux 9.0

Both are running Apache 2. HELP!

Hi. Does it give a "no links found" message? Is PHP in CGI mode? It sounds like the issue may be related to one in this thread.

Thanks for the quick reply, however, I'm not sure if it is PHP version issue...
here's my server (that doesn't work) data:

Server Host: picard.drbillbailey.net
Server OS: Linux 2.4.21-4.0.1.EL Database: MySQL 4.0.16-standard
Server Date: 12/31/2003 14:21:11 Datebase Date: 12/31/2003 14:21:11
Server Up Time: 14:21:11 up 7 days, 21:06, 2 users, load average: 0.00, 0.00, 0.00
HTTP Server: Apache/2.0.46 (Red Hat)
PHP Version: 4.3.2 (Zend: 1.3.0)

Oops! I mean to put in the results page... as I say, it "goes away" for some time, then returns this page:
-----

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://www.lowcarbnexus.com/
Exclude paths :
- @NONE@
No link in temporary table

--------------------------------------------------------------------------------

links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

------
There are about 252 pages on the site. I am ranked number one on Google for "low carb foods". I am puzzled! Thanks for any insights!

Hi. Is PHP in CGI mode? It's the second issue in that thread that may be the problem, not the PHP version. Does PhpDig give a "no links found" message when you try to crawl http://www.lowcarbnexus.com? The lowcarbnexus.com site is abe to be crawled, see below. Is PhpDig installed on the same server as lowcarbnexus.com?

cut -----
This is normal, the CGI platform is a loadbalanced cluster of servers, it is therefore not possible to connect back to "itself" on the loadbalanced address.

We are investigating other possibilities to enable this for the use of htdig etc although there is no ETA for this.
---- cut

links found : 41
http://www.lowcarbnexus.com/
http://www.lowcarbnexus.com/error.html
http://www.lowcarbnexus.com/drbill.htm
http://www.lowcarbnexus.com/catalog/
http://www.lowcarbnexus.com/index.html
http://www.lowcarbnexus.com/catalog/products_new.php
http://www.lowcarbnexus.com/hints_and_tips.htm
http://www.lowcarbnexus.com/LCNForums.html
http://www.lowcarbnexus.com/catalog/LCN/shipping.html
http://www.lowcarbnexus.com/belindas_low_carb_recipes.htm
http://www.lowcarbnexus.com/Articles.htm
http://www.lowcarbnexus.com/lowcarb_links.htm
http://www.lowcarbnexus.com/catalog/LCN/security.html
http://www.lowcarbnexus.com/catalog/LCN/privacy.html
http://www.lowcarbnexus.com/compatibility.htm
http://www.lowcarbnexus.com/kosher.htm
http://www.lowcarbnexus.com/catalog.html
http://www.lowcarbnexus.com/search.htm
http://www.lowcarbnexus.com/contact_us.htm
http://www.lowcarbnexus.com/catalog/login.php
http://www.lowcarbnexus.com/store_tour.htm
http://www.lowcarbnexus.com/vitamins.htm
http://www.lowcarbnexus.com/comments.htm
http://www.lowcarbnexus.com/low_carb_nexus_bookstore.htm
http://www.lowcarbnexus.com/tellafriend.php
http://www.lowcarbnexus.com/listserv.htm
http://www.lowcarbnexus.com/error.html
http://www.lowcarbnexus.com/CNHP.htm
http://www.lowcarbnexus.com/AtkinsCARECenter.html
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/135
http://www.lowcarbnexus.com/catalog/index.php?manufacturers_id=12
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/128
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/132
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/107
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/321
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/246
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/320
http://www.lowcarbnexus.com/media/LCN60secSpot.wma
http://www.lowcarbnexus.com/new_cart_features.html
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/318
http://www.lowcarbnexus.com/catalog/product_info.php/products_id/319
Optimizing tables...
Indexing complete !

It says: "links found : 0"

It is, indeed, running on the same server. I also installed it on my other server (running Red Hat 9, rather than Red Hat Enterprise Server ES3.0) and it works from there for its own sites, but not to index the Nexus Site on the other server (that the Nexus is on.) I get this message from the RH9 server running against the RHES3 server (Nexus Target Server):

-----

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://www.lowcarbnexus.com/
Exclude paths :
- @NONE@
No link in temporary table

--------------------------------------------------------------------------------

links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Hi. Can you posts the links to the PHP info for each server?

Click to see the info for the Red Hat ES30 (non-working) server:

http://www.lowcarbnexus.com/php_info.php

Click to see the info for the Red Hat 9.0 (working) server:

http://www.drbillbailey.net/php_info.php

Hi. This is puzzling. How about some error logs? Maybe that will give an idea.

Guys, thanks SO MUCH for looking into this... but due to time constraints and other factors I ended up going with a solution that indexes "off system" for my web site. You guys have better (and quicker) support than many "for profit" businesses do, though! Open Source rocks!