PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   Troubleshooting (http://www.phpdig.net/forum/forumdisplay.php?f=22)
-   -   Spidering problems (http://www.phpdig.net/forum/showthread.php?t=2084)

Dave A 07-20-2005 03:14 AM

Spidering problems
 
I can't stop any spidering going on, if I go to phpadmin and do a search for locked and place a 1 so anything that has a 1 is locked I get two websites shown as locked, if I press the refresh button I get a different two or sometimes three websites showing up as spidering and locked.
I can't seem to stop a website from starting to spider all on it's own
Even if I go down the list of web sites on the admin pannel they often show up as okay and not being spidered but as soon as I click clean common words it shows an error nessage stating that it can't be done when websites ar locked for spidering.
So I need to find some way to stop this, I have reset the server but it started again, I have gone into phpmy admin and repaired all the databases but I still can't get PHPDIG to stop spidering.
If any one has an idea I can try please can they get back to me..

Many regards
Everyone
Dave A

Charter 07-23-2005 11:36 AM

Do you see content in the tempspider table when a site is locked? If you click clean common words, the sites will also lock while the cleaning is done.

Dave A 07-23-2005 12:54 PM

re spider problem
 
Hi Charter I can't use the clean common words function becuase it always reports back that it can't do this because a site is locked.
I have gone into phpmy admin and tried to set all sites as unlocked where locked =0 but as soon as i do , then a search for locked files always show one or two locked, each time I refresh the results it shows different files as locked.

The results are mostly showing 100% but with no content when a search is done.

Your assistance is needed my friend

Dave A 07-23-2005 12:55 PM

The temp folder never shows any content when this is happening

Charter 07-23-2005 01:13 PM

In the sites table, try setting all the values in both the locked and stopped columns to zero.

Dave A 07-23-2005 02:19 PM

I have tried to set all the tables to unlocked but as soon as you go back to the menu to try and clean the common words list , it reports that i't can't because sites are locked.

I have tried to unlock them all but if I go to phpmyadmin and search for locked=1 then two are threee sites are locked, if I then edit that site the locked part of the dayabase reports it as ZERO?

Charter 07-23-2005 05:00 PM

After you run the following query, and then go back to the PhpDig admin panel, there is still a locked site? Do you have any PhpDig related cron job running?
Code:

UPDATE sites SET locked = 0, stopped = 0;

Dave A 08-20-2005 06:52 PM

Just to let you know that it is functioning okay, it has the following results:
DataBase status
Hosts : 9434 Entries
Pages : 149481 Entries
Index : 29167923 Entries
Keywords : 1516635 Entries
Temporary table : 0 Entries

This must be pushing it to the boundaries a little

lhukaz 08-21-2005 07:46 AM

Dave A

Do you have menssenger??
If you have add me! -> lhpsobral@msn.com

Thank's


All times are GMT -8. The time now is 05:06 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.