PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 10-26-2005, 03:47 PM   #1
noel
Orange Mole
 
Join Date: Aug 2005
Posts: 44
Shell command no indexing

Hello,

If I put :

php -f spider.php http://www.a site.com

The spider find links

If I put

php -f spider.php forceall

to force update of all the database, it didn't find any links, I have @NONE@ for all the sites.


What I have to do ?

Thank you

Noël

P.S: When you will come back , you will have work )))
noel is offline   Reply With Quote
Old 10-26-2005, 11:23 PM   #2
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
The @NONE@ refers to what PhpDig finds from a robot.txt file. Try setting up the shell index so PhpDig runs in the background and logs the output to a file. There are instructions for how to do this here. Also nix this bug. After another forceall index is complete, what do you see in the log file?
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Old 10-27-2005, 08:07 AM   #3
noel
Orange Mole
 
Join Date: Aug 2005
Posts: 44
[root@wpc1460 admin]# php -f spider.php forceall >> spider.log
Failed loading /usr/lib/ioncube/Ioncube_loader_lin_4.4.so: /usr/lib/ioncube/Ioncube_loader_lin_4.4.so: cannot open shared object file: No such file or directory

But the spider is working because the log file , is update , here is a small copy because because is still spidering there are 700 sites :

5726: old priority 0, new priority 18
Exploration des liens en cours...
-----------------------------
SITE : http://www.fromage-corse.com/
Chemins exclus :
- @NONE@
Pas de liens dans la table temporaire
liens trouvés : 0

-----------------------------
SITE : http://www.corse-piscines.com/
Chemins exclus :
- @NONE@
Pas de liens dans la table temporaire
liens trouvés : 0

-----------------------------
SITE : http://www.corsenature.com/
Chemins exclus :
- @NONE@
Pas de liens dans la table temporaire
liens trouvés : 0
*http://www.corse-moto-service.com/ Verrouillé*

-----------------------------
SITE : http://www.corsematin.com/
Chemins exclus :
- admin__nm/
- upload/
Pas de liens dans la table temporaire
liens trouvés : 0



I have also that whith the numbre 92 what is this ?
-----------------------------
SITE : http://www.centralhotel.fr/
Chemins exclus :
- @NONE@
Pas de liens dans la table temporaire
liens trouvés : 92

-----------------------------
SITE : http://www.ccm-airlines.com/
Chemins exclus :
- @NONE@
Pas de liens dans la table temporaire
liens trouvés : 92

-----------------------------
SITE : http://www.castelbr****.com/
Chemins exclus :
- @NONE@
Pas de liens dans la table temporaire
liens trouvés : 92


Still have problem with accents , Stil have Ecluded way = @NONE@ so why it did'nt undex the site ?

Thank You

Noël
noel is offline   Reply With Quote
Old 10-27-2005, 10:22 AM   #4
Charter
Head Mole
 
Charter's Avatar
 
Join Date: May 2003
Posts: 2,539
The 'failed loading - cannot open shared object file' message is not a PhpDig issue. You'll need to look at your ionCube setup for that. PhpDig 1.8.8 RC1 is set to use UTF-8 as the character encoding, so set your browser character encoding to UTF-8 when viewing the admin panel, as the characters à and © together in UTF-8 make the é in ISO-8859-1. The number 92 is telling you how many links were found so far. As PhpDig is still spidering, check and see how many links were found when it is done spidering.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
Charter is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
shell indexing problem Patrick_2a Troubleshooting 1 11-06-2005 10:30 AM
How To stop spider by shell command ? noel How-to Forum 4 11-03-2005 01:06 PM
Shell Spidering Quits After Indexing A Few Pages vinyl-junkie Troubleshooting 11 10-09-2004 06:08 PM
shell indexing problem simonced Troubleshooting 8 08-15-2004 03:01 PM
auto indexing without shell command takpoli How-to Forum 1 04-29-2004 07:26 AM


All times are GMT -8. The time now is 05:37 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.