PDF indexing blocked
Hi,
I'm trying to index a pdf file which I know for sure it exists like http://..../foo.pdf The console prints this : Is result test http an array: 1 What is result test http status: PDF Is result test an array: 1 What is result test status: PDF Use is executable is set to: 1 Index the pdf is set to: 1 Parse the pdf is set to: c:/bin/pdftotext.exe Does parse pdf exist: And stay blocked. What happens ? Thanx in advance. |
sorry it's this :
Is result test http an array: 1 What is result test http status: PDF Is result test an array: 1 What is result test status: PDF Use is executable is set to: 1 Index the pdf is set to: 1 Parse the pdf is set to: c:/bin/pdftotext.exe Does parse pdf exist: 1 |
In robot_functions.php, find the appropriate $command variable:
Code:
// it can have _PDF or _MSWORD or _MSEXCEL depending on binary Code:
// it can have _PDF or _MSWORD or _MSEXCEL depending on binary |
I had already changed that line but nothing more is displayed...
|
Is it just one PDF that won't index, or is it all? If just one, how large is the file? Maybe you are running out of memory? Try uncommenting error_reporting(E_ALL); in the config file, and see if a memory error occurs on reindex of the PDF file.
|
Any PDF file won't index.
the pdf file I tried is 796 kbytes... but I tried another which is 350 kb, it won't index either. I try the error_reporting... |
I tried the "error_reporting"... nothing more.
Besides, why doesn't the line "Is parse pdf executable:" display ? |
If you are only getting the following to print out, then check the code edits again to see if echo "Is parse pdf executable: " . is_executable(PHPDIG_PARSE_PDF) . "<br>"; is in there:
Quote:
|
I finally got the pdf indexing working...
BUT it only indexes a pdf when I indicate the full URL to the pdf. I have a page : http://www.ville-magny-les-hameaux.f...ain_public.htm it contains 2 simple pdf links. The spider doesn't find any pdf link into it whereas there's at least two obvious ones. I use "no" and 20 depth and 20 links parameters. Any idea ? |
When you use the code in this post, does any error message print onscreen?
|
No error message indeed...
|
Tried a test on your site with search depth one and links per four, and got the below output. Try using...
Code:
define('PHPDIG_INDEX_PDF',true); Spidering in progress... [Stop spider] SITE : http://www.ville-magny-les-hameaux.fr/ Exclude paths : - library - moteur - Pics - plan_site - x_element_base - a_mieux_connaitre/jpg - a_mieux_connaitre/geo/jpg - a_mieux_connaitre/histoire/jpg - a_mieux_connaitre/magny_chiffres/jpg - a_mieux_connaitre/patrimoine/jpg - a_mieux_connaitre/vie_municipale/jpg - actualite/jpg - b_vie_pratique/jpg - b_vie_pratique/se_deplacer/jpg - b_vie_pratique/serv_public/jpg - c_vie_eco/jpg - d_vie_cult_sport/jpg - e_vie_associative/jpg Wait... 1:http://www.ville-magny-les-hameaux.fr/actualite/com_public/main_public.htm (time : 00:00:10) + + + + + + + level 1... Wait... 2:http://www.ville-magny-les-hameaux.fr/actualite/com_public/ae.pdf (time : 00:00:36) + + + Wait... 3:http://www.ville-magny-les-hameaux.fr/actualite/com_public/ae.doc (time : 00:00:52) Wait... 4:http://www.ville-magny-les-hameaux.fr/actualite/com_public/dc5.doc (time : 00:01:12) Wait... 5:http://www.ville-magny-les-hameaux.fr/actualite/com_public/dc5.pdf (time : 00:01:28) level 2... links found : 5 http://www.ville-magny-les-hameaux.fr/actualite/com_public/main_public.htm http://www.ville-magny-les-hameaux.fr/actualite/com_public/ae.pdf http://www.ville-magny-les-hameaux.fr/actualite/com_public/ae.doc http://www.ville-magny-les-hameaux.fr/actualite/com_public/dc5.doc http://www.ville-magny-les-hameaux.fr/actualite/com_public/dc5.pdf Optimizing tables... Indexing complete ! [Back] to admin interface. |
I already use the code you give here.
The result is that "the page has been recently indexed" so it doesn't index anymore. As you saw, there are 2 pdfs in it. My spider found no pdf. He just found the dc5.pdf because I gave him explicitly... Any idea ? |
Do you have shell or command line access? If so, then "touch" the PDFs to give them a new file date. Otherwise, if you are making your PDFs, resave and FTP a new version over, so the file appears updated. See if this will let you reindex the PDFs. Of course, if the PDFs haven't changed content, no reindex is necessary, and PhpDig does look for a "Last-Modified" date. One other thing is that you should be able to delete a page/document from the PhpDig admin panel, so if you want to reindex without touching the file, try a delete and then a reindex, both from the admin panel.
|
I deleted the page from phpdig admin panel and tried to reindex... it indexes the html file itself but doesn't index the pdf links into it. As I said earlier, when I index the pdf url directly, it works...
For information, no problem of timeout. |
All times are GMT -8. The time now is 03:55 AM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.