indexing doesn't work on the serverver it should

[OceanSurf]

Hi.

I have set up a testing phpdig on my local machine and it worked okay. When I moved the page to the 'real' server and ran the phpdig spider there to index the site it only logged the Host and nothing else. I have no idea why. chmods are the way they should be. When I indexed the site with my local machine everything worked fine. Does anyone have a clue of what is wrong?

Cheers.

[vinyl-junkie]

Could you post the exact error messages you're getting?

[OceanSurf]

it's not an error i guess, it's just that it doesn't find any links.

Spidering in progress...
SITE : http://www.the_domain.com/
Exclude paths :
- @NONE@
No link in temporary table
links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !

But when I spider the same domain with my machine i get 108 links that are indexed. What's the catch? MySQL grant permissions?

[dnuttall]

it's not an error i guess, it's just that it doesn't find any links.

Spidering in progress...
SITE : http://www.the_domain.com/
Exclude paths :
- @NONE@
No link in temporary table
links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !

But when I spider the same domain with my machine i get 108 links that are indexed. What's the catch? MySQL grant permissions?

I get identical results as above.

[michy]

I have exact the same problem, anyone got a clue ?

[dnuttall]

Indexing doesn't work unless your target has a "links" via "<a href=something>something</a>" tags.

I can make it work by artificially populating the index.html/php file, but what I'd like to do is make it index what ever it finds in the directory and it seems like that means the spider has to be modified.

FWIW, I've also found that it can be somewhat unreliable in terms of stepping thru a long list of files when the files have to be converted to text. I've never been able to get thru a complete but long list of referenced files and when it quits, it leaves the system (PHPDig, not the base computer) in "locked" mode, which I have yet to figure out how to gracefully UNlock.

YMMV but so far, I don't see it as quite ready for prime time, but I would LOVE to be corrected on that! lol.

Best to all who shall hear these presents.

Dave in San Antonio, Texas.

[Charter]

Uh, dnuttall, then it's working as it should. PhpDig is a "web spider" and "search engine." Where does it say that PhpDig traverses directories, and what is PhpDig supposed to do if PHP is out of memory? Rhetorical questions, sure, however these "complaints" have likely been answered in one way or another somewhere on the forums.

http://www.phpdig.net/forum/showthread.php?t=1139
http://www.phpdig.net/forum/showthread.php?t=1158

[instyle]

I am having exactly the same issue. PhpDig works perfectly on my local machine and my local machine can spider my external domain. However when I install phpdig in my web hosting it just searches the first page BUT nothing is written to the database under keywords.

Oh, and I could see an answer to the problem in the two threads named above.

Thanks :bang:

[instyle]

I am having exactly the same issue. PhpDig works perfectly on my local machine and my local machine can spider my external domain. However when I install phpdig in my web hosting it just searches the first page BUT nothing is written to the database under keywords.


My problem is fixed. It was to do with permissions of the directories. had to change them to 755.