Spider site with links

[dell_10]

Hi..
i need help ?????????????????????
1) I have 2 web sites and phpdig run on solaris machine when we indexing Server A (Windows 2000 Advances Server ) evry thing OK but whem im try index B (Windows 2003 Server) On this Server im only have folder includes MS word and PDF Files and only on HTML page this page include links to this documents and PDF Files ,,, i'm Try to index this page http://serverB/Folder/
got only fisrt page indexed and No Links Found

Im posting my COnfig File and wish any one can help me

2) i need to know if there is and hosting companies support phpdig so i can put phpdig there thanks

[dell_10]

Whta ???????????
Any one can help me or what ?????

[dell_10]

Hi..
i need help ?????????????????????
1) I have 2 web sites and phpdig run on solaris machine when we indexing Server A (Windows 2000 Advances Server ) evry thing OK but whem we try index Server B (Windows 2003 Server) [ On this Server we only have folder includes MS word and PDF Files and only on HTML page this page include links to this documents and PDF Files ,,, We Try to index this page http://serverB/Folder/page.htm
got only fisrt page indexed and No Links Found
Im posting our Config File and wish any one can help me

2) i need to know if there is any hosting company support phpdig so i can put phpdig there thanks

[Charter]

1) http://www.phpdig.net/forum/showthread.php?t=799

2) PhpDig can run on a lot of, but not all, remote servers

[dell_10]

Dear ...
i don't have any problem with using external binaries my problem is when im trying to index another server (.NEt Server) include folder contain sub folders this sub folder contain files (word, xls, pdf ) and the main folder contain html page with links to this files when im start index this server and put the path to this html page i think phpdig will spider and follow links frm this page and index filse .. i try it on another server (2000 Advance server) and it's work but i can't make it done on this .NET Server the result only indexing of the page without any links
and when im try to index any file bu put the full path of the file phpdig can index it

[asanad]

Dear all:

I am a new commer to this forum, I really like PHPDig very much.
Still I have a problem in one of my servers, whenever I try to crawl that specific Server, PHPDig just crawls the first page then it stops going deeper in the levels. It simply gives me "No temporary table links" or something like that.
For example, I have a document called "doc1.txt" its under the folder "test" in "Server A". When I tell PHPDig to index "http://ServerA/test/doc1.txt" ot indexes the file. Now, i need to index all the documents, so I created a file called "index.html", this file caontains a link to all the documents under the folder "test" , for example, "doc1.txt, doc2.txt,doc3.htm,doc3.pdf, doc4.doc". PHPDig for some reason indexes only the "index.html", it does not go and crawl the links within the page.

Could you please give me a hint, why this is happening.
many thanks for your help and support.

[Charter]

If PhpDig can index the HTML page but won't follow the links and index the DOC, XLS, and PDF files, then that seems to indicate an external binary problem on the one server.

[asanad]

Thank you for your quick reponse,

I forgot to mention to you that PHPDig is residing on a Unix server, it is able to completely index many other servers sucessfully. This case is only for a specific server.

So, all the binaries and conversions work on the PHPDig Unix Server, it is just the issue that one of the destination servers does not crawl properly.

Regards

[Charter]

Okay, that changes my response. ;)

Some thoughts: check the destination server request and error logs, and also check the MIME type mappings on the destination server.

[dell_10]

Hi :smoke:
My problem is:
i have 3 servers: Unix(Phpdig Server),2 windows Servers (A,B)
PhpDig crawl Server A completley But it's only crawl & index 7 Pages on Server B, This server contain more than 500 pages.
** No Problems with conversion tools like catdoc ...
Any idea please

[asanad]

I have checked the request and MIME type, it seems normal , does PHPDig have certain settings for the mime type on the server ?