i am really puzzled
I am a bit puzzled now,
if PhpDig could search the website from Internet connection, why doesn't it index it locally on my machines. Currently in my LAN Phpdig searches many websites in the Intranet, but for the Internet website (behind a proxy), it only indexes the documents under the root, for example, "hompage/test.htm" could be indexed, but, "homepage/about-us/test.htm" will not be indexed.
Why does it follow only the links for the documents under the root of the website only ?
Do you have any hints ??
|