Earlier I did experiments and concluded the following:
- if you ask PhpDig to index from some URL such as foo.com/french/index.htm
- if all hyperlinks from that page and the linked ones are limited to foo.com/french (i.e. there is no cross-link to english)
- then PhpDig will only index foo.com/french
Just yesterday I tried again and for some reason that I do not yet understand, PhpDig found out about "english" while indexing "french". I have to find out why, because the whole philosophy for my site and its indexing counts on the results of my first experiments, i.e. you can indeed index only a single branch of a site, provided that you are careful with where hyperlinks point to.
Charter, a few comments would be welcome.
__________________
René Haentjens, Ghent University
|