the links to the pages are generated by the pages themselves...
its a directory of the UK
ie. an index page placed in a county folder will create the links to all the towns/cities within that, these links would be somethhing like
leicestershire/leicester/index.php
so the links only exist after the php page has been compiled, i think i read somewhere that phpdig compiles all php then spiders it afterwards.
the index.php pages become html in content but only when compiled
hope that helps explain it!
|