I was wondering if there are any optimizations one can make when spidering a site hosted on the same server (same domain)? In particular, if I tell phpdig to spider
www.mydomain.com, doesn't this involve the DNS server and a roundtrip to the internet? I tried localhost, but that didn't work (shared hosting). Any suggestions?