Thanks for the message. Prior to receiving your answer I had worked with my website provider (Affinity.com) and we were able to spider URI's on dedicated servers and always had failures on all URI's that were placed on shared (clustered) servers.
I requested for Affinity.com to add an entry to the hosts file but I was told that the TCP/IP address that I have is a fake one and not suitable for use in the hosts file [Ed. note: What???? this is way over my head!]. Affinity.com will ask one of its higher-level technicians on Monday to look into possible solutions and get back to me.
I also found another thread in this forum suggesting a solution like spidering
http://www.affinity.com/~mywebsite/ and then manually editing the entries in mySQL to
http://www.mywebsite.com instead. However the lower-level technician and myself were unable to find a suitable URI address for the workaround. We will also ask the high-level technician to explore this possiblity on Monday.
In conclusion, I think that my installation of PHPdig is working just fine and the problem is on the server side. Do you agree?