I'm just upgrading my hosting to a Dell Rack mount 3.2 Gig processor, 512 mb ram and 64gb hard disk.
The spidering times vary heaps a few hosts I have tried to spider were home PC's connected via ADSL broadband and it took an age to index them.
One guy complained and said the spider wasn't well behaved and it was doing a get command every one second which he thought was too much.
How you can expect a commercial web site to run from a home computer I am not sure if it would work.
|