|
One thing I left out, and am not sure if it makes a difference. I'm running the spider from my home server (IIS) on my website. The idea is to later move my database and the search feature to my hosting server, but just run the indexing from home.
Not sure if that messes up the paths for exclusion.
|