Check out section 6 of the
documentation. Also, try changing some of the config file options such as LIMIT_TO_DIRECTORY, PHPDIG_IN_DOMAIN, *_MAX_LIMIT, and *_LIMIT. Without knowing more about the pages you are tring to index, I don't know why you'd be getting ones in the tempspider table. Perhaps you can provide some examples?