Hi. Some people just don't want their site crawled by certain bots.
Can't blame them: their site, their resources, their bandwidth. 
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
|