Hi. Here are a couple of simple robots.txt examples:
# Disallow PhpDig from dir_to_exclude
User-agent: PhpDig
Disallow: /dir_to_exclude/
# Disallow all robots from all directories
# assuming the robots obey robots.txt
User-agent: *
Disallow: /
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
|