PhpDig.net - View Single Post - do not index directory listing on web server ?

Dave A · 01-17-2006, 11:56 AM

Hi I would imagine that you could set your robots.txt file to exclude certain files and directories from being indexed by the webspider.
Information about the settings should be available on the web, some information can be found at http://www.wnpro.com/robots.html but heaps of websites give details of the settings required.

I hope this helps
Dave A

01-17-2006, 11:56 AM	#2
Dave A Purple Mole Join Date: Aug 2004 Location: North Island New Zealand Posts: 170	Hi I would imagine that you could set your robots.txt file to exclude certain files and directories from being indexed by the webspider. Information about the settings should be available on the web, some information can be found at http://www.wnpro.com/robots.html but heaps of websites give details of the settings required. I hope this helps Dave A