PDA

View Full Version : do not index directory listing on web server ?


ipguy
01-16-2006, 03:21 PM
Hi all

Anyone know how i can NOT index directories listings on the web server ?

To clarity, i don;t want phpsig to index the web server's listing of files in any directory under the web root, just the contents of allowed files themselves.

Dave A
01-17-2006, 11:56 AM
Hi I would imagine that you could set your robots.txt file to exclude certain files and directories from being indexed by the webspider.
Information about the settings should be available on the web, some information can be found at http://www.wnpro.com/robots.html but heaps of websites give details of the settings required.

I hope this helps
Dave A