PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   Troubleshooting (http://www.phpdig.net/forum/forumdisplay.php?f=22)
-   -   do not index directory listing on web server ? (http://www.phpdig.net/forum/showthread.php?t=2341)

ipguy 01-16-2006 03:21 PM

do not index directory listing on web server ?
 
Hi all

Anyone know how i can NOT index directories listings on the web server ?

To clarity, i don;t want phpsig to index the web server's listing of files in any directory under the web root, just the contents of allowed files themselves.

Dave A 01-17-2006 11:56 AM

Hi I would imagine that you could set your robots.txt file to exclude certain files and directories from being indexed by the webspider.
Information about the settings should be available on the web, some information can be found at http://www.wnpro.com/robots.html but heaps of websites give details of the settings required.

I hope this helps
Dave A


All times are GMT -8. The time now is 06:51 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.