|
Download -
PHP Reference -
Links -
Demo 1.8.9 RC1 -
API
License - Credits - Copying - Changelog - Documentation |
|
|
11-03-2004, 01:54 AM
|
#1 |
|
Green Mole
Join Date: Oct 2004
Location: Senlis (60) France
Posts: 18
|
How to exclude subdirectories while indexing a site
Good morning,
Is it possible, when indexing a site, to exclude all or some subdirectories ? Thanks 
|
|
|
|
11-08-2004, 04:23 AM
|
#2 |
|
Green Mole
Join Date: Oct 2004
Location: Senlis (60) France
Posts: 18
|
I have found this in documentation
================================================= 3.4. Other features ------------------------- PhpDig Tries to read a robots.txt file at the server root. It searches meta robots tags too. ================================================== Please how does this feature function ? How are the robot.txt record's. Where is this file ? |
|
|
|
|
11-10-2004, 02:48 AM
|
#3 |
|
Green Mole
Join Date: Oct 2004
Location: Senlis (60) France
Posts: 18
|
I have found what I was seeking for.
The solution is to create a "robots.txt" exclusion file at the root of the site. Informations about robots exclusion at : http://www.robotstxt.org/wc/norobots.html |
|
|
|
 |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Not Indexing Site | Lord_Goran | Troubleshooting | 1 | 11-09-2007 07:10 AM |
| Exclude links from indexing, keep text | digger_123 | How-to Forum | 0 | 12-20-2006 04:14 AM |
| successful indexing of every site but site where phpdig is served | phillystyle123 | Troubleshooting | 1 | 02-21-2005 09:06 PM |
| Subdirectories but not higher directories | td234 | How-to Forum | 14 | 02-08-2005 03:09 PM |
| Don't index all subdirectories | Shadowalex | Troubleshooting | 2 | 01-10-2005 03:03 AM |
