PDA

View Full Version : do not index all pages


robilix
11-25-2003, 02:41 AM
Hi!

i have a problem
i have installed pgpDig, and started to index my page
www.aiudonline.ro

because of the forum (phpBB) the index started more then 10 hours agoo and still not finished.

how i can exclude for example the forum
www.aiudonline.ro/forum
because the forum already have the search function and than don't need it.

thanks,
Robert

Charter
11-25-2003, 08:04 AM
Hi. There are three ways to exclude portions of a site.

Use the values for PHPDIG_EXCLUDE_COMMENT and PHPDIG_INCLUDE_COMMENT in the HTML, each on their own line, to exclude a portion of a page like so:

<!-- phpdigExclude -->
<a href="http://www.this_link.com/is_followed.html">This text is ignored</a>
This text is also ignored
<!-- phpdigInclude -->

Use a robots.txt file, placed in web root, with the following text:

User-agent: PhpDig
Disallow: /forum

If the forum directory has been indexed, go to the PhpDig admin panel, click the site, click the update button, and click the red exclude circle symbol next to the forum directory to delete and exclude it from future indexing.

robilix
11-25-2003, 02:50 PM
thanks a lot
www.aiudonline.ro/search

and it's working :)

nice day,
robert