PhpDig.net - specific links not spider

The phpdigExclude and phpdigInclude tags work like this:

Code:

<html>

<body>

<a href="http://www.this_link.com/is_followed.html">This text is indexed.</a>

This text is indexed.

<!-- phpdigExclude -->

<a href="http://www.this_link.com/is_followed.html">This text is ignored.</a>

This text is ignored.

<!-- phpdigInclude -->

<a href="http://www.this_link.com/is_followed.html">This text is indexed.</a>

This text is indexed.

</body>

</html>

Note that the phpdigExclude and phpdigInclude tags need to be on their own lines. If dynamically including a portion of a page, you may need to add a \n newline before and/or after the phpdigExclude and phpdigInclude tags, so that in the HTML source, the tags appear on their own lines.

To exclude specific links from being indexed, try using a robots.txt file, editing FORBIDDEN_EXTENSIONS in the config file, using a no index no follow META tag, or crawl the links and then exclude directories from the admin panel. The FORBIDDEN_EXTENSIONS option requires some regex knowledge.