Hi. It's not working because the exclude/include comments need to each be on their own line. If generating HTML from a script, use \n to place newlines and check the HTML source to make sure the comments are on their own lines prior to index. The comments work as follows:
Code:
<html>
<body>
This text is indexed.
<!-- phpdigExclude -->
<a href="http://www.this_link.com/is_followed.html">This text is ignored.</a>
This text is ignored.
<!-- phpdigInclude -->
This text is indexed.
</body>
</html>
To change this behavior, the phpdigExplore and/or phpdigIndexFile functions in robot_functions.php could be modified.