gkdeveloper
09-12-2007, 03:54 AM
I've come across this old thread ( http://www.phpdig.net/forum/showthread.php?threadid=383 ) in relation to using the <!-- phpdigExclude --> to prevent stuff being indexed - but this only stops text and not links from being spidered - does anyone know of a method to stop BOTH text AND links from being spidered if it is within a phpdigExclude?
I know 'Charter' states in the old thread the following:
To change this behavior, the phpdigExplore and/or phpdigIndexFile functions in robot_functions.php could be modified.
Anyone have any ideas im not an expert and have difficult following the behaviour in robot_functions.php but i'll continue to look at it.
Cheers,
I know 'Charter' states in the old thread the following:
To change this behavior, the phpdigExplore and/or phpdigIndexFile functions in robot_functions.php could be modified.
Anyone have any ideas im not an expert and have difficult following the behaviour in robot_functions.php but i'll continue to look at it.
Cheers,