Exclude links with certain url variabls
Hi there,
Every page on my website has a link to a printer-friendly version of the same page, done with [thispage.php?print=y]
I need to exclude these links from the spidering process, but without excluding other url variables such as [news.php?story=11]
Basically I need a way to tell the spidering process not to follow links containing a specific string (in this case '?print=y'). I can't find this feature already there, so can someone guide me to the right fuction and how to modify it?
Thanks
|