How does PhpDig epure text?
 

I had a closer look at PhpDig code and couldn't find how does PhpDig epure texts.
I'm wondering how it strips the text into keywords.

phpdigEpureText() removes dots (periods) and multiple spaces. However, I was unable to get to know how it removes other punctuation marks (comma, semi-colon...)

I would like to exclude multi-byte punctuation marks used in Japanese from keywords stored in the DB.

Any help, please.

PhpDig v.1.8.8 RC1 strips punctuation off the front and back of a 'word' where a 'word' is defined by space breaks. There are a couple of spots where this occurs. Search the PhpDig files for [\x00 to find the spots.