dan 6024772ba2 Add a version of the unicode61 tokenizer to fts5. ...

FossilOrigin-Name: d09f7800cf14f73ea86d037107ef80295b2c173a

2015-01-01 16:46:10 +00:00

..

CaseFolding.txt

Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators.

2012-05-25 17:50:19 +00:00

mkunicode.tcl

Add a version of the unicode61 tokenizer to fts5.

2015-01-01 16:46:10 +00:00

UnicodeData.txt

Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators.

2012-05-25 17:50:19 +00:00