12 Commits

Author SHA1 Message Date
Kishore Nallan
a9c15ec0f7 Fix facet highlighting for Cyrillic text. 2021-12-09 10:54:47 +05:30
Kishore Nallan
bd6fd1c03e Improve Cyrillic support. 2021-12-02 16:17:01 +05:30
Kishore Nallan
07d838e385 Make symbols for indexing and segmentation configurable. 2021-08-26 10:27:18 +05:30
Kishore Nallan
8726e27718 Support Chinese locale. 2021-06-06 22:03:02 +05:30
Kishore Nallan
56d3a26cc5 Imporve prefix searching on ko locale. 2021-05-31 19:47:12 +05:30
Kishore Nallan
b3b47f5651 Refactor highlighting + tokenizer to simplify logic. 2021-04-18 20:37:58 +05:30
Kishore Nallan
1d1712f391 Refactor tokenizer to use index, skip and separate logic. 2021-04-16 17:55:52 +05:30
kishorenc
3a92685967 Integrate with Kakasi. 2021-04-05 12:25:50 +05:30
kishorenc
dd72e2a78c Introduce field level locale. 2021-04-02 21:28:49 +05:30
kishorenc
c2eec85277 Fix highlighting of strings with special characters. 2021-03-20 12:58:30 +05:30
kishorenc
9533b73609 Fixed a few higlighting/splitting edge cases. 2020-11-17 20:10:34 +05:30
kishorenc
6997e35f72 Combine various token operations in a single flow.
Splitting, normalizing etc. are now done in a single loop.
2020-11-17 20:10:34 +05:30