429 Commits

Author SHA1 Message Date
Kishore Nallan
5e6b35b333 Merge pull request #39 from typesense/large_string_overflow
[Patch] Fixed an edge case that causes overflow when querying large string fields.
2018-06-09 07:34:28 +05:30
Kishore Nallan
6bb139399d Fixed an edge case that causes overflow when querying large string fields. 2018-06-08 20:59:14 +05:30
Kishore Nallan
0c765250d3 Update README to use 0.9.0 2018-06-04 20:26:10 +05:30
Kishore Nallan
2d0192cc93 Merge pull request #37 from typesense/rocksdb_upgrade_5_13_1
Upgrade to RocksDB 5.13.1
2018-05-29 08:42:41 +05:30
Kishore Nallan
a62e0faeef Upgrade to RocksDB 5.13.1
Mostly to fix a crash issue:

https://github.com/typesense/typesense/issues/36
https://github.com/facebook/rocksdb/issues/1370

Fixed by: 2a6d0cde72
2018-05-24 21:20:33 +05:30
Kishore Nallan
0a2fa3b9dd Merge pull request #32 from typesense/highlight_all_fields
Highlighting should include all search fields, and not just the best matched field.
2018-05-24 18:40:32 +05:30
Kishore Nallan
c5b7f3c7e2 Return snippets of best matched array elements instead of just the best matched element.
However, we limit the number of snippets returned to 5 for now.
2018-05-22 14:48:25 +05:30
Kishore Nallan
76febf74d0 Improve benchmark utility. 2018-05-22 14:39:13 +05:30
Kishore Nallan
0014e19ea6 Highlighting should include all search fields, and not just the best matched field. 2018-05-14 14:11:14 +05:30
Kishore Nallan
7f7dcd814e Merge pull request #30 from typesense/wildcard_query_support
Support wildcard query: using a * would ignore the search query and consider all records for filter+sort.
2018-05-13 11:30:08 +05:30
Kishore Nallan
b467133cf9 Merge pull request #28 from typesense/include_exclude_fields
Include exclude fields
2018-05-13 07:06:31 +05:30
Kishore Nallan
2d7e75caa5 Support wildcard query: using a * would ignore the search query and consider all records for filter+sort. 2018-05-12 09:48:29 +05:30
Kishore Nallan
969b2cc15f Merge pull request #26 from typesense/highlight_for_string_array
Highlight support for string array
2018-05-08 22:00:46 +05:30
Kishore Nallan
95112a8086 Support inclusion and exclusion of document fields that are returned in search response. 2018-05-08 07:53:13 +05:30
Kishore Nallan
3cdeff7814 Snappy compression is enabled by default but setting it explicitly nevertheless. 2018-05-08 07:52:29 +05:30
Kishore Nallan
46983ba6b4 Simplify the structure of the "highlight" field in response. 2018-05-05 17:48:04 +05:30
Kishore Nallan
4f1736124b Use heap allocation rather than stack allocation for topster data. 2018-05-04 20:23:28 +05:30
Kishore Nallan
8902cf58df Tweak dockerfiles to ensure that downloads are not being pulled over and over.
ADD does not cache http fetches, so using CURL.
2018-05-04 20:22:28 +05:30
Kishore Nallan
56ed39e3ff Refactor topster to ensure that it handles insertion of duplicate keys.
Instead of ignoring a duplicate blindly, ignore when match score is less than existing key.
2018-04-30 20:28:56 +05:30
Kishore Nallan
71f1fbb4aa Refactor query index logic. 2018-04-25 19:32:46 +05:30
Kishore Nallan
1d1cd2459b When multiple fields are searched, the same document should not be returned twice. 2018-04-24 17:49:04 +05:30
Kishore Nallan
33552ca627 Change structure of hightlight in response to allow sending the matched array index. 2018-04-23 21:54:08 +05:30
Kishore Nallan
d4d1a9e3bd Fuzzy prefix searching should rely on the intermediate cost rather than the final cost.
Since we are only trying to match the prefix part, comparing the prefix with the full string makes no sense.
2018-04-21 20:14:10 +05:30
Kishore Nallan
b669a47c29 Highlight best matched string in an array.
An ARRAY_SEPARATOR delimiter is used to demarcate offsets of tokens from different indices of an array. Plain string fields are treated like a single-element array field, but without needing to use a delimiter.
2018-04-20 16:44:17 +05:30
Kishore Nallan
dea9df233f Merge pull request #24 from typesense/drop_tokens_threshold
Introduce a drop tokens threshold parameter
2018-04-15 13:46:57 +05:30
Kishore Nallan
b186816ca5 Respect drop_tokens_threshold even when that token does not exist in the index. 2018-04-13 16:52:51 +05:30
Kishore Nallan
874b5beb89 Fix initialization of priority queue. 2018-04-12 20:56:44 +05:30
Kishore Nallan
5a3482435b Refactor type definition of art node priority queue comparator. 2018-04-12 20:40:03 +05:30
Kishore Nallan
6ad5e36179 Allow configuring a threshold for dropping tokens.
Fixes https://github.com/typesense/typesense/issues/20
2018-04-12 19:25:59 +05:30
Kishore Nallan
1b966f1c93 Add a FAQ section. 2018-04-09 20:01:55 +05:30
Kishore Nallan
63134aa2da Update docs. 2018-04-06 21:55:14 +05:30
Kishore Nallan
e0c671522c Merge pull request #19 from typesense/normalize_unicode
Normalize unicode
2018-04-04 22:34:26 +05:30
Kishore Nallan
ccd654af94 Update README. 2018-04-04 19:05:56 +05:30
Kishore Nallan
c0d7e57c62 Only lowercase, don't substitute latin chars to ASCII.
There was a noticeable slow-down. To be explored in future, potentially behind an optional flag.
2018-04-04 19:05:48 +05:30
Kishore Nallan
96f1340c73 Locating ICU library on Mac requires additional hint. 2018-04-02 20:29:47 +05:30
Kishore Nallan
e558257b5f Remove dependency on miniutf. 2018-04-02 19:08:36 +05:30
Kishore Nallan
7101875d26 Ensure that G3log is linked to statically. 2018-04-02 18:10:57 +05:30
Kishore Nallan
ddcb89843f Experimenting with ICU linking options. 2018-04-02 18:10:09 +05:30
Kishore Nallan
55ac4feb08 Normalize unicode characters using ICU. 2018-04-02 11:26:32 +05:30
Jason Bosco
362e83a160 Updated CircleCI badge style 2018-04-01 00:49:21 -07:00
Jason Bosco
81d7ce9dbf Added CircleCI badge 2018-04-01 00:32:15 -07:00
Jason Bosco
325fa95da3 Merge pull request #18 from wreally/circle-ci
Setup tests to run on CircleCI [WIP]
2018-04-01 00:11:34 -07:00
Jason Bosco
29da6295d9 Fix cache path 2018-03-31 17:28:26 -07:00
Jason Bosco
ff0218a24e Fix artifact path 2018-03-31 17:22:47 -07:00
Jason Bosco
aa59cac7c2 Add latest version of git 2018-03-31 17:22:47 -07:00
Jason Bosco
c77edc0c22 Add git-core, consolidate apt-get, switch from using curl to ADD 2018-03-31 17:22:47 -07:00
Jason Bosco
5ad4007194 Added instructions to push 2018-03-31 17:22:46 -07:00
Jason Bosco
032198a117 Store artificats 2018-03-31 17:22:46 -07:00
Jason Bosco
3cded7207a Cleaned up dockerfile, consolidated apt-get and switched from curl to ADD 2018-03-31 17:22:46 -07:00
Jason Bosco
5f8420fbf7 CircleCI WIP 2018-03-31 17:22:46 -07:00