3287 Commits

Author SHA1 Message Date
Kishore Nallan
97b0d79806
Merge pull request #1316 from ozanarmagan/v0.25-join
Add support for larger embedding models
2023-10-21 10:53:35 +05:30
ozanarmagan
3da18ea6d5 Add support for larger embedding models 2023-10-21 00:28:51 +03:00
Harpreet Sangar
4ffbe3aad1 Add reference_index for reference array field. 2023-10-20 13:41:02 +05:30
Kishore Nallan
02337fe60b
Merge pull request #1307 from ozanarmagan/v0.25-join
Fix search on non-indexed vector fields
2023-10-18 10:25:03 +05:30
ozanarmagan
dfa2872bdf Add test for vector field 2023-10-17 21:45:57 +03:00
ozanarmagan
910cedef4b Check if field in vector query is indexed 2023-10-17 15:47:28 +03:00
ozanarmagan
273e67358e Fix search on non-indexed auto embedding fields 2023-10-17 15:43:42 +03:00
Kishore Nallan
acfd047b81
Merge pull request #1305 from ozanarmagan/v0.25-join
Avoid loading embedding model that is larger than free memory
2023-10-17 17:42:39 +05:30
ozanarmagan
8392e85891 Use 'model size * 1.15` 2023-10-17 14:31:39 +03:00
Harpreet Sangar
8878acc0f9 Handle references for string, string[], int32, int32[], int64 and int64[] field types. 2023-10-17 11:39:25 +05:30
ozanarmagan
5766b83f24 Avoid loading models that larger than free memory 2023-10-17 00:26:36 +03:00
Kishore Nallan
dcfd336b06 Refactor field-wise search configuration parsing. 2023-10-16 11:37:25 +05:30
Kishore Nallan
5119af384e
Merge pull request #1301 from ozanarmagan/v0.25-join
Sort by vector query
2023-10-16 10:44:24 +05:30
ozanarmagan
a44f996a1b Update parse_vector_query_str 2023-10-15 14:34:07 +03:00
ozanarmagan
8b01c5cd85 Update error message 2023-10-15 14:27:59 +03:00
ozanarmagan
dfbb1ebfb4 Refactor vector index lookup & normalization 2023-10-15 14:08:14 +03:00
Kishore Nallan
6129715f49 Handle thread safety of search_cutoff var. 2023-10-14 20:38:36 +05:30
ozanarmagan
4167fe69c8 Sort by vector query 2023-10-14 02:07:51 +03:00
Kishore Nallan
91209a17dc Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/collection.h
#	include/index.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/index.cpp
#	test/collection_specific_more_test.cpp
#	test/collection_vector_search_test.cpp
2023-10-13 19:00:17 +05:30
Kishore Nallan
c5dbfc25bb
Merge pull request #1297 from krunal1313/facet_query_value_index
Facet query handling with value index
2023-10-13 17:17:31 +05:30
krunal
b3a94888eb add test facet query with multiple tokens to hash index tests 2023-10-13 16:22:04 +05:30
krunal
79ad74bb07 break loop if single token is not found 2023-10-13 15:56:01 +05:30
krunal
eeb7521394 handle facet query with multiple tokens in value index 2023-10-13 15:38:02 +05:30
krunal
34b5aa7d61 adding test for multiple words in facet query 2023-10-13 15:37:12 +05:30
Kishore Nallan
479b3bb139
Merge pull request #1296 from happy-san/_get_reference_collection_names
Fix crash in `_get_reference_collection_names` in case of malformed f…
2023-10-13 12:49:58 +05:30
Kishore Nallan
72adf3de8b
Merge pull request #1295 from krunal1313/posting_list_iterator
Posting list iterator
2023-10-13 12:49:24 +05:30
Harpreet Sangar
f03e749588 Add test case. 2023-10-13 11:43:58 +05:30
krunal
c7c099b8b4 intialize iterator per facet field 2023-10-13 11:32:17 +05:30
Harpreet Sangar
0e9cf7ed69 Fix crash in _get_reference_collection_names in case of malformed filter query. 2023-10-13 11:29:00 +05:30
krunal
ef7a08f9d9 fix for failing test 2023-10-11 19:11:29 +05:30
krunal
f1cbb71cdf correcting test 2023-10-11 19:10:07 +05:30
krunal
5cf8b2c8d8 add test for group_by with multiple facet field 2023-10-11 16:39:56 +05:30
Kishore Nallan
ff0d2596cc Handle zero width non-joiner character for persian.
It must split the tokens into individual words.
2023-10-11 15:02:22 +05:30
Kishore Nallan
40a684619b Add both sides drop tokens mode. 2023-10-10 19:18:42 +05:30
Kishore Nallan
9553ee35b4
Merge pull request #1293 from krunal1313/value_index_stats
min/max of all matched facets
2023-10-10 16:48:44 +05:30
krunal
cc46d213fb min/max of all matched facets 2023-10-10 15:42:16 +05:30
Kishore Nallan
d64f7f2cfe
Merge pull request #1292 from ozanarmagan/v0.25-join
Add vector query param to set hybrid saerch alpha
2023-10-10 15:30:29 +05:30
ozanarmagan
998b071956 Add test for invalid alpha params 2023-10-10 11:20:15 +03:00
ozanarmagan
7073811546 Add vector query param to set hybrid saerch alpha 2023-10-09 23:20:35 +03:00
Kishore Nallan
191d62a0cb Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/collection_manager.h
#	include/index.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/index.cpp
#	test/collection_specific_more_test.cpp
#	test/collection_vector_search_test.cpp
2023-10-09 21:52:48 +05:30
Kishore Nallan
2bef32f9c6 Drop tokens direction. 2023-10-09 21:04:33 +05:30
Kishore Nallan
d7c4072bde
Merge pull request #1286 from krunal1313/int64_stats_facets
fix address sanitizer issue
2023-10-09 20:05:19 +05:30
krunal
6b68ac6a5d fix address sanitizer issue 2023-10-09 19:29:33 +05:30
Kishore Nallan
37b3663ee1
Merge pull request #1282 from ozanarmagan/v0.25-join
Unload model from RAM when it is unused
2023-10-09 19:10:50 +05:30
Kishore Nallan
62f3609cbf
Merge pull request #1274 from krunal1313/posting_list_iterator
store posting_list iterators with facet_index initialization
2023-10-09 16:44:52 +05:30
ozanarmagan
cbc3595e70 Fix test 2023-10-09 13:19:25 +03:00
ozanarmagan
753f910915 Update test 2023-10-09 13:17:04 +03:00
ozanarmagan
0dad1a369f Add test & fine grain locking for collection manager 2023-10-09 13:14:10 +03:00
ozanarmagan
73ae433ab5 Use const auto& 2023-10-09 13:04:06 +03:00
krunal
338f30f51b add test for skip_to_rev() and bug fix for single null record 2023-10-09 14:45:18 +05:30