370 Commits

Author SHA1 Message Date
Kishore Nallan
7ac12c0357 Merge branch 'v0.25-join' into v0.26-facets 2023-11-25 15:39:52 +05:30
Kishore Nallan
816c56fada Refactor collection resource locking.
Make collection operations more independent.
2023-11-16 14:49:29 +05:30
Harpreet Sangar
14cc364a16 Remove unused expression. 2023-11-13 15:31:55 +05:30
Harpreet Sangar
10a334cf07 Add object_array_reference_index. 2023-11-13 15:31:49 +05:30
Harpreet Sangar
aa9ff7d37e Allow a field inside an object to have reference. 2023-11-13 15:27:33 +05:30
Kishore Nallan
9921d2dc9c Spread the hash for sort index key.
This addresses an edge case where look ups were slow when there are gaps in a large key range.
2023-11-10 12:37:01 +05:30
Ozan Armağan
1ca6058abf
Merge branch 'v0.26-facets' into v0.26-facets 2023-11-07 01:48:04 +03:00
Kishore Nallan
87e0e1773c Override tagging. 2023-11-05 17:42:25 +05:30
ozanarmagan
822cb9c2cd Remove system_prompt parameter and add it to conversation models & support excluding conversation history 2023-11-04 14:43:46 +03:00
ozanarmagan
90f38987dd Use UUID for conversation ids 2023-11-03 00:47:40 +03:00
ozanarmagan
54e9498b19 Fix compile error 2023-11-02 23:30:31 +03:00
Ozan Armağan
fa11f4cd7e
Merge branch 'v0.26-facets' into v0.26-facets 2023-11-02 17:03:23 +03:00
Harpreet Sangar
b469962b42 Remove reference helper fields from response. 2023-10-31 17:36:42 +05:30
Kishore Nallan
ae597f40ba Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/index.h
#	src/collection.cpp
#	test/collection_vector_search_test.cpp
2023-10-30 21:41:47 +05:30
Kishore Nallan
59f7bf0f48 Add background thread for periodic housekeeping. 2023-10-30 18:17:54 +05:30
Kishore Nallan
9d0eaaad21
Merge pull request #1333 from ozanarmagan/v0.25-join
Support `remote_embedding_timeout_ms` and `remote_embedding_num_tries` for indexing
2023-10-27 17:36:01 +05:30
Harpreet Sangar
ce6a5c2f3f Add support for nest and merge reference include strategy. 2023-10-27 11:34:17 +05:30
Harpreet Sangar
6409875742 Fix wildcard include/exclude fields not matching id. 2023-10-27 11:34:17 +05:30
ozanarmagan
34ade97636 Support remote_embedding_timeout_ms and remote_embedding_num_tries for indexing 2023-10-26 01:04:39 +03:00
Harpreet Sangar
31938490ae Refactor Collection::validate_and_standardize_sort_fields_with_lock. 2023-10-24 12:05:01 +05:30
Kishore Nallan
e6876fa147 Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/field.h
#	src/collection.cpp
#	src/index.cpp
#	test/collection_vector_search_test.cpp
2023-10-23 18:45:18 +05:30
Harpreet Sangar
4ffbe3aad1 Add reference_index for reference array field. 2023-10-20 13:41:02 +05:30
Harpreet Sangar
8878acc0f9 Handle references for string, string[], int32, int32[], int64 and int64[] field types. 2023-10-17 11:39:25 +05:30
Kishore Nallan
dcfd336b06 Refactor field-wise search configuration parsing. 2023-10-16 11:37:25 +05:30
Kishore Nallan
5119af384e
Merge pull request #1301 from ozanarmagan/v0.25-join
Sort by vector query
2023-10-16 10:44:24 +05:30
ozanarmagan
4167fe69c8 Sort by vector query 2023-10-14 02:07:51 +03:00
Kishore Nallan
91209a17dc Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/collection.h
#	include/index.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/index.cpp
#	test/collection_specific_more_test.cpp
#	test/collection_vector_search_test.cpp
2023-10-13 19:00:17 +05:30
Kishore Nallan
40a684619b Add both sides drop tokens mode. 2023-10-10 19:18:42 +05:30
Kishore Nallan
191d62a0cb Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/collection_manager.h
#	include/index.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/index.cpp
#	test/collection_specific_more_test.cpp
#	test/collection_vector_search_test.cpp
2023-10-09 21:52:48 +05:30
Kishore Nallan
2bef32f9c6 Drop tokens direction. 2023-10-09 21:04:33 +05:30
ozanarmagan
fb36c1dd4c Update process_embedding_field_delete 2023-10-09 11:06:38 +03:00
ozanarmagan
cc54fb8176 Review changes 2023-10-09 02:04:43 +03:00
ozanarmagan
238c5f00b9 Remove collection_to_text_embedders and text_embedder_to_collections 2023-10-08 13:59:52 +03:00
Kishore Nallan
ce4b8e3e2c Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/collection.h
#	include/index.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/index.cpp
#	test/collection_faceting_test.cpp
2023-10-03 11:13:23 +05:30
Kishore Nallan
d5d9fcad1d Add flag for not keeping missing group field values distinct. 2023-09-29 16:29:23 +05:30
Kishore Nallan
4dd35835e3 Add flag prioritize_num_matching_fields. 2023-09-27 12:12:01 +05:30
Kishore Nallan
b530f80770 Drop tokens direction. 2023-09-25 07:29:55 +05:30
krunal
fe716f27b9 return parent as json object 2023-09-19 14:06:21 +05:30
ozanarmagan
bf3b58872b Remove unnecessary variables 2023-09-16 19:00:55 +03:00
Ozan Armağan
9ebc16dd74
Merge branch 'v0.26-facets' into v0.26-facets 2023-09-14 23:12:32 +03:00
ozanarmagan
405b0037da Add support for conversation model endpoints + multi search with conversations 2023-09-14 23:09:30 +03:00
Harpreet Sangar
ee05ecefa1 Support as to specify an alias for reference doc's fields.
Fix reference `include_fields` returning flattened fields.
2023-09-14 12:23:08 +05:30
Harpreet Sangar
81af3643f7 Fix "include_fields": "*, " only including indexed fields in the response. 2023-09-13 13:10:35 +05:30
Ozan Armağan
6f95caa3f3
Merge branch 'v0.26-facets' into v0.26-facets 2023-09-06 13:59:16 +03:00
Harpreet Sangar
f80184a25c Fix referenced_in not being initialized if referenced collection is created later on. 2023-09-04 19:15:27 +05:30
Harpreet Sangar
c30df4a69a Fix bug in restoring a collection having reference. 2023-09-01 12:32:31 +05:30
Harpreet Sangar
8229ba5435 Fix bug in importing a reference doc having an id field. 2023-08-29 17:09:29 +05:30
Harpreet Sangar
7264977490 Merge remote-tracking branch 'up/v0.26-facets' into v0.26-facets 2023-08-23 16:08:20 +05:30
Harpreet Sangar
79b5afe7d9 Include reference fields in case of many-to-many relation. 2023-08-23 16:07:37 +05:30
ozanarmagan
589ac8747c Move system_prompt and qa & add support for stoing conversation history and follow up 2023-08-22 20:16:53 +03:00