109 Commits

Author SHA1 Message Date
Krunal Gandhi
b256736986
allow updating remote model api_key (#1944)
Some checks failed
tests / test (push) Has been cancelled
* allow updating remote model api_key

* add nullptr checks and unique_lock

* refactor field updation flow

* Revert "refactor field updation flow"

This reverts commit a6a9847be80ce3d8cee7ea944f5e9453091a949f.

* refactor api_key updation flow

* add locks in remote embedder, update api_key after validation

* fix parsing of embed field

* fix wrong params and parse

* update minor changes, update entry in text_embedders

* add comment

* update embeded_fields with new api_key

* add lock for updating embedded fields

---------

Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-09-25 08:58:32 +05:30
Harpreet Sangar
1128f7f9dd
Merge join conditions of embedded filter_by and query filter_by (#1935)
* Move joins related functions into `Join` class.

* Add `Join::merge_join_conditions`.

* Handle join condition merge in a complex embedded filter.

* Add test case and comments.

* Fix if condition.
2024-09-06 16:39:11 +05:30
Harpreet Sangar
c8cd7e0472
Async reference field. (#1835)
* Add `async_reference` property to reference field.

* Accept `"async_reference": true` only when `reference` is provided.

* Avoid reference lookup during updation if ref helper field is present.

* Clear `referenced_in_backlog` on dispose.

* Add references asynchronously to singular reference field.

Store only the reference field name in the indexes instead of reference helper field name.

* Only update async references when a document is indexed successfully.

* Remove unused params.

* Refactor reference index.

* Move `update_async_references` into `Index`.

* Refactor `Collection::update_async_references_with_lock`.

* Handle async update of reference array field.

* Add test case.

* Remove `update_async_references` method from `Collection`.

* Add `Join` class.
2024-08-30 11:20:05 +05:30
Kishore Nallan
6659054608 Add ability to exclude fields in collection listing. 2024-07-29 16:18:54 +05:30
Kishore Nallan
6466249f76 Fix logic for finding first error in loading coll from disk. 2024-07-11 10:57:28 +05:30
Harpreet Sangar
87e33e1970
Allow joining export documents. (#1822)
* Allow joining export documents.

* Add tests.
2024-07-10 10:48:57 +05:30
Krunal Gandhi
629def6f0f
support updation of collection meta (#1779)
* support updation of collection meta

* error on altering anything except fields and meta

* fix test

* add alter schema validation test

* extend alter schema fields check
2024-06-07 20:44:53 +05:30
Krunal Gandhi
c9618bf71e
return collections as per scoped key params (#1658)
* return collections as per scoped key params

* add test for wildcard

* update facet return parent test
2024-04-09 20:43:24 +05:30
Kishore Nallan
8ef6bcb939 Merge branch 'v0.26-facets' into v27
# Conflicts:
#	include/collection.h
#	include/collection_manager.h
#	include/synonym_index.h
#	include/tsconfig.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/synonym_index.cpp
#	src/typesense_server_utils.cpp
#	test/collection_manager_test.cpp
#	test/collection_synonyms_test.cpp
2024-03-20 15:34:28 +05:30
Harpreet Sangar
a27645f6bb
Add filter-by-max-ops option. (#1619) 2024-03-15 14:57:07 +05:30
Harpreet Sangar
84573668a4
Handle batch indexer for reference collections. (#1612) 2024-03-13 13:17:36 +05:30
Harpreet Sangar
1f6fbed372
Refactor referenced_in initialization of a collection. (#1585)
* Refactor `referenced_in` initialization of a collection.

* Review changes.

* Review changes.

---------

Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-02-28 20:48:31 +05:30
Krunal Gandhi
482858d05d
pagination for collections GET (#1581)
* add limit and offset support for collection

* use req->params, dont restrict limit param when records are less

* add more checks and not sort with pagination

* minor updations
2024-02-28 19:09:33 +05:30
Krunal Gandhi
e51055712c
facilitate to add metadata while creating collection (#1491)
* facilitate to add metadata while creating collection

* allow empty metadata keys

* refactor style
2024-01-17 18:57:32 +05:30
Ozan Armağan
3b0c518643
Merge branch 'v0.26-facets' into v0.26-facets 2024-01-10 13:41:17 +03:00
ozanarmagan
cffd1a0fcf Fix naming conventions 2024-01-10 13:34:55 +03:00
ozanarmagan
3c8b79781d Add support for audio query 2024-01-09 22:41:45 +03:00
Harpreet Sangar
08c0a087a1 Support nested join. 2024-01-02 14:14:21 +05:30
Harpreet Sangar
feb1041f65 Add nest_array reference include strategy. 2023-12-27 10:34:39 +05:30
Harpreet Sangar
4bd1619cd6 Parse nested reference include_fields. 2023-12-27 10:34:36 +05:30
Kishore Nallan
7ac12c0357 Merge branch 'v0.25-join' into v0.26-facets 2023-11-25 15:39:52 +05:30
Kishore Nallan
af43190b82 Parameterize compaction of store during collection drop. 2023-11-19 18:03:45 +05:30
Kishore Nallan
816c56fada Refactor collection resource locking.
Make collection operations more independent.
2023-11-16 14:49:29 +05:30
Kishore Nallan
ae597f40ba Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/index.h
#	src/collection.cpp
#	test/collection_vector_search_test.cpp
2023-10-30 21:41:47 +05:30
Kishore Nallan
59f7bf0f48 Add background thread for periodic housekeeping. 2023-10-30 18:17:54 +05:30
Kishore Nallan
191d62a0cb Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/collection_manager.h
#	include/index.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/index.cpp
#	test/collection_specific_more_test.cpp
#	test/collection_vector_search_test.cpp
2023-10-09 21:52:48 +05:30
ozanarmagan
fb36c1dd4c Update process_embedding_field_delete 2023-10-09 11:06:38 +03:00
ozanarmagan
4008f0bb2f Remove empty lines 2023-10-09 02:06:14 +03:00
ozanarmagan
cc54fb8176 Review changes 2023-10-09 02:04:43 +03:00
Harpreet Sangar
f80184a25c Fix referenced_in not being initialized if referenced collection is created later on. 2023-09-04 19:15:27 +05:30
Harpreet Sangar
35fc560ed9 Move get_reference_collection_names out of StringUtils. 2023-07-21 11:30:20 +05:30
krunal1313
a2796450ae refactor and adding tests 2023-07-10 11:33:53 +05:30
krunal1313
a40a1b60fc adding locale and tokenization 2023-07-04 18:10:52 +05:30
krunal1313
8e6bc04555 initial commit to add support for stopwords 2023-06-30 14:28:11 +05:30
Kishore Nallan
f9f0566606 Fine grain locking for collection creation.
Ensures that collection creation op is not blocked by a write to another collection.
2023-01-19 19:29:55 +05:30
Kishore Nallan
f380bd5fa9 Take care of underlying req being null. 2023-01-02 19:33:43 +05:30
Kishore Nallan
bf0f7430a0 Allow vector query to pass a document ID. 2023-01-01 18:00:50 +05:30
Kishore Nallan
a98e5bacdd Vector search basics. 2022-08-27 13:47:09 +05:30
Kishore Nallan
134af13281 By default, don't enable nested fields. 2022-08-07 17:36:28 +05:30
Kishore Nallan
a90bfba930 Multiple explicit nested fields should be allowed. 2022-08-03 18:38:18 +05:30
Kishore Nallan
4c6eac9840 Allow cloning of collection & assets from a reference collection. 2022-08-02 18:02:23 +05:30
Kishore Nallan
b6908f2f81 Add test for missing fields property in schema change. 2022-04-30 19:19:25 +05:30
Kishore Nallan
a5b06a0e0d Schema change basics. 2022-03-26 08:22:40 +05:30
Kishore Nallan
31c8a030c7 Handle per-search API key for multi search. 2022-02-25 21:19:24 +05:30
Kishore Nallan
bf475ad55f Support presets on GET search endpoint as well. 2022-02-19 19:11:20 +05:30
Kishore Nallan
facdda2a03 Preset API. 2022-02-17 16:23:59 +05:30
Kishore Nallan
efec5f97e9 Fix collection restore batch size. 2021-11-08 15:03:15 +05:30
Kishore Nallan
baaf7ea65d Restore store persisted raft log from snapshot. 2021-10-23 10:14:38 +05:30
Kishore Nallan
ebbab76a43 Gracefully quit during loading on signal. 2021-10-20 21:24:12 +05:30
Kishore Nallan
07d838e385 Make symbols for indexing and segmentation configurable. 2021-08-26 10:27:18 +05:30