1869 Commits

Author SHA1 Message Date
Ozan Armağan
0b75cdcc3d
Support embedding generation from both image and text fields (#1826)
* Support embedding generation from both image and text fields

* Fix tests

* Fix test query

* Remove unnecessary logs

* Remove commented code

* Refactoring

* Refactor batch_embed_fields

* Refactor batch_embed_fields
2024-07-10 16:43:03 +05:30
Harpreet Sangar
87e33e1970
Allow joining export documents. (#1822)
* Allow joining export documents.

* Add tests.
2024-07-10 10:48:57 +05:30
Krunal Gandhi
2f1dab72dd
return store value in collection_schema response (#1823) 2024-07-05 17:39:18 +05:30
Harpreet Sangar
b0014f9c05
Fix empty reference array field update. (#1820) 2024-07-04 12:41:33 +05:30
Harpreet Sangar
6189fec042
Fix id field filter value parsing crash. (#1817) 2024-07-02 21:42:55 +05:30
Harpreet Sangar
6cb6a07891
sort_by nested join collection field. (#1793)
* sort_by nested join collection field.

* Refactor reference sort logic.
2024-07-02 15:17:08 +05:30
Harpreet Sangar
b92bba5f3f
Handle null value update of reference field. (#1814)
* Handle null value update of reference field.

* Fix `CollectionVectorTest, VectorWithNullValue`.

* Add tests.
2024-07-02 12:42:20 +05:30
Krunal Gandhi
b88f1fedbe
analytics db minor fixes (#1807)
* initial commit for analytics db with ttl

* refactor store class

* get last N events from db and minor changes

* add more tests & limit keys fetching per user

* fix local cluster sync & add test with alias

* revert get_collection_unsafe() call

* fix asan error & add event weight check
2024-07-01 14:42:42 +05:30
Krunal Gandhi
a1f8d7257a
analytics db with ttl (#1789)
* initial commit for analytics db with ttl

* refactor store class

* get last N events from db and minor changes

* add more tests & limit keys fetching per user
2024-06-27 12:41:51 +05:30
Ozan Armağan
7b1ed4ee79
Fix conversation model initialization (#1806)
* Fix conversation model initialization

* Rename `conversation_collection` to `history_collection`
2024-06-27 06:23:05 +05:30
Kishore Nallan
fed1a6300b Fix update of array reference field. 2024-06-25 14:12:03 +05:30
Kishore Nallan
423577c04a Check length of filter token index during prefix/exact match. 2024-06-22 14:26:28 +05:30
Krunal Gandhi
e1bdfc1ca6
delete associated events on deleting rule (#1794)
* delete associated events on deleting rule

* remove mandatory query param & unnecessary if

* update failing test
2024-06-21 22:26:57 +05:30
Krunal Gandhi
34e864d4a8
enable counter events without analytics dir (#1788) 2024-06-18 13:14:32 +05:30
Kishore Nallan
03358bcf37 Fix null values in embed from field values. 2024-06-17 22:33:02 +05:30
Harpreet Sangar
b471620a24
Remove values from reference_index and object_array_reference_index in Index::remove_field. (#1787) 2024-06-17 19:32:54 +05:30
Harpreet Sangar
cf5278f267
Timeout filter_result_iterator during compute_iterators. (#1785)
* Handle timeout during computation of filter_result_iterator in case of wildcard search.

* Pass `override_function_call_counter` as true in `filter_result_iterator_t::get_n_ids`.

* Invalidate iterator in `filter_result_iterator_t::get_n_ids`.

* Pass `timeout_info` into subtree in `filter_result_iterator_t::compute_iterators`.

* Fix `FilterTest, FilterTreeIteratorTimeout`.

* Refactor timeout logic.
2024-06-14 18:50:29 +05:30
Harpreet Sangar
966a622072
Geosearch sorting with precision fix. (#1623)
* Add `geo_distance_meters` assert.

* Return real distances when precision is specified.

* Fix `CollectionSortingTest, GeoPointSorting`.

* Lock mutex in `Index::get_distance`.
2024-06-12 14:45:26 +05:30
Krunal Gandhi
2f16a71d98
add support for include exclude fields in doc fetch (#1782)
Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-06-12 09:33:14 +05:30
Kishore Nallan
e1615dddf8 Add test for field value coercion during removal. 2024-06-11 22:01:43 +05:30
Kishore Nallan
cdb6552898 Fix facet value hash mapping being cleared on sparsification.
We still need it for maintaning str -> id mapping.
2024-06-11 21:42:02 +05:30
Kishore Nallan
f6108feec5 Add validation and test for empty alter payload. 2024-06-07 21:49:05 +05:30
Krunal Gandhi
629def6f0f
support updation of collection meta (#1779)
* support updation of collection meta

* error on altering anything except fields and meta

* fix test

* add alter schema validation test

* extend alter schema fields check
2024-06-07 20:44:53 +05:30
Harpreet Sangar
4fee4dc286
Exact prefix value filter. (#1763)
* Exact prefix match on `string` field.

* Exact prefix match on `string[]` field.

---------

Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-06-07 14:57:34 +05:30
Kishore Nallan
25762a7c69 Fix test. 2024-06-07 14:02:51 +05:30
Ozan Armağan
5859e0fd3f
Fix filtering on stemmed fields (#1776)
* Fix filtering on stemmed fields

* Fix getting stemmer twice
2024-06-06 16:49:12 +05:30
Krunal Gandhi
b4b399a4b7
allow integer val for geopoint (#1773) 2024-06-05 20:42:22 +05:30
Ozan Armağan
002b188b56
Force whisper to not transcribe punctuations (#1771)
* Force whisper to not transcribe punctuations

* Fix the test
2024-06-05 14:53:39 +05:30
Harpreet Sangar
561b01bb51
Assign default sorting score if reference is not found while sorting by a reference field. (#1770) 2024-06-04 17:21:39 +05:30
Kishore Nallan
f47c09fd63 Fix synonym upserts. 2024-06-04 12:10:12 +05:30
Harpreet Sangar
2c3b595982
Fix posting_list_t::has_exact_match. (#1767)
* Add failing tests for `posting_list_t::has_exact_match`.

* Fix failing test.

* Add test case for `string[]` field.
2024-06-03 20:54:12 +05:30
Kishore Nallan
0bf8669327 Semantic search faceting should work only on k returned docs. 2024-05-29 18:02:00 +05:30
Kishore Nallan
b3db94867f Increase max length of facet value stored. 2024-05-29 10:35:28 +05:30
Krunal Gandhi
94af3afb66
allow special char in range facet labels (#1760) 2024-05-28 18:48:02 +05:30
Kishore Nallan
fdf16b0e23 Fix facet index type auto population for wildcard faceting. 2024-05-28 16:21:56 +05:30
Krunal Gandhi
3ab8517a8c
facet parent for array fields (#1756)
* return object itself as parent for array fields

* make variables const reference
2024-05-28 08:32:53 +05:30
Jason Bosco
1c0c5c4d51 Remove double quotes to prevent bad escaping in JSON response.
Fix for #1753
2024-05-24 16:26:00 -05:00
Ozan Armağan
ed87e63961
Fix stemming for non-English locales (#1745)
* Fix stemming for non-English locales

* Fix synoyms

* Use `query_tokens_t.q_unstemmed_tokens` for passing unstemmed tokens-

* Refactoring

* Move for loop in parse_search_query to process_tokens completely

* Use q_phrase_dummy and q_exclude_tokens_dummy for unstemmed process_tokens

* Add stopwords_set to process_tokens

* remove unused variables
2024-05-23 01:20:20 +05:30
Harpreet Sangar
8e808d4e29
Fix cascade deletion bug. (#1742)
* Fix cascade deletion bug.

* Add test case.
2024-05-21 19:52:21 +05:30
Harpreet Sangar
35e6a097af
Remove limit of 10 filter values to compute filter iterator. (#1739) 2024-05-21 03:02:29 +05:30
Krunal Gandhi
ef674a80f9
add flag hide_from_analytics (#1737)
* add flag hide_from_analytics

* change param name to enable_analytics
2024-05-21 02:34:48 +05:30
Kishore Nallan
b9d70433b4 Revert "Do grouping in two pass (#1677)"
This reverts commit dccf6eb1864870cffc5ca71e3307e59b6ee5d9b2.

# Conflicts:
#	src/index.cpp
2024-05-16 17:37:54 +05:30
Harpreet Sangar
52b9d5a959
Fix sort_by parsing bug. (#1733) 2024-05-15 17:10:10 +05:30
Krunal Gandhi
6075362709
throw error when range faceted field has sorting disabled (#1726)
* range facets with sort disabled

* update test names

* throw error when range faceted field has sort disabled
2024-05-15 17:08:57 +05:30
Kishore Nallan
be57f68e64 Merge branch 'v0.26-facets' into v27 2024-05-15 08:32:21 +05:30
Ozan Armağan
1b4e08b29d
Use collections to store conversations (#1723)
* Use collections to store conversations

* Use conversation model to select conversation history collections

* Fix multi search add conversation call

* Add support for migrating conversation models

* use same suffix for all default conversation collections

* delete `delete_models_With_conversation_collection`
2024-05-14 15:32:35 -04:00
Harpreet Sangar
a6fa986286
Add float filter tests. (#1729) 2024-05-14 15:31:25 -04:00
Krunal Gandhi
f17f6f690e
allow fields containing sort keyword with range facets (#1730) 2024-05-14 08:22:29 -04:00
Harpreet Sangar
43a9bb75d1
Numeric iterator (#1709)
* Numeric filter iterator.

* Add test cases.

* Refactor.

* Float field filter iterator.
2024-05-13 04:34:52 +05:30
Harpreet Sangar
8d7def3eb9
Handle reference to an id field from an object array field. (#1721) 2024-05-10 18:34:57 +05:30