3861 Commits

Author SHA1 Message Date
Harpreet Sangar
6189fec042
Fix id field filter value parsing crash. (#1817) 2024-07-02 21:42:55 +05:30
Harpreet Sangar
6cb6a07891
sort_by nested join collection field. (#1793)
* sort_by nested join collection field.

* Refactor reference sort logic.
2024-07-02 15:17:08 +05:30
Harpreet Sangar
b92bba5f3f
Handle null value update of reference field. (#1814)
* Handle null value update of reference field.

* Fix `CollectionVectorTest, VectorWithNullValue`.

* Add tests.
2024-07-02 12:42:20 +05:30
Krunal Gandhi
b88f1fedbe
analytics db minor fixes (#1807)
* initial commit for analytics db with ttl

* refactor store class

* get last N events from db and minor changes

* add more tests & limit keys fetching per user

* fix local cluster sync & add test with alias

* revert get_collection_unsafe() call

* fix asan error & add event weight check
2024-07-01 14:42:42 +05:30
Krunal Gandhi
a1f8d7257a
analytics db with ttl (#1789)
* initial commit for analytics db with ttl

* refactor store class

* get last N events from db and minor changes

* add more tests & limit keys fetching per user
2024-06-27 12:41:51 +05:30
Ozan Armağan
7b1ed4ee79
Fix conversation model initialization (#1806)
* Fix conversation model initialization

* Rename `conversation_collection` to `history_collection`
2024-06-27 06:23:05 +05:30
Kishore Nallan
fed1a6300b Fix update of array reference field. 2024-06-25 14:12:03 +05:30
Krunal Gandhi
4c2b5d328f
fix typo for create event response (#1800) 2024-06-24 18:41:57 +05:30
Kishore Nallan
423577c04a Check length of filter token index during prefix/exact match. 2024-06-22 14:26:28 +05:30
Krunal Gandhi
e1bdfc1ca6
delete associated events on deleting rule (#1794)
* delete associated events on deleting rule

* remove mandatory query param & unnecessary if

* update failing test
2024-06-21 22:26:57 +05:30
Ozan Armağan
63f0b8025d
Fix conversation model id generation (#1790)
* Fix conversation model id generation

* Fix typo
2024-06-19 21:57:59 +05:30
Krunal Gandhi
34e864d4a8
enable counter events without analytics dir (#1788) 2024-06-18 13:14:32 +05:30
Kishore Nallan
03358bcf37 Fix null values in embed from field values. 2024-06-17 22:33:02 +05:30
Harpreet Sangar
b471620a24
Remove values from reference_index and object_array_reference_index in Index::remove_field. (#1787) 2024-06-17 19:32:54 +05:30
Ozan Armağan
9caffccfc8
Do not index role and message for default conversation collection (#1786)
* Do not index `role` and `message` for default conversation collection

* Fix using custom conversation model id

* Remove unnecessary get_conversation call

* Check model id type
2024-06-16 18:03:31 +05:30
Harpreet Sangar
cf5278f267
Timeout filter_result_iterator during compute_iterators. (#1785)
* Handle timeout during computation of filter_result_iterator in case of wildcard search.

* Pass `override_function_call_counter` as true in `filter_result_iterator_t::get_n_ids`.

* Invalidate iterator in `filter_result_iterator_t::get_n_ids`.

* Pass `timeout_info` into subtree in `filter_result_iterator_t::compute_iterators`.

* Fix `FilterTest, FilterTreeIteratorTimeout`.

* Refactor timeout logic.
2024-06-14 18:50:29 +05:30
Kishore Nallan
f45beb23cc Add option to log inflight queries in /debug 2024-06-13 21:06:25 +05:30
Harpreet Sangar
966a622072
Geosearch sorting with precision fix. (#1623)
* Add `geo_distance_meters` assert.

* Return real distances when precision is specified.

* Fix `CollectionSortingTest, GeoPointSorting`.

* Lock mutex in `Index::get_distance`.
2024-06-12 14:45:26 +05:30
Krunal Gandhi
2f16a71d98
add support for include exclude fields in doc fetch (#1782)
Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-06-12 09:33:14 +05:30
Kishore Nallan
e1615dddf8 Add test for field value coercion during removal. 2024-06-11 22:01:43 +05:30
Kishore Nallan
cdb6552898 Fix facet value hash mapping being cleared on sparsification.
We still need it for maintaning str -> id mapping.
2024-06-11 21:42:02 +05:30
Kishore Nallan
37d7ecabe7 Do value coercion before removing value from index. 2024-06-11 16:09:03 +05:30
Kishore Nallan
bc9e24fb57 Move thread pool exhaustion logging to separate func. 2024-06-11 16:00:22 +05:30
Kishore Nallan
de413783c8 Log about threadpoool exhuastion. 2024-06-10 17:10:43 +05:30
Kishore Nallan
f6108feec5 Add validation and test for empty alter payload. 2024-06-07 21:49:05 +05:30
Krunal Gandhi
629def6f0f
support updation of collection meta (#1779)
* support updation of collection meta

* error on altering anything except fields and meta

* fix test

* add alter schema validation test

* extend alter schema fields check
2024-06-07 20:44:53 +05:30
Harpreet Sangar
4fee4dc286
Exact prefix value filter. (#1763)
* Exact prefix match on `string` field.

* Exact prefix match on `string[]` field.

---------

Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-06-07 14:57:34 +05:30
Kishore Nallan
25762a7c69 Fix test. 2024-06-07 14:02:51 +05:30
Kishore Nallan
f2632a00e0 Accept config writes even under oom. 2024-06-07 12:13:24 +05:30
Kishore Nallan
500fd851a6 Set init hnsw size to 16 elements. 2024-06-06 21:00:06 +05:30
Kishore Nallan
59313e5986 Allow dynamic update of cache size. 2024-06-06 21:00:06 +05:30
Ozan Armağan
79018dd2b9
Add API key support for vLLM conversation models (#1777) 2024-06-06 17:45:58 +05:30
Ozan Armağan
5859e0fd3f
Fix filtering on stemmed fields (#1776)
* Fix filtering on stemmed fields

* Fix getting stemmer twice
2024-06-06 16:49:12 +05:30
Krunal Gandhi
b4b399a4b7
allow integer val for geopoint (#1773) 2024-06-05 20:42:22 +05:30
Ozan Armağan
002b188b56
Force whisper to not transcribe punctuations (#1771)
* Force whisper to not transcribe punctuations

* Fix the test
2024-06-05 14:53:39 +05:30
Harpreet Sangar
561b01bb51
Assign default sorting score if reference is not found while sorting by a reference field. (#1770) 2024-06-04 17:21:39 +05:30
Kishore Nallan
f47c09fd63 Fix synonym upserts. 2024-06-04 12:10:12 +05:30
Harpreet Sangar
2c3b595982
Fix posting_list_t::has_exact_match. (#1767)
* Add failing tests for `posting_list_t::has_exact_match`.

* Fix failing test.

* Add test case for `string[]` field.
2024-06-03 20:54:12 +05:30
Kishore Nallan
3291fca5ba Account for maximum number of search fields supported. 2024-05-31 08:48:03 +05:30
Kishore Nallan
0bf8669327 Semantic search faceting should work only on k returned docs. 2024-05-29 18:02:00 +05:30
Ozan Armağan
b02782656c
Fix conversation history bug in multi search (#1762) 2024-05-29 16:37:57 +05:30
Kishore Nallan
a3d7b9a24a Add guard for collection document counter decrement. 2024-05-29 13:03:28 +05:30
Kishore Nallan
b3db94867f Increase max length of facet value stored. 2024-05-29 10:35:28 +05:30
Krunal Gandhi
94af3afb66
allow special char in range facet labels (#1760) 2024-05-28 18:48:02 +05:30
Kishore Nallan
fdf16b0e23 Fix facet index type auto population for wildcard faceting. 2024-05-28 16:21:56 +05:30
Krunal Gandhi
3ab8517a8c
facet parent for array fields (#1756)
* return object itself as parent for array fields

* make variables const reference
2024-05-28 08:32:53 +05:30
Jason Bosco
055425a2eb
Merge pull request #1754 from typesense/fix-infix-json-quoting
Remove double quotes to prevent bad escaping in JSON response for infix search
2024-05-24 17:45:47 -05:00
Jason Bosco
1c0c5c4d51 Remove double quotes to prevent bad escaping in JSON response.
Fix for #1753
2024-05-24 16:26:00 -05:00
Ozan Armağan
ed87e63961
Fix stemming for non-English locales (#1745)
* Fix stemming for non-English locales

* Fix synoyms

* Use `query_tokens_t.q_unstemmed_tokens` for passing unstemmed tokens-

* Refactoring

* Move for loop in parse_search_query to process_tokens completely

* Use q_phrase_dummy and q_exclude_tokens_dummy for unstemmed process_tokens

* Add stopwords_set to process_tokens

* remove unused variables
2024-05-23 01:20:20 +05:30
Harpreet Sangar
85c5c80445
Fix numeric filter performance regression. (#1749) 2024-05-23 00:13:40 +05:30