3938 Commits

Author SHA1 Message Date
Jason Bosco
05e4671c7d
Fix stray logs from image embeddings (#1931) 2024-09-04 07:11:49 +05:30
Krunal Gandhi
0d030f08fe
Faceting on top k (#1878)
* do faceting on top_k results

* make top_k faceting on single thread

* remove logging to tsv file

* Revert "remove logging to tsv file"

This reverts commit 42bd4fdc4607d3cb5000080ac8aeba21b602e279.

* add validation checks & aggregate facets

* add tests

* refactor code

* refactor facet parsing to single pass

---------

Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-09-03 13:01:46 +05:30
Kishore Nallan
478f0ce322 Don't return error if limit_hits is hit. 2024-08-30 14:39:40 +05:30
Harpreet Sangar
c8cd7e0472
Async reference field. (#1835)
* Add `async_reference` property to reference field.

* Accept `"async_reference": true` only when `reference` is provided.

* Avoid reference lookup during updation if ref helper field is present.

* Clear `referenced_in_backlog` on dispose.

* Add references asynchronously to singular reference field.

Store only the reference field name in the indexes instead of reference helper field name.

* Only update async references when a document is indexed successfully.

* Remove unused params.

* Refactor reference index.

* Move `update_async_references` into `Index`.

* Refactor `Collection::update_async_references_with_lock`.

* Handle async update of reference array field.

* Add test case.

* Remove `update_async_references` method from `Collection`.

* Add `Join` class.
2024-08-30 11:20:05 +05:30
Harpreet Sangar
9378de62f7
Return error when multiple joins are mentioned of the same collection. (#1923) 2024-08-30 11:17:43 +05:30
Krunal Gandhi
3a24ba9f84
support random sort (#1918)
* support random sort

* add empty sort_fields check

* generate random score instead of shuffling

* refactor sort_random_t

* add seed value check
2024-08-29 18:20:33 +05:30
Jason Bosco
e62e7e8316 Merge branch 'main' into v28 2024-08-29 00:53:28 -05:00
Kishore Nallan
e348213669 When infix search does not find highlight, use normal search. 2024-08-28 12:00:42 +05:30
Jason Bosco
fe675f4aab
Update README.md v27.0 2024-08-27 16:42:30 -05:00
Krunal Gandhi
028a90173e
fix _vector_query parsing in sort_by (#1915)
* fix _vector_query parsing in sort_by param

* update model and make brace counter integer
2024-08-26 20:25:30 +05:30
Harpreet Sangar
bca83ef529
Object reference field. (#1911)
* Including referenced documents of object's reference field shouldn't depend on whether the query excludes the reference field.

* Refactor `Collection::include_references`.

* Only copy `doc` when references are involved.
2024-08-26 10:34:10 +05:30
Harpreet Sangar
6376e3951d
Add = case in filter::extract_num_comparator to avoid confusion. (#1910) 2024-08-23 19:08:18 +05:30
Krunal Gandhi
85f5027428
remove all events when rule is deleted (#1912)
* update analytics store key

* remove all events when rule is deleted
2024-08-23 19:05:19 +05:30
Kishore Nallan
87486da745 Add hidden hits + wildcard query test. 2024-08-23 11:54:50 +05:30
Krunal Gandhi
76f9c02944
update analytics store key (#1908) 2024-08-22 18:52:43 +05:30
Krunal Gandhi
9255c4e459
fix overrides with semantic search (#1906)
* fix overrides with semantic search

* override test with semantic search

* handle excluded_ids for nofilter vector search

* remove un-necessary code block

* remove core_api usage
2024-08-22 12:57:16 +05:30
Kishore Nallan
2c9407ba56 Skip only bad conversation models without aborting. 2024-08-22 07:16:18 +05:30
Kishore Nallan
a1b7f9c8e2 Fix synonym deletion regression. 2024-08-19 14:00:24 +05:30
Kishore Nallan
78f15fe6dd Handle md5 context memory. 2024-08-17 22:07:39 +05:30
Kishore Nallan
d77a82ac3c Fix memory spike during md5 hash compute for model. 2024-08-17 17:07:37 +05:30
Kishore Nallan
998b581e28
Merge pull request #1899 from happy-san/filter_by
Accept empty array as filter value.
2024-08-16 12:05:11 +05:30
Harpreet Sangar
c52bd6c55e Accept empty array as filter value. 2024-08-16 11:11:18 +05:30
Kishore Nallan
673d36f2b0
Merge pull request #1898 from joonatanaatos/main
Do housekeeping for authmanager at regular intervals
2024-08-16 10:21:17 +05:30
Kishore Nallan
bf8cc0b91e During import return_id should work for failures. 2024-08-15 22:56:55 +05:30
Kishore Nallan
02ed6a471b Refactor conversation model. 2024-08-15 22:14:58 +05:30
Joonatan Korpela
e02a9a69b9
fix: Do housekeeping for authmanager at regular intervals 2024-08-15 08:54:28 +03:00
Ozan Armağan
21500131fd
Fix conversation expire and migration (#1895)
* Fix conversation expire and migration

* Remove unnecessary log

* Fix unused variable

* Remove unimplemented function declerations
2024-08-14 20:49:12 +05:30
Ozan Armağan
0395857601
Fix conversation and conversation model (#1869)
* Fix conversation models and conversations

* Remove unnecessary op in the test

* Fix persistence of conversations

* Fix conversaton swap

* Move TTL and conversation history logic to conversation models

* Fix conversation tests

* Fix tests
2024-08-13 14:43:16 +05:30
Jason Bosco
dffcdda35f
Update Slack links 2024-08-12 16:00:20 -07:00
Krunal Gandhi
fea777f41e
add analytics rate limit config (#1879)
* add analytics rate limit config

* make analytic_minute_rate_limit mandatory arg
2024-08-08 15:45:39 +05:30
Krunal Gandhi
f625f493eb
add generic log events (#1877) 2024-08-08 12:23:28 +05:30
Harpreet Sangar
b12db0dcd9
Fix numeric not equals filter not matching any docs when its value is absent. (#1873) 2024-08-07 16:08:15 +05:30
Harpreet Sangar
b46c72572b
Return error when sort: false is set for geopoint/geopoint[] field. (#1872)
* Return error when `sort: false` is set for geopoint/geopoint[] field.

* Fix failing tests.
2024-08-07 14:31:36 +05:30
Harpreet Sangar
fc5f2e2166
Refactor cascade deletion logic. (#1868)
Only cascade delete document if the reference field is required or if it is the last optional reference field.
2024-08-06 10:44:15 +05:30
Krunal Gandhi
631563d1c6
add flag to enable/disable auto-aggregation of search queries (#1865)
* add flag to enable/disable auto-aggregation of search events

* updaitng validation checks
2024-08-02 20:53:03 +05:30
Kishore Nallan
73bde1ed0d Move conversation model init to raft init db.
This also takes care of a clustering quirk, where this gets called later, once follower restores data from leader.
2024-08-01 23:00:40 +05:30
Krunal Gandhi
ca2ec6a383
Analytics manager refactor (#1860)
* remove source collections for counter events rule

* support popular_queries by events API

* make search events API optional

* only keep doc_id param as mandatory for non search events

* add more validation tests

* remove live_query param for search events

* remove expanded_query param
2024-08-01 21:15:18 +05:30
Kishore Nallan
c1bc1e2cd9 Assert on vector distance. 2024-08-01 16:24:15 +05:30
Harpreet Sangar
65151cd51b
Fix crash when reference expression is passed in _eval. (#1863) 2024-08-01 16:20:26 +05:30
Kishore Nallan
05b0faa955 Return vector distance when sort by vector query. 2024-07-31 13:44:04 +05:30
Harpreet Sangar
fc153ae192
Return all included overrides if provided filter_by produces no match. (#1861) 2024-07-31 11:24:37 +05:30
Jason Bosco
9b6894fee6
Update README.md 2024-07-30 19:34:52 -05:00
Ozan Armağan
e8590daa5a
Fix conversation model migration (#1857)
Co-authored-by: Kishore Nallan <kishorenc@gmail.com>
2024-07-30 16:18:56 +05:30
Kishore Nallan
0be6c0ad75 Handle empty hits because of curated ids. 2024-07-30 13:38:30 +05:30
Harpreet Sangar
e2685f4f8f
Fix reference _eval. (#1859) 2024-07-30 13:29:57 +05:30
Kishore Nallan
c975136c32 Fix test. 2024-07-29 17:50:27 +05:30
Kishore Nallan
6659054608 Add ability to exclude fields in collection listing. 2024-07-29 16:18:54 +05:30
Kishore Nallan
6876408cb6 Simplify facet count implementation. 2024-07-26 17:03:30 +05:30
Krunal Gandhi
058eb9db52
handle userid with '_' (#1853)
* fix endpoints and unused vars

* add response on failure of writing events to db

* update response code

* handle userid with '_' & dont process events with log_to_store disabled

* use '%' as separator instead of '_'

* optimize '%' removal from userid
2024-07-24 10:44:07 +05:30
Kishore Nallan
cc1588ecfa Flush analytics store before snapshot. 2024-07-22 21:29:32 +05:30