postgres/typesense
1
0
Fork 0
mirror of https://github.com/typesense/typesense.git synced 2025-05-21 14:12:27 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,243 Commits 55 Branches 37 Tags
Commit Graph

1041 Commits

Author SHA1 Message Date
Kishore Nallan
6dc2df2376 Don't trim when splitting POST body. 2022-12-08 13:09:58 +05:30
Kishore Nallan
4651b9a6fd Fix phrase match + match scores for offset wrap around. 2022-12-06 20:16:38 +05:30
Kishore Nallan
b911766379 Implement search cutoff during intersection. 2022-11-30 15:37:12 +05:30
Kishore Nallan
71260ea2f0 Fix offset wrap around in match score. 2022-11-30 15:35:29 +05:30
Kishore Nallan
856ad0efe5 Fix new snippetting on flat fields. 2022-11-25 18:50:05 +05:30
Kishore Nallan
cbf5985307 Fix duplication of nested fields during flattening. 2022-11-23 15:08:04 +05:30
Kishore Nallan
4e7c5560aa Handle missing optional object fields. 2022-11-19 08:49:11 +05:30
Kishore Nallan
f9598dfd55 Ensure that all RocksDB iterators use upper bound. 
Without this, unbound iteration was happening on large datasets.
 2022-11-17 14:13:08 +05:30
Kishore Nallan
83495c817b Guard for preventing writes when memory/disk thresholds are breached. 2022-11-15 20:25:45 +05:30
Kishore Nallan
64def55527 Increase default candidates for smaller collections. 2022-11-14 12:51:05 +05:30
Kishore Nallan
23bd0af779 Simplify nested highlighting format. 2022-11-11 19:01:41 +05:30
Kishore Nallan
5292956718 Fix highlight meta structure. 2022-11-09 12:41:40 +05:30
Kishore Nallan
4212a107ed Ensure that detected nested fields inherit field properties. 2022-11-01 17:19:45 +05:30
Kishore Nallan
c87e0ddf9d Highlight meta should follow nested doc structure. 2022-10-31 16:19:51 +05:30
Kishore Nallan
81b6712296 Fix highlighting for fields with dot in their names. 2022-10-31 13:07:09 +05:30
Kishore Nallan
ae49dab8fd Vector flat search: handle missing values. 2022-10-21 16:42:23 +05:30
Kishore Nallan
790fac008b Optimize numerical filter ID consolidation. 2022-10-20 15:42:39 +05:30
Kishore Nallan
4808d1610a Flat search cutoff for vector search. 2022-10-19 13:48:07 +05:30
Harpreet Sangar
9651c1abdf
Add Tokenize test. (#756) 
* Add Tokenize test.

* Add Tokenize test case.

* Review changes.
 2022-10-18 12:07:39 +05:30
Kishore Nallan
10ad8162b6 Fix repeating tokens in phrase search. 2022-10-17 16:15:37 +05:30
Kishore Nallan
643ba73ec7 Fix edge case with field names containing dots. 
Should not be treated as nested fields.
 2022-10-15 17:34:05 +05:30
Kishore Nallan
374cb6948b Reclaim deleted memory on vector insert. 2022-10-11 16:25:13 +05:30
Harpreet Sangar
f75cbca920
Filter query (#737) 
* Implement advance filter query parser.

* Remove `exclude_filters`.

* Review changes

* Implement do_filtering2

* Use updated implementation

* Pass failing tests.

* Handle special characters in value.

* Add space around  in embedded filters

* Update tokenize

* Rename to `recursive_filtering`

* Deconstruct filter tree.

* Remove separating space requirement for operators

* Fix rebase errors.

* Undo filter override change

* Format changes

* Pass StaticFilteringMultipleRuleMatch

* Undo formatting changes

* Pass DynamicFilteringMultipleRuleMatch

* Review changes.

* Add filter_query guard.
 2022-10-11 11:21:20 +05:30
Kishore Nallan
36a0405416 More prefix expansion tweaks. 2022-10-07 10:28:03 +05:30
Kishore Nallan
7b59f10d46 Fix float validation to handle scientific notation. 2022-10-06 11:46:47 +05:30
Kishore Nallan
85d5ce06b2 Refactor prefix search expansion. 2022-10-05 16:14:32 +05:30
Kishore Nallan
77af30ef93 Handle prefix expansion for the same field. 2022-09-29 17:29:30 +05:30
Ozan Armağan
3280665cc9
Added rate limiting feature (#709) 
* Added rate limiting and blocking IP and API key  feature

* Fix for core_api differences

* Coding style improvements

* Coding style improvement II

* Design Update for RateLimitManager

* Updated some of comments

* Design Update II

* Design Update III

* Updated unit test and bug fixes

* Design Update IV

* Design Update V

* Refactoring update for add_rule and edit_rule

* Update to store rate limits and bans in DB

* Bug fix for bans prefix

* Bug fix for rate limit manager unit test

* Refactoring and updates

* Added More Tests & Fixes

* Updated Rate Limit Manager class tests
 2022-09-25 10:37:08 +05:30
Kishore Nallan
eaa2b5027a Remove unused arg. 2022-09-21 16:10:15 +05:30
Kishore Nallan
4679d298c7 Geopoint field cannot be a default sorting field. 2022-09-20 15:12:31 +05:30
Kishore Nallan
940c2b982d Support locale and symbols_to_index in synonyms. 2022-09-20 14:38:23 +05:30
Kishore Nallan
c8afd1e7c6 Use k value from vector query params. 2022-09-17 16:00:56 +05:30
Kishore Nallan
49268d648e Persist vector field properties and restore. 2022-09-15 17:32:17 +05:30
Kishore Nallan
c7f879bf30 Return vector distance in response. 2022-09-15 11:34:27 +05:30
Kishore Nallan
31559f15b2 Numerical facet field values must be fully removed. 2022-09-14 16:22:15 +05:30
Kishore Nallan
d2daad2c3d Basic alter support for nested fields. 
No longer storing .flat inside the document.
 2022-09-13 14:47:17 +05:30
Kishore Nallan
dff7f8b746 Don't persist flattened nested field values on disk. 
Instead, we will reconstruct them when we fetch them from disk, trading cpu for storage.
 2022-09-12 15:04:12 +05:30
Kishore Nallan
aeb4424662 Better error messages for nested field type mismatch. 2022-09-11 18:53:14 +05:30
Kishore Nallan
832b519633 Optimize wildcard query sans filter/sort/facets. 2022-09-10 18:21:13 +05:30
Kishore Nallan
0e39736327 Refactor / simplify schema update logic. 2022-09-09 14:14:21 +05:30
Kishore Nallan
ba2d5d10ce Fix vector search filter: don't assume order of IDs. 2022-09-08 16:19:46 +05:30
Kishore Nallan
c5b55a4ca3 More careful handling of custom request data destruction. 2022-09-06 19:16:50 +05:30
Kishore Nallan
44edeb8a5e Buffer IDs during filtering. 2022-09-03 18:35:14 +05:30
Kishore Nallan
720855f406 Use cosine similarity as default vector distance. 2022-09-02 17:48:02 +05:30
Kishore Nallan
b20c32046b Support simple filter_by rule in overrides. 2022-09-02 13:27:17 +05:30
Kishore Nallan
70e6a89ea8 Do word level tokenization for th locale. 
This ensures that we handle change in text length due to NFKC normalization.
 2022-08-31 07:41:33 +05:30
Kishore Nallan
a98e5bacdd Vector search basics. 2022-08-27 13:47:09 +05:30
Kishore Nallan
b7e33584fb Ensure that only highlighted fields exist in snippet. 2022-08-25 12:47:45 +05:30
Kishore Nallan
936270b4a5 Flag for skipping writes to avoid bad writes. 2022-08-19 18:20:32 +05:30
Kishore Nallan
57ac561743 Handle special characters in locale tokenization. 2022-08-18 10:47:30 +05:30