906 Commits

Author SHA1 Message Date
kishorenc
0f876b5488 Filter out GLIBC_PRIVATE for RPM build. 2020-09-16 20:45:37 +05:30
kishorenc
27179b4f8b Parameterize snapshot interval duration. 2020-09-15 17:30:04 +05:30
kishorenc
97394c146a Allow := filter syntax for non-string fields.
Though it makes no difference.
2020-09-14 11:59:43 +05:30
kishorenc
eb0e5b9d1e Increase snapshot interval to 3600s. 2020-09-13 09:51:08 +05:30
kishorenc
0577df5e91 Throttle collection loading to prevent CPU saturation. 2020-09-12 18:46:40 +05:30
kishorenc
d3d25768a0 Temporarily disable memory threshold check. 2020-09-12 11:29:36 +05:30
kishorenc
6593d959ec Set min snapshot index gap to 1. 2020-09-10 21:35:55 +05:30
kishorenc
9091df57c0 Don't trigger snapshots for small unapplied logs.
Required upgrading braft to HEAD version.
2020-09-10 16:04:43 +05:30
kishorenc
eaafe484fd Enable filter before copy remote for snapshots. 2020-09-10 11:58:11 +05:30
kishorenc
d06552eeba Allow a string facet field to be filtered verbatim.
Use the `field := value` notation to indicate verbatim match. Requires the field to be a facet field, otherwise an error is returned indicating that requirement.
2020-09-10 11:56:23 +05:30
kishorenc
3189c1c4cc Fix import follower hang. 2020-09-09 17:35:50 +05:30
kishorenc
1b01de0c0c Housekeeping tasks. 2020-09-07 21:25:04 +05:30
kishorenc
13fd927944 Fix crash when an int32 field is filtered with an int64 value. 2020-09-07 19:23:11 +05:30
kishorenc
5795aba81f Speed up token position computation. 2020-09-07 18:41:29 +05:30
kishorenc
06152d0d25 Fixed early export end. 2020-09-06 17:35:09 +05:30
kishorenc
8f6ec34918 Count facet values with overlapping tokens separately. 2020-09-06 17:04:48 +05:30
kishorenc
aa9e4a226e Filtering on string field should be verbatim by default.
Allow earlier "CONTAINS" behavior via "~" operator.
2020-09-06 16:25:39 +05:30
kishorenc
d42a04acb9 Return raw doc in response when indexing fails during import. 2020-09-05 19:40:48 +05:30
kishorenc
695c44dc17 Forward status code and content type properly. 2020-09-05 18:56:39 +05:30
kishorenc
58b52687ea Handle disconnects during import. 2020-09-04 15:12:09 +05:30
kishorenc
6d7c6b2ea0 Implemented import streaming end-to-end on follower. 2020-09-03 20:44:39 +05:30
kishorenc
02dd4a8a4f Use direct node API for checking leader status.
Otherwise, configuration refresh was getting stuck in a race condition when leader term is not updated while stepping down.
The actual error was "Doing another configuration change".
2020-09-02 11:16:32 +05:30
kishorenc
10957633fb Request-side import streaming via follower is working. 2020-09-01 20:12:08 +05:30
kishorenc
1f726d747a Add logging for auth key handling. 2020-08-29 08:08:37 +05:30
kishorenc
e254a1d519 Fix an edge case in match score calculation. 2020-08-28 20:09:34 +05:30
kishorenc
9dc7450a09 Return document with bad JSON in import response. 2020-08-28 17:28:52 +05:30
kishorenc
1e5dd2bdbc Add debug logs. 2020-08-27 13:19:03 +05:30
kishorenc
5b55b071b2 Handle facet query being larger than matched token. 2020-08-26 17:22:02 +05:30
kishorenc
59dc1fef0d Speed up match scoring. 2020-08-25 21:28:23 +05:30
kishorenc
2f21819db0 Use num_memory_shards as parameter name. 2020-08-24 17:58:15 +05:30
kishorenc
eea20ed188 Check for complete document during streaming import more carefully. 2020-08-24 17:47:18 +05:30
kishorenc
a7f3176732 Ignore non-utf8 characters during JSON serialization.
Otherwise, there will be an exception thrown.
2020-08-23 14:52:29 +05:30
kishorenc
9f83d9e0c2 Fix edge case in initialization of auth manager.
Must be initialized only when CollectionManager is ready to be loaded.
2020-08-23 12:37:07 +05:30
kishorenc
0004b5d9e2 Speed up facet computation for array fields.
Ditched use of stringstream.
2020-08-22 18:32:44 +05:30
kishorenc
a55b929203 Reset peers should be called only in single-node setup.
In a clustered setup, this leads to nasty consistency issues.
2020-08-22 09:10:44 +05:30
kishorenc
030dc5ca35 Fix http2 async import. 2020-08-21 18:02:06 +05:30
kishorenc
d2221aa449 Use guard for deleting iterator. 2020-08-20 13:21:51 +05:30
kishorenc
09541e5311 Parameterize number of indices per collection. 2020-08-19 12:29:59 +05:30
kishorenc
80a3e0fb87 Throttle imports.
Ensure that other queries are not blocked when an import is in progress.
2020-08-18 18:32:19 +05:30
kishorenc
7f928fb0bc Reuse new streaming framework for exports. 2020-08-17 13:03:09 +05:30
kishorenc
e2c0b52671 Free request & response objects via generator dispose callback. 2020-08-17 11:53:04 +05:30
kishorenc
4a173ee49d Streaming import basics. 2020-08-16 20:17:07 +05:30
kishorenc
5b618ac06c Log curl result integer code, along with strerror. 2020-08-13 07:51:21 +05:30
kishorenc
f54bc8a4b3 Fix + add test for int64 as default sorting field. 2020-08-13 07:42:15 +05:30
kishorenc
9a4105111d Fix NaN during cpu metric calculation. 2020-08-13 07:31:04 +05:30
kishorenc
6e77a9792e Refactor http req handler: prepare for deferred request body access. 2020-08-12 21:42:23 +05:30
kishorenc
72e4c0510c Use only connection timeout, and not request timeout for curl. 2020-08-12 17:59:41 +05:30
kishorenc
0c186481a9 Allow int64 to be used as a default sorting field. 2020-08-12 16:06:27 +05:30
kishorenc
14faa3af4e Speed up wildcard searches further. 2020-08-12 15:33:40 +05:30
kishorenc
c70e83cfba Fix used memory metric. 2020-08-12 09:09:53 +05:30