121 Commits

Author	SHA1	Message	Date
Kishore Nallan	7d06c30cb0	No timeout for follower proxying of writes.	2023-11-20 15:55:02 +05:30
Kishore Nallan	0493922b2e	Log pending writes.	2023-11-17 19:59:39 +05:30
Kishore Nallan	a99929f05f	Address change in streaming behavior of h2o on http/2. ... _req->proceed_req is not 1 when http2 is used for chunks that follow the first chunk.	2023-08-09 19:02:36 +05:30
Kishore Nallan	01801f4ea9	Refactor remoted embedding code.	2023-07-11 12:42:06 +05:30
Kishore Nallan	176a72e6ca	Fix http curl client timeout API.	2023-06-30 10:58:15 +05:30
Kishore Nallan	23dbfd20d5	Merge pull request #1065 from ozanarmagan/v0.25-join ... Bug fixes for embedding generation process	2023-06-24 10:04:33 +05:30
Kishore Nallan	62ba570491	Remove resource check for POST /health	2023-06-22 11:49:58 +05:30
ozanarmagan	99be1f69df	Bug fixes for embedding generation process	2023-06-20 01:35:23 +03:00
ozanarmagan	d61abab259	Update for naming conventions and fix hashing for strings	2023-06-14 16:05:01 +03:00
ozanarmagan	a29c76ff54	Proxy remote embedding API calls from leader node	2023-06-14 03:08:51 +03:00
Kishore Nallan	d8fc509fe9	Don't send ts api key in curl client requests by default.	2023-05-30 16:28:36 +05:30
Kishore Nallan	b7f29aeed1	Evented query aggregation skeleton.	2023-05-22 17:52:52 +05:30
Kishore Nallan	6096a96385	Verify status of ext snapshot dir copy.	2023-05-08 22:06:30 +05:30
Kishore Nallan	56184aff26	Allow peers to be reset on error/on-demand.	2023-03-28 16:40:52 +05:30
Kishore Nallan	ee3ed42713	Handle premature termination of resource-limited request.	2023-03-10 17:07:05 +05:30
Kishore Nallan	eb3c889e13	Merge branch 'v0.24-nested' into v0.25	2023-01-21 21:22:06 +05:30
Kishore Nallan	e9ffdaf4ed	Update caught up only when leader status is available.	2023-01-21 18:17:50 +05:30
Kishore Nallan	38d7d385f8	Use raft rpc connnection timeout parameter.	2023-01-03 15:24:19 +05:30
Kishore Nallan	e3dee78a1b	Add resource check to batch indexer as well.	2022-12-10 19:21:54 +05:30
Kishore Nallan	83495c817b	Guard for preventing writes when memory/disk thresholds are breached.	2022-11-15 20:25:45 +05:30
Kishore Nallan	936270b4a5	Flag for skipping writes to avoid bad writes.	2022-08-19 18:20:32 +05:30
Kishore Nallan	df46ea28f9	Fix status endpoint response during snapshot loading.	2022-07-02 18:08:24 +05:30
Kishore Nallan	9e5c3ed8b2	Status endpoint for tracking lag against leader.	2022-06-30 18:44:59 +05:30
Kishore Nallan	e3d7a5932d	Rely on nodes configuration for peer discovery.	2022-06-18 11:03:41 +05:30
Kishore Nallan	ec217bd7d7	Expose snapshot_max_byte_count_per_rpc param.	2022-06-17 15:24:26 +05:30
Kishore Nallan	f3af2319a3	Switch to managed snapshotting. ... Ensures that a snapshot does not run when the peers are unhealthy (possibly recovering).	2022-06-17 11:31:48 +05:30
Kishore Nallan	73cc256e2f	Add guard for protecting writes from low disk space.	2022-05-10 07:46:39 +05:30
Kishore Nallan	b2acf289ac	Move write log persistence logic to batched indexer.	2021-11-03 14:37:38 +05:30
Kishore Nallan	baaf7ea65d	Restore store persisted raft log from snapshot.	2021-10-23 10:14:38 +05:30
Kishore Nallan	87f18b03f3	Address concurrency edge case in import streaming. ... Manage concurrent access by the req/res variables between batch indexer and http response threads.	2021-10-07 19:38:54 +05:30
Kishore Nallan	6da39ff51c	Expose write stats.	2021-10-02 18:54:30 +05:30
Kishore Nallan	e3bf9f02d6	Expose number of pending writes as metric.	2021-09-21 12:04:08 +05:30
Kishore Nallan	ced4163062	Handle stack trace on batched indexing.	2021-08-22 08:43:32 +05:30
Kishore Nallan	b24df3c26a	Allow read/write lags to be updated via config API.	2021-08-11 20:28:47 +05:30
Kishore Nallan	a890d036ed	Account for queued writes when computing read+write lags.	2021-08-11 18:18:49 +05:30
Kishore Nallan	35409f8493	Batched background indexer. ... Enables write parallelism across collections.	2021-07-31 21:44:06 +05:30
Kishore Nallan	8e4fc412b1	Retry parsing of nodes config: helps DNS resolution lag.	2021-05-30 20:48:44 +05:30
Kishore Nallan	d6d83ec3ed	Resolve hostnames in nodes config to IP automatically.	2021-05-29 20:54:53 +05:30
Kishore Nallan	46b0f08d3f	Server should not be ready during snapshot pull + load.	2021-05-07 19:32:08 +05:30
Kishore Nallan	c4deb38189	Handle lag being negative in leader.	2021-04-26 17:19:07 +05:30
Kishore Nallan	7e9fbea7f7	Use applying index to work around a bug with index updates.	2021-04-26 08:09:25 +05:30
Kishore Nallan	2a42f1a5fc	Fix race condition with on-demand snapshot.	2021-04-25 22:04:42 +05:30
Kishore Nallan	2a89acd84e	Return 503 for both read and write lag.	2021-04-25 19:15:33 +05:30
Kishore Nallan	aa1cd0acd1	Recover gracefully from a crash during write.	2021-04-23 14:23:00 +05:30
Kishore Nallan	0ae663ab02	Implement rate limiting to protect from write lag.	2021-04-22 07:35:51 +05:30
Kishore Nallan	1b004d3865	Handle failures during import.	2021-04-12 15:05:54 +05:30
Kishore Nallan	5b4b617b59	Refresh catch up status more frequently.	2021-04-10 13:06:56 +05:30
Kishore Nallan	6b793afbae	Refactor deferring of batched writes during import.	2021-04-09 16:47:42 +05:30
Kishore Nallan	073667e844	Fix blocking of http thread during writes.	2021-04-08 17:57:02 +05:30
kishorenc	ad28540fdc	Manage lifecycle of deferred_req_res_t better.	2021-04-06 14:12:15 +05:30