68 Commits

Author	SHA1	Message	Date
Kishore Nallan	7ac12c0357	Merge branch 'v0.25-join' into v0.26-facets	2023-11-25 15:39:52 +05:30
Kishore Nallan	7d06c30cb0	No timeout for follower proxying of writes.	2023-11-20 15:55:02 +05:30
krunal	a21a2dfddd	add analytics db to snapshot	2023-11-16 15:01:08 +05:30
krunal	1f8c0d73dd	adding tests	2023-08-07 16:23:43 +05:30
krunal1313	c39126ee79	error handling	2023-07-04 17:32:44 +05:30
krunal1313	46a2aa140b	moving gzip handling to leader node only	2023-07-04 11:34:10 +05:30
Kishore Nallan	b7f29aeed1	Evented query aggregation skeleton.	2023-05-22 17:52:52 +05:30
Kishore Nallan	6096a96385	Verify status of ext snapshot dir copy.	2023-05-08 22:06:30 +05:30
Kishore Nallan	56184aff26	Allow peers to be reset on error/on-demand.	2023-03-28 16:40:52 +05:30
Kishore Nallan	e3dee78a1b	Add resource check to batch indexer as well.	2022-12-10 19:21:54 +05:30
Kishore Nallan	83495c817b	Guard for preventing writes when memory/disk thresholds are breached.	2022-11-15 20:25:45 +05:30
Kishore Nallan	9e5c3ed8b2	Status endpoint for tracking lag against leader.	2022-06-30 18:44:59 +05:30
Kishore Nallan	e3d7a5932d	Rely on nodes configuration for peer discovery.	2022-06-18 11:03:41 +05:30
Kishore Nallan	ec217bd7d7	Expose snapshot_max_byte_count_per_rpc param.	2022-06-17 15:24:26 +05:30
Kishore Nallan	f3af2319a3	Switch to managed snapshotting. ... Ensures that a snapshot does not run when the peers are unhealthy (possibly recovering).	2022-06-17 11:31:48 +05:30
Kishore Nallan	73cc256e2f	Add guard for protecting writes from low disk space.	2022-05-10 07:46:39 +05:30
Kishore Nallan	b2acf289ac	Move write log persistence logic to batched indexer.	2021-11-03 14:37:38 +05:30
Kishore Nallan	6da39ff51c	Expose write stats.	2021-10-02 18:54:30 +05:30
Kishore Nallan	e3bf9f02d6	Expose number of pending writes as metric.	2021-09-21 12:04:08 +05:30
Kishore Nallan	b24df3c26a	Allow read/write lags to be updated via config API.	2021-08-11 20:28:47 +05:30
Kishore Nallan	35409f8493	Batched background indexer. ... Enables write parallelism across collections.	2021-07-31 21:44:06 +05:30
Kishore Nallan	8e4fc412b1	Retry parsing of nodes config: helps DNS resolution lag.	2021-05-30 20:48:44 +05:30
Kishore Nallan	d6d83ec3ed	Resolve hostnames in nodes config to IP automatically.	2021-05-29 20:54:53 +05:30
Kishore Nallan	b3d1a48769	Fix shutdown when node is terminated before becoming leader.	2021-04-26 19:01:32 +05:30
Kishore Nallan	c4deb38189	Handle lag being negative in leader.	2021-04-26 17:19:07 +05:30
Kishore Nallan	2a89acd84e	Return 503 for both read and write lag.	2021-04-25 19:15:33 +05:30
Kishore Nallan	aa1cd0acd1	Recover gracefully from a crash during write.	2021-04-23 14:23:00 +05:30
Kishore Nallan	0ae663ab02	Implement rate limiting to protect from write lag.	2021-04-22 07:35:51 +05:30
Kishore Nallan	2591231a0b	Fix on-demand snapshot.	2021-04-10 14:24:28 +05:30
Kishore Nallan	5b4b617b59	Refresh catch up status more frequently.	2021-04-10 13:06:56 +05:30
Kishore Nallan	6b793afbae	Refactor deferring of batched writes during import.	2021-04-09 16:47:42 +05:30
Kishore Nallan	073667e844	Fix blocking of http thread during writes.	2021-04-08 17:57:02 +05:30
kishorenc	bc0d01bb47	Parameterize thread pool size and collection load configs.	2021-03-29 15:18:47 +05:30
kishorenc	3159712ca3	Remove support for init db snapshot. ... Also, handle termination of follower process during import gracefully.	2021-03-26 12:27:04 +05:30
kishorenc	9f159b5d3d	Clean shutdown.	2021-03-25 16:05:49 +05:30
kishorenc	f085354824	Copy only state snapshot directory for on-demand snapshots.	2021-03-17 16:12:46 +05:30
kishorenc	0c6a6d483a	Protect access to node object.	2021-03-11 18:49:37 +05:30
kishorenc	8d4defa93e	Parameterize catchup_min_sequence_diff.	2021-03-04 14:11:28 +05:30
kishorenc	95ee14350a	Use shared_ptr to handle req/res life cycles.	2021-02-28 12:48:20 +05:30
kishorenc	e2882c5828	Fix race condition in snapshot restoration.	2021-02-12 19:10:57 +05:30
Jason Bosco	009e67815c	Make on-demand snapshot endpoint asynchronous.	2021-01-29 13:58:14 -08:00
Jason Bosco	bcea70ebfd	Add windowed stats endpoint	2021-01-22 16:52:27 -08:00
kishorenc	10fd97c32d	Node vote API for triggering leader rotation.	2020-12-28 19:20:00 +05:30
kishorenc	8a310bbb82	On demand snapshot API.	2020-12-28 19:19:59 +05:30
kishorenc	efae9055bc	Don't mark follower as not caught up for small lags.	2020-09-18 16:52:00 +05:30
kishorenc	a2b421209c	Protect API until follower has caught up with leader. ... The catch up threshold is configurable as well. Default: 95%	2020-09-17 18:00:32 +05:30
kishorenc	6593d959ec	Set min snapshot index gap to 1.	2020-09-10 21:35:55 +05:30
kishorenc	1b01de0c0c	Housekeeping tasks.	2020-09-07 21:25:04 +05:30
kishorenc	58b52687ea	Handle disconnects during import.	2020-09-04 15:12:09 +05:30
kishorenc	6d7c6b2ea0	Implemented import streaming end-to-end on follower.	2020-09-03 20:44:39 +05:30