Tao Lin
586cc3b102
Revert "Introduce GetRangeAndFlatMap to push computations down to FDB"
2021-11-04 08:46:56 -07:00
Tao Lin
0853661d13
Introduce getRangeAndHop to push computations down to FDB
2021-11-03 13:21:16 -07:00
Xiaoxi Wang
1a2a838df3
add knob
2021-10-27 09:08:37 -07:00
Evan Tschannen
2208b04174
Merge pull request #5855 from sfc-gh-etschannen/blob_full_clean
...
Blob Granules V0
2021-10-26 09:57:35 -07:00
Lukas Joswiak
c96f560cbe
Verify rollback of a single version in simulation, other small fixes
2021-10-25 12:03:22 -07:00
Josh Slocum
0ff8ddc2b6
Merge branch 'master' into blob_full_clean
2021-10-25 13:38:48 -05:00
Steve Atherton
d153519188
Merge pull request #5813 from sfc-gh-jslocum/ss_ebrake_streaming_fix
...
Fixes to ss e-brake, tlog streaming, and their interaction
2021-10-22 10:46:17 -07:00
Josh Slocum
773886515e
Merge branch 'feature-range-feed' into blob_full_clean
2021-10-22 11:07:51 -05:00
Zhe Wu
0cf829ef91
Reduce restore error message
2021-10-20 14:02:48 -07:00
Josh Slocum
8dd7f8f447
Fixes to ss e-brake, tlog streaming, and their interaction
2021-10-20 10:48:29 -05:00
Josh Slocum
912ef76f1c
cleanup before merge
2021-10-18 17:11:14 -05:00
A.J. Beamon
507a09893c
Add ClientCount to ClusterControllerMetrics ( #5748 )
2021-10-17 20:47:11 -07:00
Josh Slocum
5f0ec0612a
Merge branch 'feature-range-feed' into blob_full
2021-10-13 15:44:35 -05:00
Zhe Wu
c07a07dbbe
Take uptime into account when making failover decision
2021-10-07 11:19:34 -07:00
Zhe Wu
62197faa46
Add more comments to the code
2021-10-07 11:19:34 -07:00
Zhe Wu
c0fbe5471f
Implement the core logic of grey failure triggered failover
2021-10-07 11:19:34 -07:00
Suraj Gupta
4d54669ccd
Recruit the blob workers via blob manager.
...
In this PR, the blob manager now recruits blob workers
(via communication with the cluster controller). Blob workers
are onboarded as blob worker processes enter the cluster.
2021-10-04 11:07:08 -04:00
Suraj Gupta
5fa6c687d6
Add blob manager as a singleton.
2021-09-23 10:45:37 -04:00
Suraj Gupta
72edcd8d73
Address PR comments.
...
Revert knob name change, fix comparison between new and old
recruitments, and get rid of empty `if` block.
2021-09-22 16:56:34 -05:00
Suraj Gupta
0b6fecddbc
Refactor logic for recruiting singletons.
...
This commit refactors the logic for recruiting singletons,
which is done by the ClusterController. This allows for far
easier additions of new singletons in the future, and also
cleans up the code.
Also, the logic for recruiting DD was changed to mirror
the logic for recruiting RK. Although the logic for RK
allows there to be many RKs existing at once, the moveKeysLock
mechanism used by DD still prevents multiple DDs existing at once.
2021-09-22 16:56:18 -05:00
Suraj Gupta
6533678f0d
Address PR comments.
...
Revert knob name change, fix comparison between new and old
recruitments, and get rid of empty `if` block.
2021-09-20 14:26:42 -05:00
Suraj Gupta
fe098b3b11
Refactor logic for recruiting singletons.
...
This commit refactors the logic for recruiting singletons,
which is done by the ClusterController. This allows for far
easier additions of new singletons in the future, and also
cleans up the code.
Also, the logic for recruiting DD was changed to mirror
the logic for recruiting RK. Although the logic for RK
allows there to be many RKs existing at once, the moveKeysLock
mechanism used by DD still prevents multiple DDs existing at once.
2021-09-20 14:26:42 -05:00
Josh Slocum
c2d1d1704f
Merge branch 'feature-range-feed' into blob_full
2021-09-10 11:21:52 -05:00
Josh Slocum
eb76343dfb
Added blob granule reassignment and splitting
2021-09-08 14:09:14 -05:00
Steve Atherton
be440ab954
Merge pull request #5260 from FuhengZhao/RedwoodHistogram
...
Redwood local histograms
2021-08-26 12:05:44 -07:00
Josh Slocum
5259af787d
Switched blob implementation to use backup container
2021-08-24 13:47:47 -05:00
Fuheng Zhao
b65a66fab7
log redwood histogram seperatly
2021-08-24 09:57:39 -07:00
Neethu Haneesha Bingi
02b3ed3ff1
Adding deadline option to rocksdb calls.
2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi
fbb393f998
Added readrange timeoout check and rocksdb read deadline option.
2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi
24ac173c95
Adding ReadRangeAction timeout, returning error and using timer_monotonic changes.
2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi
01e85610ab
Cancelling the timedout reads with rocksdb storage.
2021-08-19 14:11:28 -07:00
Daniel Smith
45b40addb7
Merge pull request #5379 from neethuhaneesha/eagerReadsDisable
...
Disabling option for removing eagerReads for ClearRange mutations.
2021-08-19 12:39:30 -04:00
Neethu Haneesha Bingi
c45daf6f51
Disabling option for removing eagerReads for ClearRange mutations.
2021-08-13 01:26:50 -07:00
Xiaoxi Wang
a97570bd06
solve mis-spelling, trace log and format problems
2021-08-11 18:26:00 -07:00
Josh Slocum
921a2cfca1
Merge branch 'feature-range-feed' into blob_full
2021-08-10 11:25:48 -05:00
Josh Slocum
e83b27387a
POC worker that dumps fdb range to an s3 object
2021-08-06 11:01:37 -05:00
Xiaoxi Wang
fd74a16f35
format code
2021-08-02 14:24:20 -07:00
Xiaoxi Wang
2df0474fec
merge master
2021-08-02 11:58:35 -07:00
Daniel Smith
a26dbba66f
Add RocksDB metrics
2021-07-30 13:27:43 -04:00
Xiaoxi Wang
10c82b422f
merge master branch
2021-07-28 14:19:46 -07:00
Dan Lambright
55094bdd00
Merge branch 'master' into expired-forward
2021-07-26 19:58:29 -04:00
Dan Lambright
ae424f1195
rebase
2021-07-26 10:55:22 -04:00
sfc-gh-tclinkenbeard
6836e49073
Throw error when commitProxy gets stuck
2021-07-19 21:00:28 -07:00
sfc-gh-tclinkenbeard
d46feb5468
Add COORDINATOR_LEADER_CONNECTION_TIMEOUT server knob
2021-07-19 20:17:46 -07:00
Xiaoxi Wang
1584ed5853
Merge branch 'master' of https://github.com/apple/foundationdb into tlog_dev
2021-07-14 16:20:19 +00:00
Xiaoxi Wang
501dc339a9
relax perpetual wiggle pause condition; add trace log; correct perpetual wiggle priority setting
2021-07-12 05:46:55 +00:00
Zhe Wu
8773cb1a42
Merge pull request #5088 from halfprice/zhewu/cc-health-triggered-recovery
...
Implement the main logic of gray network triggered recovery in Cluster Controller
2021-07-11 20:50:34 -07:00
sfc-gh-tclinkenbeard
020371a78f
Merge remote-tracking branch 'origin/master' into add-boolean-param
2021-07-07 16:50:51 -07:00
Steve Atherton
9b969b99f4
Merge pull request #5118 from sfc-gh-satherton/redwood-rangeread-prefetch
...
Redwood range read prefetching
2021-07-07 11:12:18 -07:00
Zhe Wang
b82a3f4276
add trace event to tLog pop
2021-07-07 12:13:49 -05:00
