7658 Commits

Author SHA1 Message Date
Lukas Joswiak
c96f560cbe Verify rollback of a single version in simulation, other small fixes 2021-10-25 12:03:22 -07:00
Lukas Joswiak
6078664792 clang-format 2021-10-25 12:03:22 -07:00
Lukas Joswiak
57c2cf4a24 Retry messages to well known endpoints, add notes for future work 2021-10-25 12:03:22 -07:00
Lukas Joswiak
92998fd20b Merge rollback message into rollforward message 2021-10-25 12:03:22 -07:00
Lukas Joswiak
7357d7714c Retry with well known endpoints, move last committed check to consumer 2021-10-25 12:03:22 -07:00
Lukas Joswiak
1631a1b352 Update fdbserver/PaxosConfigConsumer.actor.cpp
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
2021-10-25 12:03:22 -07:00
Lukas Joswiak
e79c6c7456 Fix issue where previous commit messages were reused
Fixes an issue where commit versions from previous requests sent to
ConfigNodes were being reused when a new quorum of commit versions was
requested. This was occurring due to a failure to reset the state of
GetCommittedVersionQuorum after a full snapshot request.
2021-10-25 12:03:22 -07:00
Lukas Joswiak
9d78604c5b Add rollback and rollforward logic to ConfigBroadcaster 2021-10-25 12:03:22 -07:00
Lukas Joswiak
9a39da85b1 Fix issue where previous commit messages were reused
Fixes an issue where commit versions from previous requests sent to
ConfigNodes were being reused when a new quorum of commit versions was
requested. This was occurring due to a failure to reset the state of
GetCommittedVersionQuorum after a full snapshot request.
2021-10-25 12:03:22 -07:00
Lukas Joswiak
48dc91dd7f Add rollback and rollforward logic to ConfigBroadcaster 2021-10-25 12:03:22 -07:00
Evan Tschannen
118c307b57 fixed formatting 2021-10-24 22:26:11 -07:00
Evan Tschannen
9a6384fc26 fixed merge conflicts 2021-10-24 21:18:49 -07:00
Evan Tschannen
6f7558b8ea Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed
# Conflicts:
#	tests/CMakeLists.txt
2021-10-24 21:06:33 -07:00
A.J. Beamon
e882eb33fc Abstract the cluster file into a cluster connection record that can be backed by something other than the filesystem. 2021-10-22 11:05:18 -07:00
Steve Atherton
d153519188
Merge pull request #5813 from sfc-gh-jslocum/ss_ebrake_streaming_fix
Fixes to ss e-brake, tlog streaming, and their interaction
2021-10-22 10:46:17 -07:00
Evan Tschannen
f03d32f3d4 fix: handle the case where a fetch happens at an earlier read version than the commit version of the change feed registration 2021-10-21 23:04:51 -07:00
He Liu
16ae2b76e5 Merge branch 'master' of https://github.com/apple/foundationdb into clean-sim-test-data-loss 2021-10-21 09:16:53 -07:00
Trevor Clinkenbeard
c69364d5aa
Verify that cluster is fully recovered in quietDatabase check (#5807)
* Verify that cluster is fully recovered in quietDatabase check

* Add trace event to waitForQuietDatabase
2021-10-21 09:01:52 -07:00
Evan Tschannen
f1158371a7 Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed
# Conflicts:
#	flow/error_definitions.h
2021-10-21 00:55:12 -07:00
Evan Tschannen
4e79296a9f fixed a few bugs with fetching change feeds 2021-10-21 00:44:51 -07:00
Evan Tschannen
3ebabb6edc fixed incorrect use of change feed errors 2021-10-20 22:37:31 -07:00
Evan Tschannen
e34d242581 fix: do not throw wrong_shard_server for local fetch keys 2021-10-20 22:04:39 -07:00
Zhe Wu
0cf829ef91 Reduce restore error message 2021-10-20 14:02:48 -07:00
Josh Slocum
8dd7f8f447 Fixes to ss e-brake, tlog streaming, and their interaction 2021-10-20 10:48:29 -05:00
Evan Tschannen
ad3dcd6a74 fix: memory replies were not being set 2021-10-19 21:07:36 -07:00
Evan Tschannen
3f7df58a77 fixed a number of issues 2021-10-19 13:56:52 -07:00
Trevor Clinkenbeard
504d0b71b2
Fix invalid memory access when dataDistribution actor is cancelled (#5791)
* Fix valgrind error when dataDistribution actor is cancelled

* Trace Sev30 when dataDistribution actor is cancelled outside of simulation

* Rethrow actor_cancelled error in dataDistribution catch block
2021-10-18 14:21:29 -07:00
sfc-gh-tclinkenbeard
421dee532c Add const qualifiers in KeyValueStoreRocksDB.actor.cpp 2021-10-18 13:40:47 -07:00
sfc-gh-tclinkenbeard
9e06b6e6e3 Make IClosable interface const-correct 2021-10-18 13:40:47 -07:00
Daniel Smith
faf16fb29e
Merge pull request #5785 from Daniel-B-Smith/ikvs-read-type
Add an enum to IKeyValueStore to indicate the source/priority of the read
2021-10-18 13:21:20 -04:00
Daniel Smith
9713a14ef1 Reverse order of read type and debug ID args 2021-10-18 12:23:09 -04:00
A.J. Beamon
507a09893c
Add ClientCount to ClusterControllerMetrics (#5748) 2021-10-17 20:47:11 -07:00
He Liu
a0f62e873e Use ErrorOr to indicate an error. 2021-10-15 14:58:26 -07:00
He Liu
8e7a4c587e Merge branch 'master' of https://github.com/apple/foundationdb into clean-sim-test-data-loss 2021-10-15 14:22:08 -07:00
Daniel Smith
df53cc9580 Add an enum to IKeyValueStore to indicate the source/priority of the read 2021-10-15 14:35:59 -04:00
He Liu
66166e09be Clear range before setting the moved-in empty range as available. 2021-10-15 09:30:06 -07:00
He Liu
dbfeb06c97 Reproduced user data loss incident, and tested the improved exclude tool
can fix the system metadata.
2021-10-14 14:08:39 -07:00
He Liu
8174c57714
Merge pull request #5722 from liquid-helium/add-logs
Added logs for worker_removed() errors in SS.
2021-10-12 15:16:11 -07:00
Evan Tschannen
282f84c807 added handling for broken promise 2021-10-12 10:36:10 -07:00
He Liu
9f974ef21f Added logs for worker_removed() errors in SS. 2021-10-12 10:12:20 -07:00
Josh Slocum
0dafb95bbf Fixing tss private mutations ranges 2021-10-11 18:14:29 -07:00
Evan Tschannen
5b6f8b2abb added the known committed version to change feeds 2021-10-11 13:53:36 -07:00
Evan Tschannen
26b6f9a3f1 fix: resize changes to source vector even though m is a copy 2021-10-10 11:32:49 -07:00
Steve Atherton
f339b603a5 Bug fix: printSnapshotTeamsInfo() could crash when looking up status for a storage server that was very recently added because its entry in server_status was not yet created.
Bug fix:  printSnapshotTeamsInfo()'s local server_status map would not see status updates for server UIDs that already existed in the map.
2021-10-10 01:48:31 -07:00
Steve Atherton
0cce774325
Merge pull request #5732 from sfc-gh-satherton/kvs-write-version
Refactored how Redwood handles commit version
2021-10-09 20:26:52 -07:00
Evan Tschannen
d51edf18dc fixed merge conflicts 2021-10-09 19:47:24 -07:00
Evan Tschannen
5c642f706e Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
2021-10-09 19:34:16 -07:00
Evan Tschannen
efc4cec53f fixed a variety of bugs with change feeds 2021-10-09 19:24:01 -07:00
Steve Atherton
13e6ac7c53
Merge pull request #5740 from sfc-gh-satherton/queue-read-during-shutdown-fix
Fix rare Redwood crash after shutdown
2021-10-09 17:43:01 -07:00
Markus Pilman
424b35de63 verify FLAG_USE_PROVISIONAL_PROXIES on the server 2021-10-09 16:40:24 -06:00