1
0
mirror of https://github.com/apple/foundationdb.git synced 2025-05-28 10:52:03 +08:00

99 Commits

Author SHA1 Message Date
Jingyu Zhou
a8ba9bd021 Fix assertion of resolver returned mutation count 2021-11-09 11:45:53 -08:00
Jingyu Zhou
9f305d67a9 Fix backup mutation tags not counted in version vector 2021-10-22 08:43:20 -07:00
sbodagala
48a0ecd647
Merge pull request from dlambrig/integrate-PR5700
version vector / Calculate TPCV on resolvers
2021-10-20 16:35:44 -04:00
Sreenath Bodagala
06f5401d14 Propagate written tags from proxy to sequencer when ENABLE_VERSION_VECTOR
is enabled, not when ENABLE_VERSION_VECTOR_TLOG_UNICAST is enabled.
2021-10-18 16:31:31 +00:00
Dan Lambright
eb814ce070 Remove dead code, check replies match for all resolvers 2021-10-18 10:23:08 -04:00
Dan Lambright
23062b892e Calculate tpcv on resolvers 2021-10-15 16:40:00 -04:00
Jingyu Zhou
dd8840837d Assert private mutation counts are the same from Resolvers 2021-10-15 12:13:20 -04:00
Jingyu Zhou
c6a9ac11a8 fix another conflict fdbserver/ApplyMetadataMutation.cpp 2021-10-15 09:48:33 -04:00
Jingyu Zhou
fc7325e923 Fix force recovery when generating private mutations
Resolver need to skip transactions after forceRecovery flag is true.
2021-10-15 09:47:23 -04:00
Jingyu Zhou
34e9932778 Separate \xff keyspace from keyResolvers
This is needed to make sure all Resolvers process all metadata mutations.
For commit proxy, we add all read/write conflict ranges for metadata mutations
to all resolvers.

We also send lock_aware flag for each transaction to resolvers.
2021-10-15 09:47:23 -04:00
Jingyu Zhou
fddf16534d Send metadata mutations to all Resolvers
This is to make sure all Resolvers process them and make the same decision,
as well as maintain the same in-memory states, e.g., keyServers, serverKeys.
2021-10-15 09:47:23 -04:00
Jingyu Zhou
0dc9c607f4 Add knob PROXY_USE_RESOLVER_PRIVATE_MUTATIONS
To control proxy to use private mutations from resolvers or not.
2021-10-15 09:47:23 -04:00
Jingyu Zhou
c1d7b03087 CommitProxy uses Resolver's private mutations
Note the commit proxy still runs applyMetadataMutations for setting up memory
states, and no longer generates private mutations.
2021-10-15 09:47:23 -04:00
Jingyu Zhou
90a27bedf5 fix conflict fdbserver/ApplyMetadataMutation.cpp 2021-10-15 09:47:20 -04:00
Jingyu Zhou
9ecdbc39ee Add private mutations to Resolver reply messages 2021-10-15 09:45:57 -04:00
Dan Lambright
b78dd3b9dd Respond to comments 9/24 2021-09-30 11:51:57 -04:00
Dan Lambright
58e1888d8e remove network hop by getting previous commit versions in GetCommitVersionRequest 2021-09-30 11:51:57 -04:00
Sreenath Bodagala
2aa3b44d4e Merge remote-tracking branch 'apple-upstream/master' into version-vector-prototype
- Conflicts:
	fdbserver/LogSystem.h
	fdbserver/LogSystemConfig.h
	fdbserver/TagPartitionedLogSystem.actor.cpp

- Files modified during merge:

modified:   fdbserver/LogSystem.cpp
modified:   fdbserver/LogSystemConfig.cpp
2021-09-17 19:36:18 +00:00
Xiaoge Su
abf73047ca Enforce std:: specifier rather than using namespace 2021-09-16 19:40:28 -07:00
Dan Lambright
8689e1f106 merge with master 2021-08-30 15:29:08 -04:00
Xiaoge Su
e6b8a519c4 fixup! Make processTransactionStateRequestPart not blocking 2021-08-28 21:10:10 -07:00
Xiaoge Su
74d8ca87d7 Refactor TxnStateRequest handler in commitProxyServerCore 2021-08-27 23:38:34 -07:00
FDB Formatster
69508b980f modify comments to make clang-format and coverage tool play nice 2021-08-27 17:18:00 -07:00
FDB Formatster
2c788c233d apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-08-27 17:07:47 -07:00
Lukas Joswiak
a605fb3852
Merge pull request from sfc-gh-ljoswiak/fixes/alp6
Actor sampling
2021-08-11 13:44:17 -07:00
Steve Atherton
54c7036eaf Move role UIDs for MutationTracking TraceEvents from various inconsistent detail fields into the TraceEvent UID field. 2021-08-10 01:52:36 -07:00
Steve Atherton
e5e8a56b66 Merge branch 'master' of https://github.com/apple/foundationdb into debugging-cleanup
# Conflicts:
#	fdbbackup/FileDecoder.actor.cpp
2021-08-09 23:36:57 -07:00
Steve Atherton
faa4154a56 MutationTracking now uses a vector of keys to track. Removed "Mutation" detail from DEBUG_MUTATION() events because they are duplicates of the fields already logged in the returned MutationTracking event, which are now renamed and combined into "Mutation". Removed more toString() calls in TraceEvent detail values. 2021-08-09 23:30:45 -07:00
Sreenath Bodagala
a081c0baa5 Merge remote-tracking branch 'apple-upstream/master' into version-vector-prototype 2021-08-05 22:40:32 +00:00
yao-xiao-github
8609b45354
Add histograms to CommitProxyServer. () 2021-08-05 09:17:37 -07:00
Sreenath Bodagala
7f3bc53858 - Address a bug 2021-08-02 19:35:59 +00:00
Lukas Joswiak
5dc9a97230 Merge branch 'master' into fixes/alp6 2021-08-01 20:42:52 -07:00
sfc-gh-tclinkenbeard
c74047c665 Merge remote-tracking branch 'origin/master' into fix-more-clang-warnings 2021-07-28 11:51:02 -07:00
Lukas Joswiak
3eed4084e2 Merge branch 'master' into fixes/alp6 2021-07-27 11:26:53 -07:00
Lukas Joswiak
59d535149e Merge branch 'master' into fixes/alp6 2021-07-27 10:07:18 -07:00
Steve Atherton
507c1f11e3 Add .log() to bare TraceEvent() invocations without any .detail()s to avoid clang-tidy warning about immediate destruction of object without use. 2021-07-26 19:55:10 -07:00
Trevor Clinkenbeard
48d4ea6d57
Merge pull request from sfc-gh-tclinkenbeard/availability-improvements
Throw `failed_to_progress` error when a role fails to make progress
2021-07-26 15:55:14 -07:00
Sreenath Bodagala
d398377c4a - Move the logic that populates written_tags (the tags that have been
affected by a transaction batch) to LogPushData
2021-07-26 16:27:19 +00:00
sfc-gh-tclinkenbeard
b9a22a61ef Fix many -Wreorder-ctor warnings 2021-07-23 17:33:18 -07:00
Dan Lambright
1bb01ef591 use version vector in GetRange 2021-07-22 10:49:08 -04:00
sfc-gh-tclinkenbeard
6836e49073 Throw error when commitProxy gets stuck 2021-07-19 21:00:28 -07:00
Dan Lambright
3dc0c44187
Merge branch 'version-vector-prototype' into vv-79736536 2021-07-19 15:50:16 -04:00
Sreenath Bodagala
8b2089e37b - Fix a bug and address some review comments 2021-07-19 16:56:02 +00:00
Dan Lambright
65b743b5ef respond to comments 8/15 2021-07-16 09:14:34 -04:00
Sreenath Bodagala
81001edb2e - Propagate version vector deltas between processes 2021-07-15 19:49:20 +00:00
Sreenath Bodagala
b6f89df060 - Propagate the latest commit version of a storage server as part of read request.
Make storage server read at the specified version.
2021-07-15 19:48:42 +00:00
Dan Lambright
d07c8ce211 wait for prev per tlog 2021-07-15 08:44:48 -04:00
Dan Lambright
7c285aa4cf wait for prev 2021-07-13 21:07:17 -04:00
Dan Lambright
d8122ebc09 Respond to review comments 7/8 2021-07-12 12:13:25 -04:00
Dan Lambright
17be3dc201 fix bug related to misunderstanding of tag replicas. 2021-07-12 11:46:52 -04:00