Richard Chen
055add9682
conflicts
2020-10-23 06:33:00 +00:00
Young Liu
8cc3e4d3c6
Merge release-6.3 into master
2020-10-19 22:51:56 -07:00
Richard Chen
545ee4269d
master conflicts
2020-10-19 01:03:54 +00:00
Lukas Joswiak
e47e0108a7
Add new TLogVersion
2020-10-14 15:41:10 -07:00
Richard Chen
41843f07e6
add simulator support for different process versions and ProtocolVersion test
2020-10-12 18:19:31 +00:00
Lukas Joswiak
dea7000970
Merge remote-tracking branch 'upstream/master' into visibility-1
2020-10-06 18:38:15 -07:00
Lukas Joswiak
e94c372815
Fix serialization order
2020-10-06 18:33:29 -07:00
Evan Tschannen
614c8bc895
Get read versions requests must be load balanced on the number of requests because ratekeeper gives out an equal budget to each proxy
2020-10-04 16:20:24 -07:00
Young Liu
35bef73a1c
Rename proxy to commit proxy
2020-09-10 17:44:15 -07:00
Lukas Joswiak
1ca7fe1a05
Add span metadata message
2020-09-04 15:36:47 -07:00
Young Liu
79ce16650d
merge master branch
2020-08-11 19:22:10 -07:00
Evan Tschannen
a49cb41de7
Merge branch 'release-6.3'
...
# Conflicts:
# CMakeLists.txt
# cmake/ConfigureCompiler.cmake
# fdbserver/Knobs.cpp
# fdbserver/StorageCache.actor.cpp
# fdbserver/storageserver.actor.cpp
# flow/ThreadHelper.actor.h
# flow/serialize.h
# tests/CMakeLists.txt
2020-07-29 00:31:55 -07:00
Andrew Noyes
d2cf700bd4
Fix compiler warnings
2020-07-28 18:30:26 +00:00
Young Liu
229ab0d5f1
Fix some conflicts and remote debugging trace events
2020-07-22 23:35:46 -07:00
Young Liu
525f10e30c
Merge master branch
2020-07-22 16:08:49 -07:00
Young Liu
302cf5c45f
Remove debug trace events
2020-07-22 12:20:22 -07:00
Young Liu
2703cedac5
Fixed known bugs
2020-07-17 22:24:52 -07:00
Young Liu
21c1998cca
Fix MaxTLogQueueSize Bug
2020-07-16 15:56:04 -07:00
Young Liu
5b06d69d25
Pass watches test
2020-07-15 00:37:41 -07:00
Evan Tschannen
7affda3c8b
Merge branch 'release-6.3'
...
# Conflicts:
# CMakeLists.txt
2020-07-14 14:57:24 -07:00
Jingyu Zhou
773e533a09
Make Arena's impl private
2020-07-13 21:39:36 -07:00
Markus Pilman
69864c9f96
Make Spans not allocate heap memory
2020-07-09 11:49:33 -06:00
Markus Pilman
0fbe7101c3
Revert "Revert "Request tracing""
...
This reverts commit 327cc31e354d80ca00003a2673bd19a6760285d4.
2020-07-07 10:06:13 -06:00
Meng Xu
f3302833ce
Merge pull request #3435 from apple/release-6.3
...
Merge Release 6.3 to master
2020-06-30 10:08:28 -07:00
Jingyu Zhou
8263c25336
Really ignore the error from uploading actor
2020-06-27 22:36:53 -07:00
Jingyu Zhou
d883426c6a
Fix spammy GotBackupProgress events
...
Only print this types of events during master recovery and don't log them for
backup workers.
2020-06-27 21:30:38 -07:00
Jingyu Zhou
b8c77ead43
Fix spurious SevError from backup workers
...
While displaced backup workers wait for uploading to finish, it can get
connection_failed error, which caused spurious SevError of BackupFailed. Fix
by ignoring any errors from the uploading actor.
2020-06-27 21:24:22 -07:00
Jingyu Zhou
327cc31e35
Revert "Request tracing"
2020-06-16 12:32:42 -07:00
Markus Pilman
09c136e434
Framework for transaction tracing
2020-06-08 16:09:37 -07:00
Meng Xu
36ad1a95f4
Resolve conflicts when merge release-6.3 into master
2020-05-25 12:11:59 -07:00
Meng Xu
1c35ad884f
Merge branch 'master' into mengxu/release-6.3-conflict-PR
...
Has conflict with master;
Next commit will fix the conflicts.
2020-05-25 12:01:49 -07:00
A.J. Beamon
d128252e90
Merge release-6.3 into master
2020-05-22 09:25:32 -07:00
Jingyu Zhou
9e23166cf8
Fix a super rare missing mutation bug in backup workers
...
When a backup worker stops pulling for an old epoch, we cannot clear mutations.
This is because these muations are needed for saving.
2020-05-21 12:19:57 -07:00
Jingyu Zhou
cdeabc4de6
Fix memory accounting error due to growing Arena
...
After an Arena object is counted, it can grow larger later. So we can't reduce
the amount of memory of arena size later. Instead, we use the arena size when
inserting mutations.
2020-05-20 13:26:57 -07:00
Jingyu Zhou
9fbbec1033
Fix duplicated counting of memory usage
...
For each message from LogPeekCursor, check it's using different arena from the
previous one. Otherwise, the arena's memory could be counted twice.
2020-05-16 18:50:09 -07:00
Jingyu Zhou
a2e5050492
Fix duplicated mutation
...
This seems to be related to how actor compiler generates code. The message can
be inserted twice with original code ordering.
2020-05-16 10:52:11 -07:00
Jingyu Zhou
caca31d05a
Filter out mutations before the true-up version
...
When a mutation log's begin version is true-uped, we must filter out mutations
less than such a version.
2020-05-15 20:06:47 -07:00
Jingyu Zhou
01eff0fc03
Fix memory bytes accounting
...
Avoid duplicated counting of arena memory since messages from peek cursor can
share arena.
2020-05-14 19:59:54 -07:00
Jingyu Zhou
17915e13b0
Limit memory usage of backup workers
2020-05-14 13:24:56 -07:00
Jingyu Zhou
1a35efe43c
Add an assertion: mutation version >= log's begin version
...
This is to check that no version's data are split into two files.
2020-05-14 12:06:13 -07:00
Alex Miller
ccaac162e2
Resolve performance concerns of nearly-no-op debugMutation being frequently called
...
This introduces unhygenic macro variants that inline a `ENABLED &&`
before the TraceEvent. This way, they get entirely compiled out unless
enabled.
Then rewrite all debugMutation uses via sed.
2020-05-13 18:44:15 -07:00
Alex Miller
27da91ab9e
Merge remote-tracking branch 'upstream/master' into mutation-debugging
2020-05-13 12:51:44 -07:00
A.J. Beamon
36454bb3b8
Merge branch 'master' into transaction-tagging
...
# Conflicts:
# fdbclient/MasterProxyInterface.h
# fdbclient/NativeAPI.actor.cpp
2020-05-04 10:23:25 -07:00
Evan Tschannen
bd699f435c
fixed compiler errors
2020-05-01 11:01:09 -07:00
A.J. Beamon
66228343f1
Merge branch 'master' into transaction-tagging
2020-04-30 08:12:03 -07:00
Jingyu Zhou
7d59e53349
Consolidate makePadding()
2020-04-28 15:39:23 -07:00
A.J. Beamon
41c517a5dd
Merge branch 'master' into transaction-tagging
...
# Conflicts:
# fdbclient/NativeAPI.actor.cpp
2020-04-27 13:05:24 -07:00
A.J. Beamon
239876351b
Add some initial auto-throttling. Move the definition of the priority enum to a more global place and use it for all transaction priorites (except in ClientLogEvents, because of serialization incompatibilites).
2020-04-24 11:31:16 -07:00
Jingyu Zhou
0ae0a81edf
Ensure mutation logs save complete version's data
...
I.e., do not allow the same version's mutations saved in different files.
Otherwise, we may have a file only contain a version's partial data, causing
continuity analysis of mutation logs to fail. This could also cause restore
failures, if the target version's mutations are stored in two files.
In the above description, all mutation logs refer to the same tag's logs.
2020-04-20 20:41:30 -07:00
Jingyu Zhou
61f0f44ab3
Fix comments on startVersion in BackupWorker
2020-04-20 17:07:50 -07:00