A.J. Beamon
a892eec57d
Manually apply changes made to BackupContainer.actor.cpp on release-6.3 to the new files where that code is located.
2021-03-15 16:41:22 -07:00
A.J. Beamon
25c4880ebe
Merge branch 'release-6.3' into merge-release-6.3-into-master (temporarily discard all changes to BackupContainer.actor.cpp)
...
# Conflicts:
# fdbclient/BackupContainer.actor.cpp
# fdbserver/Knobs.h
2021-03-15 16:41:04 -07:00
A.J. Beamon
0dd9fdf9de
Throw an error if the local client is disabled and there are no external clients
2021-03-11 14:09:52 -08:00
Vishesh Yadav
2c316db94d
Merge remote-tracking branch 'apple/master' into master-format-final
...
Also format the changes
2021-03-11 12:54:26 -08:00
Andrew Noyes
be980ebb55
Merge pull request #4354 from sfc-gh-clin/add-advanceversion
...
Add advanceversion into special keys
2021-03-11 11:43:53 -08:00
Russell Sears
d17702e7c4
Merge pull request #4463 from sfc-gh-ajbeamon/mvc-dont-copy-with-single-thread
...
Multi-version client: don't copy external libraries if we aren't using multiple threads
2021-03-11 11:16:54 -08:00
Vishesh Yadav
d7252da951
clang-format: Fix the TEST() macros which require comments in line
2021-03-10 16:50:53 -08:00
Vishesh Yadav
2cd3f45fd6
Merge remote-tracking branch 'apple/release-6.3' into master-format-final
...
release-6.3 was recently merged, and there were two PRs which were
merged in between and got those changes in here. Hence, since all the
changes were in, discarded the incoming changes and accepted all
current.
2021-03-10 16:50:44 -08:00
A.J. Beamon
fe4ff420a3
Don't copy the external libraries if you aren't using more than one thread
2021-03-10 15:09:30 -08:00
Markus Pilman
cfbaaa6001
Merge remote-tracking branch 'origin/release-6.2' into release-6.3
2021-03-10 14:30:47 -07:00
Vishesh Yadav
af36e52fdf
Merge branch 'release-6.3-pre-format' into master-format
...
This merges release-6.3 branch right before it was fully formatted.
There were quite a few conflicts that are resolved here. CoroFlow had
a check for OOM errors introduced in 6.3, but didn't seem applicable in
the new implmentation which seems to use boost.
2021-03-10 10:40:53 -08:00
FDB Formatster
df90cc89de
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
Vishesh Yadav
2bb4f2e59f
Merge branch 'release-6.3-pre-format' into master-format
...
This merges release-6.3 branch right before it was fully formatted.
There were quite a few conflicts that are resolved here. CoroFlow had
a check for OOM errors introduced in 6.3, but didn't seem applicable in
the new implmentation which seems to use boost.
2021-03-10 09:37:41 -08:00
Steve Atherton
e9c9bd5299
Merge commit 'e2d3ddee2cb4da0bba65346d29ad2212fbce16f0' into file-backup-async-rename
...
# Conflicts:
# fdbclient/BackupContainer.actor.cpp
# fdbclient/FileBackupAgent.actor.cpp
# fdbclient/Knobs.cpp
# fdbrpc/AsyncFileNonDurable.actor.h
# fdbrpc/sim2.actor.cpp
2021-03-08 02:00:40 -08:00
Steve Atherton
318b862aa3
Apply clang-format to backup changes.
2021-03-08 01:49:29 -08:00
Steve Atherton
a397d8625f
AsyncFileNonDurable now has a flag for whether or not to emulate AIO mode, so the previous behavior limits are preserved when this flag is set. AsyncFileDurable writes which are selected to be durable are again done in a single write, and the logic to handle non-aligned writes for non-AIO mode is more clear and commented. In simulation, backup files on local filesystems are written with random buffer sizes. Backup container unit test now uses more random file sizes and limits memory consumption for all files being written in parallel.
2021-03-07 22:21:10 -08:00
Steve Atherton
8a4aca3f47
Bug fix: In simulation only, RangeFileWriter was not waiting on a write future in one location.
2021-03-07 22:19:04 -08:00
Steve Atherton
1d00c41385
Bug fixes: Avoid empty writes, avoid 0 length truncation, and make AsyncFileNonDurable support writes at arbitrary offsets and lengths. Increase randomness of IBackupFile appends in backup container unit test.
2021-03-05 17:45:36 -08:00
FDB Formatster
8a8c488ede
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-05 18:13:38 -06:00
FDB Formatster
0c214d71da
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-05 16:31:35 -06:00
Steve Atherton
1025a0da37
File-based backup now uses async rename to prevent blocking the network thread in the event of slow filesystem metadata operations. Backup now opens its write-only files without a block cache so that writes to disk will be larger (1MB by default instead of 4k).
2021-03-03 21:45:33 -08:00
Andrew Noyes
79cec09255
Apply clang-tidy's performance-inefficient-vector-operation fix
...
I ran this command in my build directory after compiling with
OPEN_FOR_IDE. It took a few small tweaks to get it to compile, which is
outside the scope of this commit.
$ python run-clang-tidy.py -j $(nproc) -checks='-*,performance-inefficient-vector-operation' -fix
2021-03-04 03:58:25 +00:00
Markus Pilman
37d9e975e9
Fix multiple compiler warnings
2021-03-03 10:18:03 -07:00
Evan Tschannen
346a4e3ecd
Merge branch 'release-6.3'
...
# Conflicts:
# fdbcli/fdbcli.actor.cpp
# fdbrpc/LoadBalance.actor.h
# fdbrpc/MultiInterface.h
# fdbserver/ClusterController.actor.cpp
# fdbserver/MasterProxyServer.actor.cpp
# fdbserver/masterserver.actor.cpp
2021-03-01 18:52:06 -08:00
Hari Bhaskaran
25069a9444
Fix compile error: Related to pr 3961
2021-02-27 17:10:21 -08:00
Chaoguang Lin
5b4e77bb99
Update comments, add asssertions
2021-02-25 13:13:34 -08:00
Chaoguang Lin
424aae71cc
Solve comments. Disable clear for ClientProfilingImpl and set the upperbound value for advanceversion
2021-02-25 13:02:56 -08:00
Vishesh Yadav
d8932f142a
Merge pull request #4350 from sears/multithreaded-pr-comments
...
Multithreaded pr comments
2021-02-23 15:09:52 -07:00
Vishesh Yadav
1ee9c3e45d
Apply suggestions from code review
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2021-02-22 20:18:01 -07:00
Jingyu Zhou
d2440b5986
Merge pull request #4313 from xumengpanda/mengxu/ha-code
...
Add comments to explain loadBalance algorithm
2021-02-22 18:24:06 -08:00
negoyal
e9b7e22e02
Merge branch 'rel-6.3'
2021-02-22 08:47:22 -08:00
negoyal
e49cc68bbc
Merge branch 'rel-6.2' into rel-6.3
2021-02-21 00:15:31 -08:00
Meng Xu
ef0bf2728e
Merge branch 'release-6.3' into mengxu/ha-code
...
Resolve Conflicts:
fdbserver/LogRouter.actor.cpp: Only conflicts at comments
2021-02-19 21:47:09 -08:00
Chaoguang Lin
9ce9cba0e5
Merge branch 'master' of github.com:apple/foundationdb into add-advanceversion
2021-02-19 14:29:08 -08:00
Chaoguang Lin
703107332a
Add special keys for profile client get/set
2021-02-19 12:22:00 -08:00
Andrew Noyes
9fb396e372
Merge pull request #4255 from sfc-gh-clin/add-coordinators-into-special-keys
...
Add coordinators into special keys
2021-02-18 18:26:07 -08:00
Nim Wijetunga
fa3834f115
fix bug
2021-02-18 18:23:28 -05:00
Chaoguang Lin
70098b752a
Fix typo, solve comments
2021-02-18 14:23:51 -08:00
A.J. Beamon
af77fae131
Fix bug in code I recently added where the process name memory was not long-lived and was later used.
2021-02-18 18:33:23 +00:00
Chaoguang Lin
ac860b3c22
Add advanceversion into special keys
2021-02-18 01:27:14 -08:00
Hao Fu
971b1aa1e6
Add txnRejectedForQueuedTooLong in ProxyStats
...
Added transactions.rejected_for_queued_too_long for bookkeeping the
number of transactions rejected by commit proxy because its queuing
time exceeds MVCC window.
2021-02-17 21:40:46 -08:00
Russell Sears
5324f127c9
Address skipped PR comments from multithreaded client PR
2021-02-17 21:10:42 +00:00
Andrew Noyes
c075415a51
Merge pull request #4344 from sfc-gh-ljoswiak/fixes/remove-async-tracer
...
Remove async tracer
2021-02-17 09:43:24 -08:00
Chaoguang Lin
f3a849de10
Update ChangeConfig test for auto coordinators change
2021-02-16 23:55:58 -08:00
Lukas Joswiak
30d2d9ff82
Remove async tracer
2021-02-16 16:36:33 -08:00
Andrew Noyes
bcd9a00a50
Backport #4285 and 1513df22f3 to release-6.2
...
Fixes #4342
2021-02-17 00:35:25 +00:00
Chaoguang Lin
fca7f753f8
Remove special key for coordinators' 'auto' option
2021-02-16 13:46:45 -08:00
Vishesh Yadav
ab1c51618a
Merge pull request #4269 from sears/multithreaded_client
...
Multithreaded client
2021-02-16 13:11:14 -08:00
Chaoguang Lin
9dd94499f2
Update traces
2021-02-16 13:06:25 -08:00
Chaoguang Lin
731ee8a121
Update ChangeConfig to test coordinators special keys
2021-02-16 13:01:37 -08:00