1
0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-02 03:12:12 +08:00

3240 Commits

Author SHA1 Message Date
A.J. Beamon
a892eec57d Manually apply changes made to BackupContainer.actor.cpp on release-6.3 to the new files where that code is located. 2021-03-15 16:41:22 -07:00
A.J. Beamon
25c4880ebe Merge branch 'release-6.3' into merge-release-6.3-into-master (temporarily discard all changes to BackupContainer.actor.cpp)
# Conflicts:
#	fdbclient/BackupContainer.actor.cpp
#	fdbserver/Knobs.h
2021-03-15 16:41:04 -07:00
A.J. Beamon
0dd9fdf9de Throw an error if the local client is disabled and there are no external clients 2021-03-11 14:09:52 -08:00
Vishesh Yadav
2c316db94d Merge remote-tracking branch 'apple/master' into master-format-final
Also format the changes
2021-03-11 12:54:26 -08:00
Andrew Noyes
be980ebb55
Merge pull request from sfc-gh-clin/add-advanceversion
Add advanceversion into special keys
2021-03-11 11:43:53 -08:00
Russell Sears
d17702e7c4
Merge pull request from sfc-gh-ajbeamon/mvc-dont-copy-with-single-thread
Multi-version client: don't copy external libraries if we aren't using multiple threads
2021-03-11 11:16:54 -08:00
Vishesh Yadav
d7252da951 clang-format: Fix the TEST() macros which require comments in line 2021-03-10 16:50:53 -08:00
Vishesh Yadav
2cd3f45fd6 Merge remote-tracking branch 'apple/release-6.3' into master-format-final
release-6.3 was recently merged, and there were two PRs which were
merged in between and got those changes in here. Hence, since all the
changes were in, discarded the incoming changes and accepted all
current.
2021-03-10 16:50:44 -08:00
A.J. Beamon
fe4ff420a3 Don't copy the external libraries if you aren't using more than one thread 2021-03-10 15:09:30 -08:00
Markus Pilman
cfbaaa6001 Merge remote-tracking branch 'origin/release-6.2' into release-6.3 2021-03-10 14:30:47 -07:00
Vishesh Yadav
af36e52fdf Merge branch 'release-6.3-pre-format' into master-format
This merges release-6.3 branch right before it was fully formatted.
There were quite a few conflicts that are resolved here. CoroFlow had
a check for OOM errors introduced in 6.3, but didn't seem applicable in
the new implmentation which seems to use boost.
2021-03-10 10:40:53 -08:00
FDB Formatster
df90cc89de apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-10 10:18:07 -08:00
Vishesh Yadav
2bb4f2e59f Merge branch 'release-6.3-pre-format' into master-format
This merges release-6.3 branch right before it was fully formatted.
There were quite a few conflicts that are resolved here. CoroFlow had
a check for OOM errors introduced in 6.3, but didn't seem applicable in
the new implmentation which seems to use boost.
2021-03-10 09:37:41 -08:00
Steve Atherton
e9c9bd5299 Merge commit 'e2d3ddee2cb4da0bba65346d29ad2212fbce16f0' into file-backup-async-rename
# Conflicts:
#	fdbclient/BackupContainer.actor.cpp
#	fdbclient/FileBackupAgent.actor.cpp
#	fdbclient/Knobs.cpp
#	fdbrpc/AsyncFileNonDurable.actor.h
#	fdbrpc/sim2.actor.cpp
2021-03-08 02:00:40 -08:00
Steve Atherton
318b862aa3 Apply clang-format to backup changes. 2021-03-08 01:49:29 -08:00
Steve Atherton
a397d8625f AsyncFileNonDurable now has a flag for whether or not to emulate AIO mode, so the previous behavior limits are preserved when this flag is set. AsyncFileDurable writes which are selected to be durable are again done in a single write, and the logic to handle non-aligned writes for non-AIO mode is more clear and commented. In simulation, backup files on local filesystems are written with random buffer sizes. Backup container unit test now uses more random file sizes and limits memory consumption for all files being written in parallel. 2021-03-07 22:21:10 -08:00
Steve Atherton
8a4aca3f47 Bug fix: In simulation only, RangeFileWriter was not waiting on a write future in one location. 2021-03-07 22:19:04 -08:00
Steve Atherton
1d00c41385 Bug fixes: Avoid empty writes, avoid 0 length truncation, and make AsyncFileNonDurable support writes at arbitrary offsets and lengths. Increase randomness of IBackupFile appends in backup container unit test. 2021-03-05 17:45:36 -08:00
FDB Formatster
8a8c488ede apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-05 18:13:38 -06:00
FDB Formatster
0c214d71da apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-05 16:31:35 -06:00
Steve Atherton
1025a0da37 File-based backup now uses async rename to prevent blocking the network thread in the event of slow filesystem metadata operations. Backup now opens its write-only files without a block cache so that writes to disk will be larger (1MB by default instead of 4k). 2021-03-03 21:45:33 -08:00
Andrew Noyes
79cec09255 Apply clang-tidy's performance-inefficient-vector-operation fix
I ran this command in my build directory after compiling with
OPEN_FOR_IDE. It took a few small tweaks to get it to compile, which is
outside the scope of this commit.

    $ python run-clang-tidy.py -j $(nproc) -checks='-*,performance-inefficient-vector-operation' -fix
2021-03-04 03:58:25 +00:00
Markus Pilman
37d9e975e9 Fix multiple compiler warnings 2021-03-03 10:18:03 -07:00
Evan Tschannen
346a4e3ecd Merge branch 'release-6.3'
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
#	fdbrpc/LoadBalance.actor.h
#	fdbrpc/MultiInterface.h
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/masterserver.actor.cpp
2021-03-01 18:52:06 -08:00
Hari Bhaskaran
25069a9444 Fix compile error: Related to pr 3961 2021-02-27 17:10:21 -08:00
Chaoguang Lin
5b4e77bb99 Update comments, add asssertions 2021-02-25 13:13:34 -08:00
Chaoguang Lin
424aae71cc Solve comments. Disable clear for ClientProfilingImpl and set the upperbound value for advanceversion 2021-02-25 13:02:56 -08:00
Vishesh Yadav
d8932f142a
Merge pull request from sears/multithreaded-pr-comments
Multithreaded pr comments
2021-02-23 15:09:52 -07:00
Vishesh Yadav
1ee9c3e45d
Apply suggestions from code review
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2021-02-22 20:18:01 -07:00
Jingyu Zhou
d2440b5986
Merge pull request from xumengpanda/mengxu/ha-code
Add comments to explain loadBalance algorithm
2021-02-22 18:24:06 -08:00
negoyal
e9b7e22e02 Merge branch 'rel-6.3' 2021-02-22 08:47:22 -08:00
negoyal
e49cc68bbc Merge branch 'rel-6.2' into rel-6.3 2021-02-21 00:15:31 -08:00
Meng Xu
ef0bf2728e Merge branch 'release-6.3' into mengxu/ha-code
Resolve Conflicts:
	fdbserver/LogRouter.actor.cpp: Only conflicts at comments
2021-02-19 21:47:09 -08:00
Chaoguang Lin
9ce9cba0e5 Merge branch 'master' of github.com:apple/foundationdb into add-advanceversion 2021-02-19 14:29:08 -08:00
Chaoguang Lin
703107332a Add special keys for profile client get/set 2021-02-19 12:22:00 -08:00
Andrew Noyes
9fb396e372
Merge pull request from sfc-gh-clin/add-coordinators-into-special-keys
Add coordinators into special keys
2021-02-18 18:26:07 -08:00
Nim Wijetunga
fa3834f115 fix bug 2021-02-18 18:23:28 -05:00
Chaoguang Lin
70098b752a Fix typo, solve comments 2021-02-18 14:23:51 -08:00
A.J. Beamon
af77fae131 Fix bug in code I recently added where the process name memory was not long-lived and was later used. 2021-02-18 18:33:23 +00:00
Chaoguang Lin
ac860b3c22 Add advanceversion into special keys 2021-02-18 01:27:14 -08:00
Hao Fu
971b1aa1e6 Add txnRejectedForQueuedTooLong in ProxyStats
Added transactions.rejected_for_queued_too_long for bookkeeping the
number of transactions rejected by commit proxy because its queuing
time exceeds MVCC window.
2021-02-17 21:40:46 -08:00
Russell Sears
5324f127c9 Address skipped PR comments from multithreaded client PR 2021-02-17 21:10:42 +00:00
Andrew Noyes
c075415a51
Merge pull request from sfc-gh-ljoswiak/fixes/remove-async-tracer
Remove async tracer
2021-02-17 09:43:24 -08:00
Chaoguang Lin
f3a849de10 Update ChangeConfig test for auto coordinators change 2021-02-16 23:55:58 -08:00
Lukas Joswiak
30d2d9ff82 Remove async tracer 2021-02-16 16:36:33 -08:00
Andrew Noyes
bcd9a00a50 Backport and 1513df22f3 to release-6.2
Fixes 
2021-02-17 00:35:25 +00:00
Chaoguang Lin
fca7f753f8 Remove special key for coordinators' 'auto' option 2021-02-16 13:46:45 -08:00
Vishesh Yadav
ab1c51618a
Merge pull request from sears/multithreaded_client
Multithreaded client
2021-02-16 13:11:14 -08:00
Chaoguang Lin
9dd94499f2 Update traces 2021-02-16 13:06:25 -08:00
Chaoguang Lin
731ee8a121 Update ChangeConfig to test coordinators special keys 2021-02-16 13:01:37 -08:00