15933 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard
27e44c1bb9 Add support for encryption testing in BackupCorrectness workload 2021-06-26 11:15:12 -07:00
sfc-gh-tclinkenbeard
c5b612510d Added invalid_encryption_key_file error 2021-06-26 11:14:23 -07:00
sfc-gh-tclinkenbeard
3d6515bd14 Support encryption for blob store backups (not yet tested) 2021-06-26 00:07:27 -07:00
sfc-gh-tclinkenbeard
d88f8f7653 Make BackupContainer.actor.cpp less verbose 2021-06-25 22:53:19 -07:00
sfc-gh-tclinkenbeard
1afae7623b Added /backup/containers/localdir/encrypted unit test 2021-06-25 22:33:26 -07:00
sfc-gh-tclinkenbeard
f5aa3df917 Add --encryption_key_file command line argument to fdbbackup and fdbrestore 2021-06-25 15:11:03 -07:00
sfc-gh-tclinkenbeard
53f5cd2453 Support passing encryption file to BackupContainer::openContainer 2021-06-25 14:11:21 -07:00
sfc-gh-tclinkenbeard
5858ca3c62 Use unit test data directory for fdbrpc/AsyncFileEncrypted test 2021-06-25 12:23:08 -07:00
sfc-gh-tclinkenbeard
81b8292094 Merge remote-tracking branch 'origin' into encrypt-backup-files 2021-06-25 12:21:12 -07:00
Daniel Smith
f82cf46124
Merge pull request #5065 from Daniel-B-Smith/iknob-leak
Fix leak due to missing virtual destructor
2021-06-25 10:38:28 -04:00
Lukas Joswiak
026aad6f12
Merge pull request #5060 from sfc-gh-ljoswiak/docs/special-keys-global-config-tracing
Add documentation for global configuration and tracing special key space modules
2021-06-24 14:05:49 -07:00
Lukas Joswiak
9ae6fc28fc Update documentation/sphinx/source/global-configuration.rst
Co-authored-by: Chaoguang Lin <chaoguang.lin@snowflake.com>
2021-06-24 13:50:28 -07:00
Jingyu Zhou
4b56cf26be
Merge pull request #5064 from jzhou77/remove-orderer
Remove fdbserver/Orderer.actor.h
2021-06-24 13:27:59 -07:00
Daniel Smith
4cfa84cb77 Fix leak due to missing virtual destructor 2021-06-24 15:43:53 -04:00
Jingyu Zhou
9b8c4a2ffc Remove fdbserver/Orderer.actor.h
Apparently this is no longer used for many years.

Fix Conflicts:
	fdbserver/CMakeLists.txt
2021-06-24 11:23:37 -07:00
Trevor Clinkenbeard
b2a8811816
Merge pull request #5049 from sfc-gh-etschannen/feature-ref-count-parallel-stream
Fixed a destruction order bug with parallel stream
2021-06-24 10:25:02 -07:00
Xiaoge Su
048eee55a5
Merge pull request #5061 from xis19/master
Add static_assert to serializeBinaryItem
2021-06-23 22:13:18 -07:00
Xiaoge Su
5089459bd2 Add static_assert to *Writer::serializeBinaryItem
BinaryWriter::serializeBinaryItem will accept *any* objects and
serialize them by memory copy. If the object is a struct, padding bytes
will also be copied, which is not expected (at this stage, the
serializer will NOT include any padding). If padding exists, the caller
is required to use _Reader::serializeBinaryItem when reading.

Due to this inconsistency, it is helpful to restrict
serializedBinaryItem calls to limited types. Base on the current
implementation, one reasonable approach is allowing only those types
are BINARY_SERIALIZABLE. This patch addresses such restriction.

The restriction is also applied to other classes:

 * OverWriter
 * _Reader
 * PacketWriter
2021-06-23 18:45:51 -07:00
Lukas Joswiak
ce64c5079f Add documentation for special key space modules 2021-06-23 16:57:34 -07:00
sfc-gh-ngoyal
c071074f98
Merge pull request #5056 from sfc-gh-xwang/master
Cherry-pick “Add document for perpetual storage wiggle (#5043)“
2021-06-23 12:14:44 -07:00
Meng Xu
108b77d1a0
Merge pull request #5044 from RenxuanW/proxy-metrics
Add a few ProxyStats fields.
2021-06-23 12:14:12 -07:00
Daniel Smith
02e6c634b4
Merge pull request #5055 from Daniel-B-Smith/tsan-wrangling
Properly enable santizers in RocksDB build
2021-06-23 15:11:47 -04:00
Xiaoxi Wang
48ff893266 Merge branch 'master' of https://github.com/apple/foundationdb 2021-06-23 18:47:24 +00:00
Xiaoxi Wang
099713116d Update documentation/sphinx/source/perpetual-storage-wiggle.rst
Co-authored-by: Josh Slocum <josh.slocum@snowflake.com>
2021-06-23 18:47:10 +00:00
Xiaoxi Wang
eb1372c667 Update perpetual-storage-wiggle.rst 2021-06-23 18:47:10 +00:00
Xiaoxi Wang
45e6ac8b3a Update command-line-interface.rst 2021-06-23 18:47:10 +00:00
Xiaoxi Wang
ea41c68fcb add documentation page 2021-06-23 18:47:10 +00:00
Xiaoxi Wang
fff5593e2f add documentation 2021-06-23 18:47:10 +00:00
Daniel Smith
1d38795a46 Properly enable santizers in RocksDB build 2021-06-23 13:58:36 -04:00
sfc-gh-ngoyal
790fedf8f8
Merge pull request #5053 from sfc-gh-jslocum/tss_release_notes_fix
Linked TSS release notes to documentation and largest PR instead of a…
2021-06-23 10:46:54 -07:00
Xiaoxi Wang
4e97cbc2d8
Merge pull request #5018 from sfc-gh-xwang/ppwiggle
Solve cluster status oscillation when ss is not enough for perpetual wiggle
2021-06-23 10:03:58 -07:00
Josh Slocum
9a9d42027e Linked TSS release notes to documentation and largest PR instead of all PRs 2021-06-23 09:44:01 -05:00
Xiaoxi Wang
7b713f7fd2 add knob 2021-06-23 05:49:55 +00:00
Xiaoxi Wang
3602ec80fb Merge branch 'master' of https://github.com/apple/foundationdb into ppwiggle 2021-06-23 03:34:59 +00:00
Evan Tschannen
f6e7d84ed8 parallelStream holds a promiseStream of fragments, so we cannot make it reference counted without introducing a reference counting cycle 2021-06-22 17:45:54 -07:00
Evan Tschannen
afaa66ba47 fix: The destructor of a parallel stream fragment could be called after the parallel stream was destroyed, by making parallelStream reference counted that problem is avoided 2021-06-22 17:30:51 -07:00
Evan Tschannen
00469b7e2d
Merge pull request #5047 from apple/revert-4492-feature-sim-time-batching
Revert "Make the sim2 run loop match the behavior of the net2 run loop."
2021-06-22 15:37:06 -07:00
Evan Tschannen
fcb8bd6475
Revert "Make the sim2 run loop match the behavior of the net2 run loop." 2021-06-22 14:50:01 -07:00
Renxuan Wang
00599069d2 Add a few ProxyStats fields.
1. Add the count of # of getRateInfo() and # of leaseTimeout;
2. Add SystemGRVQueueSize, DefaultGRVQueueSize and BatchGRVQueueSize.
2021-06-22 11:45:58 -07:00
Evan Tschannen
c6a9c0a9c2
Merge pull request #4492 from sfc-gh-etschannen/feature-sim-time-batching
Make the sim2 run loop match the behavior of the net2 run loop.
2021-06-22 09:46:23 -07:00
Evan Tschannen
2ae4f51d19 added a comment 2021-06-22 09:42:00 -07:00
Evan Tschannen
154332a94b Merge branch 'master' of https://github.com/apple/foundationdb into feature-sim-time-batching
# Conflicts:
#	fdbserver/VersionedBTree.actor.cpp
2021-06-22 09:37:40 -07:00
Evan Tschannen
c1271b555c
Merge pull request #5017 from sfc-gh-etschannen/feature-streaming-reply-master
Add a streaming reply method to flow to speed up range reads
2021-06-21 21:16:19 -07:00
Trevor Clinkenbeard
eaa868291c
Merge pull request #5030 from sfc-gh-satherton/flowmutex-test-fix
FlowMutex unit test bug and macOS compilation fix
2021-06-21 20:46:03 -07:00
Steve Atherton
7799d872f2 Fixed compile error on macOS clang. 2021-06-21 20:19:36 -07:00
Chaoguang Lin
11c491e1a2
Merge pull request #5037 from sfc-gh-clin/update-special-keys-documentation
Create a separate documentation page for special keys under the api reference page
2021-06-21 18:16:05 -07:00
Evan Tschannen
244e8f3527 Merge branch 'master' of https://github.com/apple/foundationdb into feature-streaming-reply-master
# Conflicts:
#	fdbclient/CMakeLists.txt
#	fdbclient/Knobs.h
#	fdbserver/Knobs.h
2021-06-21 16:35:21 -07:00
Chaoguang Lin
002d8604d6 Create a separate documentation page for special keys under api references 2021-06-21 22:11:34 +00:00
Markus Pilman
c47644f055
Merge pull request #5012 from sfc-gh-jfu/jfu-configure-sim-cluster
Modularize generateNormalConfig code to improve readability
2021-06-21 15:02:57 -06:00
Steve Atherton
765d94c6b3 Test fails with buggify on sometimes because of injected delays in run loop, so test now waits for each future to become ready regardless of delay. 2021-06-21 11:34:57 -07:00