21642 Commits

Author SHA1 Message Date
Zhe Wu
5441eb4610 Add CommitDebug event after Commit Proxy reporting committed version to master 2022-07-21 21:29:53 -07:00
A.J. Beamon
5e9097a2e5 Fix merge failure 2022-07-21 20:57:07 -07:00
A.J. Beamon
5f605d07d3 Merge branch 'tenant-metadata-key-backed-types' into feature-metacluster 2022-07-21 20:54:28 -07:00
A.J. Beamon
17146c484b Use key-backed types for tenants. Add a tenant state field that will be used in upcoming work. Some other tenant related refactoring. 2022-07-21 20:33:28 -07:00
Xiaoge Su
32b4968835 Add TraceEvent to the construction/destruction of DatabaseContext
This is to figure out why huge databaseLogger related TraceEvents
generated after 7.1 released.
2022-07-21 19:38:59 -07:00
A.J. Beamon
c8f3a4c62f Update tenant special keys to track changes to the tenant group index and apply the net result to the tenant group map. Fix a minor bug in the tenant management workload. 2022-07-21 19:36:53 -07:00
A.J. Beamon
338d4fe380 Move the tenant group map to the tenant metadata space and improve support for configuring tenant groups. 2022-07-21 15:10:43 -07:00
A.J. Beamon
3e1763e7ac Merge branch 'main' into feature-metacluster 2022-07-21 14:48:53 -07:00
Andrew Noyes
89141d4b3a
Validate subrange reads in simulation (#7597)
* Add extra validation to special key space reads in simulation

* Fix bugs turned up by validating subrange reads

* Change to validateSpecialSubrangeRead

It is in general not safe to expect that a read from the special key
space returns the same results if performed again, since the
transaction may be being modified concurrently.

* Add comment

* Add comment
2022-07-21 14:42:08 -07:00
He Liu
257bab7311
Allow read range on null shard (#7654)
* Fixed ShardedRocks unit test.

* Removed `UNIT` from noSim/ShardedRocksDBTest.toml.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-21 13:59:49 -07:00
Zhe Wu
bd99f4fa3b Log tlog initialization 2022-07-21 13:54:44 -07:00
Andrew Noyes
45c8a4e09d
Build fixes/improvements for sanitizers (#7657)
* Don't build fdb c shim with ubsan

This avoids duplicate symbols when linking. It doesn't really make sense
to assemble files with -fsanitize=undefined anyway, since it won't
insert instrumentation.

* Consolidate boost_asan with boost_target
2022-07-21 12:43:38 -07:00
Trevor Clinkenbeard
9d63a859b0
Merge pull request #7443 from sfc-gh-xwang/readaware
[Read-aware DD] Use KeyRangeStorageMetrics instead of StorageMetrics
2022-07-21 12:37:51 -07:00
Josh Slocum
80f4c059f1 Added full granule read unit test 2022-07-21 14:14:01 -05:00
Josh Slocum
d4a2f39743 Completed delta format unit test 2022-07-21 12:40:38 -05:00
Josh Slocum
6fc0d61146 delta file test and delta generation 2022-07-21 11:49:13 -05:00
Xiaoxi Wang
01569963da update comments 2022-07-21 09:26:20 -07:00
Xiaoxi Wang
7b8ea1d14f function naming using intention rather than implementation details 2022-07-21 09:19:05 -07:00
Josh Slocum
16e63578c3 Refactoring and adding to BlobGranuleFiles data generation 2022-07-21 09:47:11 -05:00
Josh Slocum
7101578d05 Cleanup 2022-07-21 08:19:05 -05:00
Junhyun Shim
908b8faa88 Fix unmatched signatures for BoringSSL 2022-07-21 15:17:34 +02:00
Josh Slocum
6a707e95ab removing incorrect check 2022-07-21 08:08:07 -05:00
Junhyun Shim
97880880cd Defer Simulation check in OSSL-IRandom binding until g_network is set 2022-07-21 14:52:02 +02:00
Junhyun Shim
868f070c79 Simplify RequestStream verify() condition for TenantInfo 2022-07-21 13:18:30 +02:00
Junhyun Shim
f76021fe7b Apply Clang format 2022-07-21 12:12:48 +02:00
Junhyun Shim
e6fe4a62b4 Ensure DeterministicRandom gets used by OpenSSL exclusively in Simulation 2022-07-21 12:11:33 +02:00
Junhyun Shim
d35c0f5a3c Make TokenCache cache complete token strings as keys 2022-07-21 11:39:36 +02:00
A.J. Beamon
410f27412b
Merge pull request #7620 from sfc-gh-ajbeamon/make-tuple
Add a Tuple::makeTuple function to easily construct a tuple
2022-07-20 17:09:10 -07:00
A.J. Beamon
190711ccd8
Merge pull request #7622 from sfc-gh-ajbeamon/eat-and-connection-string-changes
Add some helper functions to ClusterConnectionString and an improvement to StringRef.eat
2022-07-20 16:10:24 -07:00
Xiaoxi Wang
cd13356964 solve review comments 2022-07-20 16:09:38 -07:00
A.J. Beamon
fee131f24d
Merge pull request #7591 from sfc-gh-ajbeamon/key-backed-types-range-read-more
Add support for returning a more flag from key backed types' range reads
2022-07-20 15:57:50 -07:00
A.J. Beamon
51204163df Some minor changes from code review 2022-07-20 15:29:34 -07:00
A.J. Beamon
4d036ae339
Merge pull request #7626 from sfc-gh-ajbeamon/tenant-metadata-change
Some changes to the tenant metadata
2022-07-20 14:50:00 -07:00
Xiaoxi Wang
41032500d0 only do check after bootstraping test 2022-07-20 14:47:54 -07:00
Ata E Husain Bohra
9a3e88df46
Fix ASAN build (#7629)
* Fix ASAN build

Description
  -diff-2: Fix Mac build issues
  -diff-1: Address review comments

Patch addresses the issue where ASAN build failed after introducing
BlobGranule compression.

Testing

ASAN build
2022-07-20 14:14:46 -07:00
A.J. Beamon
37b7666262 Add a comment to name the fold expression syntax in makeTuple. This should make it easier to look up for those unfamiliar with the syntax. 2022-07-20 13:57:55 -07:00
Jon Fu
762c01d567 add error check for overlap 2022-07-20 13:43:13 -07:00
Zhe Wu
aa2740e21e Increase AllTags field length in TLogReady 2022-07-20 13:17:21 -07:00
A.J. Beamon
f6a47a18e9 Use a constexpr check for deserialization (from code review) 2022-07-20 13:01:36 -07:00
Josh Slocum
c066597af1
Merge pull request #7644 from sfc-gh-jslocum/granule_merging_converge
Granule merging converge
2022-07-20 15:00:19 -05:00
A.J. Beamon
978ca7fb6f Fix some merge related issues 2022-07-20 12:56:00 -07:00
Trevor Clinkenbeard
1020d5b1ad
Merge pull request #7641 from harikb/upstream-clean
Backups, Azure, Issue 7570: Check existance of container before creation attempt
2022-07-20 12:43:54 -07:00
Josh Slocum
2a0381f44d
Merge pull request #7603 from sfc-gh-ahusain/ahusain-fix-test
Fix snapshotFormatUnitTest infinite loop
2022-07-20 14:17:39 -05:00
Josh Slocum
8ccf18f35c cleanup 2022-07-20 12:52:21 -05:00
Josh Slocum
316b7a5344 Merge branch 'main' into granule_merging_converge 2022-07-20 12:13:48 -05:00
Josh Slocum
cc5ba89fcf
Merge pull request #7612 from sfc-gh-jslocum/granule_merging_batch
Granule merging batch
2022-07-20 11:59:55 -05:00
Jingyu Zhou
fc8cf679a0
Merge pull request #7638 from jzhou77/main
Fix ScopeEventFieldTypeMismatch error for TLogMetrics
2022-07-20 09:50:12 -07:00
Hari Bhaskaran
3aec508aec Issue 7570: Check existance of container before creation attempt 2022-07-20 09:40:49 -07:00
A.J. Beamon
279296c29f Merge branch 'tenant-metadata-change' into feature-metacluster
# Conflicts:
#	fdbclient/SystemData.cpp
#	fdbclient/Tenant.cpp
#	fdbclient/include/fdbclient/SystemData.h
#	fdbclient/include/fdbclient/Tenant.h
#	fdbclient/include/fdbclient/TenantManagement.actor.h
#	fdbserver/TenantCache.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	fdbserver/workloads/TenantManagementWorkload.actor.cpp
2022-07-20 09:18:27 -07:00
Josh Slocum
12ccd3b146 typo 2022-07-20 09:35:57 -05:00