21640 Commits

Author SHA1 Message Date
A.J. Beamon
41af66bd4e Add a tenant consistency check and use it in the various tenant workloads 2022-08-03 13:33:45 -07:00
A.J. Beamon
8e777a6330 Detect and handle inverted ranges in the get cluster list test. Remove some unused code. 2022-08-03 09:09:36 -07:00
A.J. Beamon
daa7d3ae72 Remove unused variable 2022-08-02 05:50:58 -07:00
A.J. Beamon
1b693a588a Merge branch 'main' into feature-metacluster 2022-08-01 14:43:14 -07:00
A.J. Beamon
953bc4252d Add a metacluster consistency check class and use it in various tenant/metacluster workloads 2022-08-01 14:41:46 -07:00
A.J. Beamon
d9df813ce4 Fix a few metacluster accounting bugs 2022-08-01 14:34:21 -07:00
Renxuan Wang
51b92d59b9
Merge pull request #7733 from RenxuanW/hostname-backup
Prefer IPv6 in hostname resolving.
2022-08-01 12:34:02 -07:00
Renxuan Wang
4a0bea2230 Document for pickOneAddress(). 2022-08-01 10:54:04 -07:00
Markus Pilman
9caece6fc2
Merge pull request #7743 from sfc-gh-ajbeamon/fix-dummy-transaction
Fix: Transactions could change tenant ID part way through
2022-08-01 11:28:32 -06:00
Markus Pilman
204ef3a933
Merge pull request #7734 from sfc-gh-anoyes/anoyes/require-python3
Disallow python2 for cmake scripts
2022-07-31 22:18:56 -06:00
A.J. Beamon
41f519c300 Erase the cluster capacity index entry for a cluster when that cluster is removed 2022-07-30 20:32:43 -07:00
A.J. Beamon
ad52c575a8 Merge branch 'main' into feature-metacluster 2022-07-30 18:33:19 -07:00
A.J. Beamon
ea76eb2beb Transactions could change tenant ID part way through. The dummy transaction could set a new tenant ID but use the old tenant prefix. 2022-07-30 16:16:18 -07:00
A.J. Beamon
eeefb12f14
Merge pull request #7744 from sfc-gh-ajbeamon/fix-token-unit-test
Fix bug in token cache unit test where the expiration time was underflowing
2022-07-30 15:40:14 -07:00
A.J. Beamon
5a071e1b19 Fix bug in token cache unit test where the expiration time was underflowing. 2022-07-30 14:22:24 -07:00
A.J. Beamon
9ded40b6e1 The metacluster management test should disallow creating any tenants in general workload setup. 2022-07-30 13:09:30 -07:00
A.J. Beamon
fc92774b2b Fix: cleanup the metadata for a tenant creation that is permanently failed and is being replaced. 2022-07-30 11:08:11 -07:00
A.J. Beamon
8e50fe0cfc Fix a couple test bugs 2022-07-29 21:54:41 -07:00
Xiaoxi Wang
85f2200d6b
Merge pull request #7741 from sfc-gh-xwang/refactor/main/enableState
create ShardsAffectedByTeamFailure.h
2022-07-29 16:20:08 -07:00
A.J. Beamon
0d264f2731 Fix up a few things from review 2022-07-29 15:33:09 -07:00
Xiaoxi Wang
dd902fc772 create ShardsAffectedByTeamFailure.h 2022-07-29 15:12:15 -07:00
A.J. Beamon
296f17e3e5 Merge branch 'main' into feature-metacluster 2022-07-29 15:06:48 -07:00
Andrew Noyes
1558edce8c Python_EXECUTABLE to Python3_EXECUTABLE 2022-07-29 14:57:29 -07:00
Andrew Noyes
db348598a1 Update Python target name to Python3 2022-07-29 14:57:29 -07:00
Andrew Noyes
52e9990d32 Python_Interpreter_FOUND -> Python3_Interpreter_FOUND 2022-07-29 14:57:29 -07:00
Andrew Noyes
efc3045834 Disallow python2 for cmake scripts
The fdb c shim build requires python3. Let's not allow python2 to get
used there.

Otherwise we can see something like this:
```
FAILED: bindings/c/libfdb_c.so.init.c bindings/c/libfdb_c.so.tramp.S
cd /home/anoyes/workspace/foundationdb/build/bindings/c && /usr/bin/python2.7 /home/anoyes/workspace/foundationdb/contrib/Implib.so/implib-gen.py --target aarch64 --outdir /home/anoyes/workspace/foundationdb/build/bindings/c --dlopen-callback=fdb_shim_dlopen_callback /home/anoyes/workspace/foundationdb/build/lib/libfdb_c.so
  File "/home/anoyes/workspace/foundationdb/contrib/Implib.so/implib-gen.py", line 27
    sys.stderr.write(f'{me}: warning: {msg}\n')
```
2022-07-29 14:57:29 -07:00
Markus Pilman
50fd0f11dd
Merge pull request #7738 from sfc-gh-mpilman/bugfixes/investigate-token-cache-segfaults
fix token cache unit test
2022-07-29 13:55:51 -06:00
A.J. Beamon
a69164d160 Merge branch 'main' into feature-metacluster 2022-07-29 11:53:06 -07:00
Markus Pilman
b600966cf9 fix token cache unit test 2022-07-29 12:47:55 -06:00
Nim Wijetunga
3e45b6657c
Merge pull request #7714 from sfc-gh-nwijetunga/nim/tenant-encryption-property
Encryption as a tenant property
2022-07-29 11:30:19 -07:00
Xiaoxi Wang
c21aa193e6
Merge pull request #7736 from sfc-gh-xwang/refactor/main/teamrequest
[Read-aware DD] remove duplicate code in BgDDLoadRebalance
2022-07-29 11:24:52 -07:00
A.J. Beamon
2eabfe2597 Commit some changes that got left off in the last commit 2022-07-29 11:18:21 -07:00
Xiaoxi Wang
f0caaad93c
Update fdbserver/DataDistributionQueue.actor.cpp 2022-07-29 10:22:21 -07:00
Xiaoxi Wang
e3cf40002d format code 2022-07-29 10:11:10 -07:00
Xiaoxi Wang
d8323820f1 remove duplicate code 2022-07-29 10:04:14 -07:00
A.J. Beamon
8b7b6d1d4c Various cleanup; change some test parameters; add a test for metacluster management operations 2022-07-29 09:24:06 -07:00
Josh Slocum
cfc13e7018
Adding more blobrange cli commands and a couple other tweaks (#7727) 2022-07-29 08:20:45 -07:00
A.J. Beamon
88d9ef771f Fix a couple bugs 2022-07-29 08:12:15 -07:00
Vaidas Gasiunas
d99d0370b1
C shim library: API for setting client library path; additional tests (#7702)
* Adding sources of the Implib.so project

* Run C unit tests and API tests with the shim library

* Reuse compilation of C test binaries with and without shim library

* Resolve client library path from an environment variable

* Refactoring: Reusable module for downloading FDB binaries

* Testing client shim library with current version and last release version

* Tests for specifying client library over an environment variable

* Enable C shim library tests on ARM

* Restore the original path for including fdb_api.hpp

* Improve cmake dependencies on doctest

* Remove unnecessary Implib.so files

* Shim library: API to specify path to the library, additional tests

* Adding shim library to Linux distribution packages

* Update link dependencies of fdb_c_shim_lib_tester

* Add dependencies on Implib.so sources

* Abort on fatal errors of shim library

* fix typo
2022-07-29 11:45:45 +02:00
A.J. Beamon
e5bf838c83 Fix metacluster register command hints, fix bug in cluster registration on retries, extend the length of the tenant management concurrency test 2022-07-28 21:02:12 -07:00
Renxuan Wang
316ea60232 Prefer IPv6 in hostname resolving. 2022-07-28 20:07:16 -07:00
Hao Fu
62bee7ac9a
Add g_traceBatch for prefetch query (#7730) 2022-07-28 17:54:31 -07:00
Trevor Clinkenbeard
8491c2530f
Merge pull request #7416 from sfc-gh-ljoswiak/fixes/change-coordinators-commit-unknown-result
Ensure change coordinators request came from the same generation proxy
2022-07-28 17:29:24 -07:00
A.J. Beamon
e8e4f3ad3a Merge branch 'main' into feature-metacluster
# Conflicts:
#	fdbclient/include/fdbclient/Tenant.h
2022-07-28 16:53:29 -07:00
A.J. Beamon
5db1135ac6 Add MetaclusterOperationContext to make it easier to run multi-transaction operations 2022-07-28 16:44:20 -07:00
Dan Lambright
83d23512d2
Track when version not found in version vector. (#7653)
* Track when version not found in version vector.

* Respond to comments

* include vv in event

* Respond to review comments.

* Fix bug where we logged too many lines
2022-07-28 18:26:15 -04:00
A.J. Beamon
cd19f2cdc2 Add metacluster awareness of the tenant count limit 2022-07-28 15:03:38 -07:00
He Liu
35a4cb91d5
Disable ShardedRocksDB in simulation when shard_encode_location_metadata is disabled (#7726)
* Disabled tests for ShardedRocks.

Cleaned up ShardedRocks TraceEvent.

Added assertion in ShardManager::validate().

* Added test trace.

* Make sure TraceEvent contains `ShardedRocks`.

* Exclude ShardedRocksDB when SHARD_ENCODE_LOCATION_METADATA is disabled.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-28 13:54:29 -07:00
A.J. Beamon
620467a91b Fix some formatting issues 2022-07-28 13:42:34 -07:00
A.J. Beamon
65cfc839a6 Some various cleanup 2022-07-28 13:35:24 -07:00