20891 Commits

Author SHA1 Message Date
He Liu
61d621a4c4
Fix read iterator pool race (#7455) 2022-06-27 14:51:26 -07:00
Lukas Joswiak
d9b0ff418f Ignore format commits in git blame 2022-06-27 17:32:43 -04:00
A.J. Beamon
309f244f78
Merge pull request #7449 from sfc-gh-ajbeamon/get_tenant_json
Add support for getting tenant metadata as a JSON document
2022-06-27 14:21:06 -07:00
Xiaoxi Wang
ab2a6bda99
Merge pull request #7451 from sfc-gh-xwang/feature/ddtxn
[Data Distribution Testability] move getServerListAndProcessClasses to NativeAPI
2022-06-27 14:06:23 -07:00
Lukas Joswiak
c451d47a7e Initialize uninitialized field 2022-06-27 17:05:19 -04:00
Jingyu Zhou
a7e71cbac2 Add 7.1.10, 7.1.11 release notes 2022-06-27 15:52:03 -04:00
neethuhaneesha
593a4d614c
Merge pull request #7453 from neethuhaneesha/addUID
Adding logId to traceevents.
2022-06-27 12:49:14 -07:00
A.J. Beamon
7dee9fb4fd Add a test for the new JSON output 2022-06-27 12:34:40 -07:00
A.J. Beamon
f990fba44d Add support for getting tenant metadata as a JSON document. 2022-06-27 12:34:40 -07:00
Xiaoxi Wang
62d4ac550a Merge branch 'main' of https://github.com/apple/foundationdb into feature/ddtxn 2022-06-27 11:35:22 -07:00
neethuhaneesha
d80506fd21 Adding logId to trace events. 2022-06-27 10:41:05 -07:00
Mohamed Oulmahdi
542adb4b9f
Merge pull request #7460 from Doxense/7447_fix_windows_build
Add missing dependencies for fdbservice
2022-06-27 17:24:09 +02:00
Mohamed Oulmahdi
0b994341e9 Add missing dependencies for fdbservice 2022-06-27 12:07:50 +02:00
Markus Pilman
e35633149c
Merge pull request #7447 from sfc-gh-mpilman/bugfixes/cmake-disallow-illegal-cross-module-includes
enforce include modularization in cmake
2022-06-24 22:42:18 -06:00
Markus Pilman
00759feb14 windows fix 2022-06-24 16:12:45 -06:00
Markus Pilman
3a8ed3673c Trigger Build 2022-06-24 09:38:54 -06:00
Markus Pilman
a47ed89018 Linux fixes and addressed review comments 2022-06-23 20:52:13 -06:00
Markus Pilman
38e100ebc5 flow bindings are compiling 2022-06-23 19:06:05 -06:00
Markus Pilman
de48e90276 fdbserver is now compiling 2022-06-23 18:45:26 -06:00
Markus Pilman
8af056e7b0 fdbclient now compiling 2022-06-23 18:05:36 -06:00
Markus Pilman
9d80ee0cb6 fdbrpc is compiling 2022-06-23 17:15:49 -06:00
Markus Pilman
ffaf15c12a moved wellknownendpoints and fixed some includes 2022-06-23 17:03:53 -06:00
Markus Pilman
10e478dfc3 Flow is compiling 2022-06-23 16:35:19 -06:00
Xiaoxi Wang
a5054b2beb move getServerListAndProcessClasses to NativeAPI 2022-06-23 15:28:45 -07:00
Markus Pilman
d35445a868 enforce include modularization in cmake 2022-06-23 14:37:35 -06:00
Zhe Wu
3cb587edfb Remove explicit degraded peer recovery since this may be false positive 2022-06-23 09:38:27 -07:00
A.J. Beamon
c2752dc773
Merge pull request #7437 from sfc-gh-ajbeamon/copyto-fix
Add check to avoid using memcpy with an invalid data pointer
2022-06-23 08:58:24 -07:00
Vaidas Gasiunas
e28a8401fb
Update coordinator list from cluster file (#7382)
* Log failed connection attempts in monitorProxies

* Update coordinator list from the cluster file after failing to connect to all coordinators

* Wiggle and upgrade test with legacy version monitoring; updating tests to use 7.1.9

* Update coordinator list from the cluster file: addressing review comments

* Update coordinator list from the cluster file: addressing review comments

* Wait on future for all setAndPersistConnectionString calls
2022-06-23 09:22:09 +02:00
A.J. Beamon
485df52b0f Add check to avoid using memcpy with an invalid data pointer 2022-06-22 15:57:47 -07:00
Lukas Joswiak
75423a100c Move shared_ptr to save a reference increment and decrement 2022-06-22 14:50:17 -07:00
Lukas Joswiak
4f2b1807e4 Use shared_ptr to track initialization across threads 2022-06-22 14:50:17 -07:00
Lukas Joswiak
1b1a9d4df5 Initialize on main thread 2022-06-22 14:50:17 -07:00
Lukas Joswiak
88557d9169 Simplify function call when transaction is null 2022-06-22 14:50:17 -07:00
Lukas Joswiak
b80ed948f1 Check initialization status before accessing field 2022-06-22 14:50:17 -07:00
Lukas Joswiak
4c2bb0b44e Fix undefined behavior from accessing field of uninitialized object 2022-06-22 14:50:17 -07:00
Johannes Scheuermann
7bff4af14a
Initial support for Prometheus endpoint and pprof for debugging (#7359)
* Initial support for Prometheus endpoint and pprof for debugging
2022-06-22 08:07:48 +01:00
Ata E Husain Bohra
e1ca0ef9a2
Defer recoveredDiskFiles wait if Encryption data at-rest is enabled (#7414)
* Defer recoveredDiskFiles wait if Encryption data at-rest is enabled

Description

In the current code ClusterController startup wait for 'recoveredDiskFiles'
future to complete before triggered 'clusterControllerCore' actor, which
inturn starts 'EncryptKeyProxy' (EKP) actor resposible to fetch/refresh
encryption keys needed for ClusterRecovery as well interactions with
KMS.

Patch addresses a circular dependency where StorageServer initialization
depends on EKP, but, CC doesn't recruit EKP till 'recoveredDiskFiles' completes
which includes SS initialization. Given 'recoveredDiskFiles' is an optimization,
the patch proposes deferring the 'recoveredDiskFiles' future completion until
new Master recruitment is done as part of ClusterRecovery (unblock EKP singleton)

Testing

Ran 500K correctness runs: 20220618-055310-ahusain-foundationdb-61c431d467557551
Recorded failures doesn't seems to be related to the change.
2022-06-21 18:18:57 -07:00
Bharadwaj V.R
8cf2be030f
Build a TenantCache for use by DD (#7207)
* Add an DD tenant-cache-assembly actor
* Add basic tenant list monitoring for tenant cache. 
* Update DD tenant cache refresh to be more efficient and unit-testable
* Remove the DD prefix in the tenant cache class name (and associated impl and UT class names); there is nothing specific to DD in it; DD uses it; other modules may use it in the future
* Disable DD tenant awareness by default
2022-06-21 16:29:30 -07:00
Lukas Joswiak
9ca8a3c683 Reenable status json for dynamic knobs, add unit test 2022-06-21 11:43:05 -07:00
Johannes Scheuermann
4b0c4a32b0
Add testing for Kubernetes sidecar (#7105)
* Refactor python sidecar and add unit tests

* Fix issue trying to send error response multiple times

* Fix imports and TLS handling

* Correct config variable in ssl reload
2022-06-21 19:39:53 +01:00
Johannes M. Scheuermann
8da4bb9d07 Add openssl for debugging in container image 2022-06-21 12:14:06 -05:00
Dan Lambright
c48d569024
fix a fault injection bug in txn store recovery (#7405)
* fix a fault injection bug in txn store recovery

* Update LogSystemDiskQueueAdapter.actor.cpp

typo

* recoverLoc can be overwritten, so on reset use the stored range start
2022-06-21 12:33:58 -04:00
Josh Slocum
34e6a8f942
Merge pull request #7399 from sfc-gh-jslocum/bg_tenant_improvements
Bg tenant improvements
2022-06-17 11:19:41 -05:00
Markus Pilman
5aacaf891c
Merge pull request #7321 from sfc-gh-ajbeamon/multiple-tenant-creation
Support creating multiple tenants in the same transaction
2022-06-17 10:10:09 -06:00
Josh Slocum
1cc466e068 fixes and review comments 2022-06-17 08:17:44 -05:00
Trevor Clinkenbeard
b7e4d5440d
Merge pull request #7369 from sfc-gh-tclinkenbeard/fix-unused-var
Fix `-Wunused-but-set-variable` warning in `DDSketchBase::percentile`
2022-06-16 23:42:11 -07:00
sfc-gh-tclinkenbeard
111e28d0ea Merge remote-tracking branch 'origin/main' into fix-unused-var 2022-06-16 17:20:18 -07:00
Xiaoxi Wang
6bb4e341f9
Merge pull request #7110 from sfc-gh-xwang/features/ppw-pause-state
Adding paused/running wiggling status to status json and also the last running/paused timestamp
2022-06-16 14:27:18 -07:00
Xiaoxi Wang
a311cc28cc solve some comments 2022-06-16 11:07:21 -07:00
Josh Slocum
b3597ef3a8 Added plumbing for tenant-aware purge granules 2022-06-16 13:04:34 -05:00