20885 Commits

Author SHA1 Message Date
Markus Pilman
3448bc6f61 fix fdbmonitor 2022-06-27 19:11:24 -06:00
Markus Pilman
7040cb9688 fixed link errors 2022-06-27 19:00:40 -06:00
Markus Pilman
41181cda26 fdbserver compiling (but linking still fails) 2022-06-27 18:54:58 -06:00
Markus Pilman
d31fb30f57 fdbclient compiling 2022-06-27 18:31:05 -06:00
Markus Pilman
88af6b403f fdbrpc compiling 2022-06-27 18:11:55 -06:00
Markus Pilman
03d913a1de Flow compiling 2022-06-27 17:05:55 -06:00
Mohamed Oulmahdi
542adb4b9f
Merge pull request #7460 from Doxense/7447_fix_windows_build
Add missing dependencies for fdbservice
2022-06-27 17:24:09 +02:00
Mohamed Oulmahdi
0b994341e9 Add missing dependencies for fdbservice 2022-06-27 12:07:50 +02:00
Markus Pilman
e35633149c
Merge pull request #7447 from sfc-gh-mpilman/bugfixes/cmake-disallow-illegal-cross-module-includes
enforce include modularization in cmake
2022-06-24 22:42:18 -06:00
Markus Pilman
00759feb14 windows fix 2022-06-24 16:12:45 -06:00
Markus Pilman
3a8ed3673c Trigger Build 2022-06-24 09:38:54 -06:00
Markus Pilman
a47ed89018 Linux fixes and addressed review comments 2022-06-23 20:52:13 -06:00
Markus Pilman
38e100ebc5 flow bindings are compiling 2022-06-23 19:06:05 -06:00
Markus Pilman
de48e90276 fdbserver is now compiling 2022-06-23 18:45:26 -06:00
Markus Pilman
8af056e7b0 fdbclient now compiling 2022-06-23 18:05:36 -06:00
Markus Pilman
9d80ee0cb6 fdbrpc is compiling 2022-06-23 17:15:49 -06:00
Markus Pilman
ffaf15c12a moved wellknownendpoints and fixed some includes 2022-06-23 17:03:53 -06:00
Markus Pilman
10e478dfc3 Flow is compiling 2022-06-23 16:35:19 -06:00
Markus Pilman
d35445a868 enforce include modularization in cmake 2022-06-23 14:37:35 -06:00
Zhe Wu
3cb587edfb Remove explicit degraded peer recovery since this may be false positive 2022-06-23 09:38:27 -07:00
A.J. Beamon
c2752dc773
Merge pull request #7437 from sfc-gh-ajbeamon/copyto-fix
Add check to avoid using memcpy with an invalid data pointer
2022-06-23 08:58:24 -07:00
Vaidas Gasiunas
e28a8401fb
Update coordinator list from cluster file (#7382)
* Log failed connection attempts in monitorProxies

* Update coordinator list from the cluster file after failing to connect to all coordinators

* Wiggle and upgrade test with legacy version monitoring; updating tests to use 7.1.9

* Update coordinator list from the cluster file: addressing review comments

* Update coordinator list from the cluster file: addressing review comments

* Wait on future for all setAndPersistConnectionString calls
2022-06-23 09:22:09 +02:00
A.J. Beamon
485df52b0f Add check to avoid using memcpy with an invalid data pointer 2022-06-22 15:57:47 -07:00
Lukas Joswiak
75423a100c Move shared_ptr to save a reference increment and decrement 2022-06-22 14:50:17 -07:00
Lukas Joswiak
4f2b1807e4 Use shared_ptr to track initialization across threads 2022-06-22 14:50:17 -07:00
Lukas Joswiak
1b1a9d4df5 Initialize on main thread 2022-06-22 14:50:17 -07:00
Lukas Joswiak
88557d9169 Simplify function call when transaction is null 2022-06-22 14:50:17 -07:00
Lukas Joswiak
b80ed948f1 Check initialization status before accessing field 2022-06-22 14:50:17 -07:00
Lukas Joswiak
4c2bb0b44e Fix undefined behavior from accessing field of uninitialized object 2022-06-22 14:50:17 -07:00
Johannes Scheuermann
7bff4af14a
Initial support for Prometheus endpoint and pprof for debugging (#7359)
* Initial support for Prometheus endpoint and pprof for debugging
2022-06-22 08:07:48 +01:00
Ata E Husain Bohra
e1ca0ef9a2
Defer recoveredDiskFiles wait if Encryption data at-rest is enabled (#7414)
* Defer recoveredDiskFiles wait if Encryption data at-rest is enabled

Description

In the current code ClusterController startup wait for 'recoveredDiskFiles'
future to complete before triggered 'clusterControllerCore' actor, which
inturn starts 'EncryptKeyProxy' (EKP) actor resposible to fetch/refresh
encryption keys needed for ClusterRecovery as well interactions with
KMS.

Patch addresses a circular dependency where StorageServer initialization
depends on EKP, but, CC doesn't recruit EKP till 'recoveredDiskFiles' completes
which includes SS initialization. Given 'recoveredDiskFiles' is an optimization,
the patch proposes deferring the 'recoveredDiskFiles' future completion until
new Master recruitment is done as part of ClusterRecovery (unblock EKP singleton)

Testing

Ran 500K correctness runs: 20220618-055310-ahusain-foundationdb-61c431d467557551
Recorded failures doesn't seems to be related to the change.
2022-06-21 18:18:57 -07:00
Bharadwaj V.R
8cf2be030f
Build a TenantCache for use by DD (#7207)
* Add an DD tenant-cache-assembly actor
* Add basic tenant list monitoring for tenant cache. 
* Update DD tenant cache refresh to be more efficient and unit-testable
* Remove the DD prefix in the tenant cache class name (and associated impl and UT class names); there is nothing specific to DD in it; DD uses it; other modules may use it in the future
* Disable DD tenant awareness by default
2022-06-21 16:29:30 -07:00
Lukas Joswiak
9ca8a3c683 Reenable status json for dynamic knobs, add unit test 2022-06-21 11:43:05 -07:00
Johannes Scheuermann
4b0c4a32b0
Add testing for Kubernetes sidecar (#7105)
* Refactor python sidecar and add unit tests

* Fix issue trying to send error response multiple times

* Fix imports and TLS handling

* Correct config variable in ssl reload
2022-06-21 19:39:53 +01:00
Johannes M. Scheuermann
8da4bb9d07 Add openssl for debugging in container image 2022-06-21 12:14:06 -05:00
Dan Lambright
c48d569024
fix a fault injection bug in txn store recovery (#7405)
* fix a fault injection bug in txn store recovery

* Update LogSystemDiskQueueAdapter.actor.cpp

typo

* recoverLoc can be overwritten, so on reset use the stored range start
2022-06-21 12:33:58 -04:00
Josh Slocum
34e6a8f942
Merge pull request #7399 from sfc-gh-jslocum/bg_tenant_improvements
Bg tenant improvements
2022-06-17 11:19:41 -05:00
Markus Pilman
5aacaf891c
Merge pull request #7321 from sfc-gh-ajbeamon/multiple-tenant-creation
Support creating multiple tenants in the same transaction
2022-06-17 10:10:09 -06:00
Josh Slocum
1cc466e068 fixes and review comments 2022-06-17 08:17:44 -05:00
Trevor Clinkenbeard
b7e4d5440d
Merge pull request #7369 from sfc-gh-tclinkenbeard/fix-unused-var
Fix `-Wunused-but-set-variable` warning in `DDSketchBase::percentile`
2022-06-16 23:42:11 -07:00
sfc-gh-tclinkenbeard
111e28d0ea Merge remote-tracking branch 'origin/main' into fix-unused-var 2022-06-16 17:20:18 -07:00
Xiaoxi Wang
6bb4e341f9
Merge pull request #7110 from sfc-gh-xwang/features/ppw-pause-state
Adding paused/running wiggling status to status json and also the last running/paused timestamp
2022-06-16 14:27:18 -07:00
Xiaoxi Wang
a311cc28cc solve some comments 2022-06-16 11:07:21 -07:00
Josh Slocum
b3597ef3a8 Added plumbing for tenant-aware purge granules 2022-06-16 13:04:34 -05:00
Jon Fu
b891b424ea
Merge pull request #7387 from sfc-gh-jfu/jfu-mako-tenant-rows
When provided tenants in mako, divide number of rows by number of tenants.
2022-06-16 12:55:44 -04:00
Andrew Noyes
83aceb216c
Use absl::GetStackTrace for slow task profiler (#7374)
* Make SlowTask workload runnable in joshua

* Remove SignalSafeUnwind, and use absl::GetStackTrace for slow task profiler
2022-06-15 14:53:52 -07:00
Andrew Noyes
0fea3fb731
Save a bunch of copies in the trace thread (#7392)
Currently, a std::string is copied unnecessarily for every key and value
in a trace event.

This actually showed up in a jemalloc heap profile while I was
investigating something unrelated. I was surprised to see it since these
allocations should have a very short lifetime.
2022-06-15 12:29:15 -07:00
Jon Fu
a96928be2d Merge branch 'main' of github.com:apple/foundationdb into jfu-mako-tenant-rows 2022-06-15 12:15:23 -07:00
Johannes Scheuermann
c9b4ff3302
Add support for lumberjack in logging and update example to 7.1 (#7357) 2022-06-15 19:41:01 +01:00
Jingyu Zhou
a32127a0b9
Merge pull request #7391 from sbodagala/main
Do not always try to figure out the sequencer locality
2022-06-15 13:50:55 -04:00