20780 Commits

Author SHA1 Message Date
Yao Xiao
c75611bf94
[ShardedRocksDB] 2/N Support range read and integrate with read iterator pool. (#7266) 2022-06-02 11:03:49 -07:00
Junhyun Shim
3e79735b2f
Authz JWT support (#7279)
* Add JWT support to TokenSign

* Encapsulate OpenSSL public/private key type

Type-safe passing around of keys without having to DER/PEM-serialize
(OpenSSL doesn't have distinct types for public and private key)

* Apply Clang format

* Add verify benchmark for JWT and FlatBuffers token

* Unit test base64url::{encode, decode}

* Make all payload fields optional

Let user code validate non-signature fields

* Make all payload fields optional

Completely defer field check to user code

* Move rapidjson from fdbclient to contrib

* Make fdbrpc's rapidjson linkage private

Currently only sources include them.

* Modify rapidjson path in apiversioner.py

* Algorithm::Unknown > Algorithm::UNKNOWN
2022-06-02 13:22:50 +02:00
neethuhaneesha
768655992c
Merge pull request #7295 from neethuhaneesha/traceevent
Removing trace event invalid character causing simulation harness to fail.
2022-06-01 21:35:56 -07:00
Andrew Noyes
2e087a6ec6
Fix some spammy trace events (#7296)
* Exponential backoff for some GlobalConfig retry loops

* Fix incorrect usage of random01() <= p idiom
2022-06-01 16:49:25 -07:00
neethuhaneesha
410ab6352f Traceevent correction. 2022-06-01 15:21:15 -07:00
Marian Dvorsky
138618eef9
Include symbols from fdb_c_internal.h to C bindings client library for Apple platform (#7292) 2022-06-01 14:04:53 -07:00
Bharadwaj V.R
f7c8d598c0
Merge branch 'apple:main' into mcvf-nothrottle 2022-06-01 11:33:00 -07:00
Josh Slocum
567b1d35f7 Full integration with BlobConnectionProvider for blob granules 2022-06-01 12:39:51 -05:00
Ray Jenkins
8cc51064a5
Add NAPI: prefix to VerifyCausalReadRisky span. (#7285) 2022-06-01 11:47:28 -05:00
Junhyun Shim
3a7c8c72e3
Merge pull request #7283 from sfc-gh-vgasiunas/vgasiunas-fix-close-trace
Fix race conditions on closeTraceFile and flushTraceFileVoid
2022-06-01 13:24:55 +02:00
Evan Tschannen
473edf3d11
fix: the peek_using_streaming can cause memory corruption (#7286)
* fix: the peek_using_streaming can cause memory corruption

* changed how ALLOW_DANGEROUS_KNOBS is initialized

* only buggify streaming when simulated
2022-05-31 16:04:28 -07:00
A.J. Beamon
526d8b217e Fix formatting issues 2022-05-31 11:37:52 -07:00
A.J. Beamon
ee3508c2f8 Address review comments. Primarily, this changes Tenant creation to be done via a method call on Database. 2022-05-31 11:19:02 -07:00
Bharadwaj V.R
7f457cc714
Merge branch 'apple:main' into mcvf-nothrottle 2022-05-31 10:44:51 -07:00
Mohamed Oulmahdi
26ad8bc184 Format 2022-05-31 14:17:41 +02:00
Vaidas Gasiunas
4d6ec7663f Close file at the end of runNetwork rather than in stopNetwork in order to avoid a race condition,
also in order to continue tracing the pending network thread activity.
Poll event throttler only in the network thread in order to avoid a race condition.
2022-05-31 13:59:09 +02:00
Mohamed Oulmahdi
3139e28aeb Fix TestRunner.py typos 2022-05-31 13:29:25 +02:00
Mohamed Oulmahdi
3c4c485ef2 Enable Windows tests 2022-05-31 12:01:57 +02:00
Mohamed Oulmahdi
81e81c6799 Fix atomicPath and abspath for Windows 2022-05-31 12:01:39 +02:00
Mohamed Oulmahdi
541ff206f3 Use \n instead of \r\n in log formatters 2022-05-31 11:59:21 +02:00
Mohamed Oulmahdi
ae8014a181 Disable iterator debugging for Windows 2022-05-31 11:57:41 +02:00
Bharadwaj V.R
24b2be1c4f Remove last-limited check from DDMountainChopper and DDValleyFiller 2022-05-30 21:57:34 -07:00
Junhyun Shim
46af909411
Merge pull request #7277 from apple/fix-mako-onerror-wait
Correctly wait on onError() future
2022-05-28 09:11:55 +02:00
Junhyun Shim
f76d2454f5
Correctly wait on onError() future
Currently Mako worker thread waits on the original future that produced the error. Not the future returned by onError. Fix this.
2022-05-27 23:36:33 +02:00
Renxuan Wang
0500bcb3a7 Use unique pointer to avoid memory leak. 2022-05-27 14:15:21 -07:00
Renxuan Wang
d502c47bfe Avoid creating new RequestStream when retry. 2022-05-27 14:15:21 -07:00
Josh Slocum
ffa4255c65 Added blob metadata concept as new secret type, and verified blob workers can load it 2022-05-27 15:15:56 -05:00
Jon Fu
3bf4a8d521 move transaction creation to outside outer populate loop 2022-05-27 15:59:57 -04:00
Xiaoxi Wang
173bcfc528
Merge pull request #7262 from sfc-gh-xwang/readaware
Fix heap-use-after-free caused by early noErrorsActors destroy
2022-05-27 11:35:11 -07:00
Jingyu Zhou
56af76e406
Merge pull request #7259 from sfc-gh-jslocum/aws_sdk_auth_docs
Add documentation for aws sdk auth
2022-05-27 11:17:55 -07:00
Lukas Joswiak
43ece953e1 Remove actor for client profiling get range
Since the client profiling special key range now uses global config,
there is no longer any `wait` required.
2022-05-27 10:25:29 -07:00
Lukas Joswiak
43ab5e06a3 Always restart updater 2022-05-27 10:25:29 -07:00
Lukas Joswiak
4c07064632 Fix reference cycle in GlobalConfig 2022-05-27 10:25:29 -07:00
Lukas Joswiak
49e4305760 Initialize GlobalConfig on Database clone 2022-05-27 10:25:29 -07:00
Lukas Joswiak
746261f091 Add retry loop 2022-05-27 10:25:29 -07:00
Xiaoxi Wang
74748c20a0 a.fix heap-use-after-free caused by early noErrorsActors destroy 2022-05-27 10:14:10 -07:00
Jingyu Zhou
ae5818afa8
Merge pull request #7240 from jzhou77/fix-7109
CC sends recovery txn version during TLog recruitment
2022-05-27 09:27:19 -07:00
Jon Fu
55972ca07e address code review comments 2022-05-27 10:57:57 -04:00
Jingyu Zhou
db5508520c
Merge pull request #7249 from johscheuer/fix-fdbcli-exclude-check
Check if all specific processes are excluded
2022-05-26 15:01:01 -07:00
Jon Fu
8a7a8d0d59 delete tenants in memory when workload is done running 2022-05-26 17:14:41 -04:00
Jon Fu
8180414b4a remove printf debugging statements 2022-05-26 16:51:31 -04:00
Sreenath Bodagala
4ccaacdd59
Merge pull request #7256 from sbodagala/main
Make sequencer accept the recovery transaction version unconditionally
2022-05-26 16:38:57 -04:00
Jon Fu
c6ac9cf2a5 Merge branch 'main' of github.com:apple/foundationdb into jfu-mako-tenant-support 2022-05-26 16:29:52 -04:00
Jon Fu
ddda238c01 fix issues with tenant creation/deletion and temporary tenants and strings 2022-05-26 16:29:16 -04:00
Jon Fu
01fa56630a WIP commit attempting to solve some tenant open and deletion issues 2022-05-26 14:55:59 -04:00
Josh Slocum
07adc873a6 Add documentation for aws sdk auth 2022-05-26 13:18:25 -05:00
Xiaoxi Wang
5bea02cfde
Merge pull request #6686 from sfc-gh-xwang/readaware
Read-aware Data Distributor (default disabled)
2022-05-26 11:05:03 -07:00
Yao Xiao
df3d34f8ac
[ShardedRocksDB] 1/N Implement functions for write and single shard read. (#7184) 2022-05-26 10:59:14 -07:00
Renxuan Wang
cd2a575e02
Move the resolve of coordinator hostname from getCoordinatorProtocol() to getClusterProtocolImpl(). (#7245)
* Move the resolve of coordinator hostname from getCoordinatorProtocol() to getClusterProtocolImpl().

* Guard DNS Cache behind a knob.
2022-05-26 09:45:54 -07:00
Sreenath Bodagala
0402de9085 - Make sequencer accept the recovery transaction version unconditionally.
Cluster controller could send multiple recovery transaction versions
and not accpeting them unconditionally could cause a discrepancy between
the recovery transaction versions on the sequencer and the resolvers,
resulting in a hung recovery (because the cluster controller won't be able
to commit the recovery transaction version).
2022-05-26 13:37:12 +00:00