Josh Slocum
1cc466e068
fixes and review comments
2022-06-17 08:17:44 -05:00
Josh Slocum
b3597ef3a8
Added plumbing for tenant-aware purge granules
2022-06-16 13:04:34 -05:00
Josh Slocum
a3289f9cab
adding tenant prefix to bg ranges call
2022-06-06 14:09:10 -05:00
Josh Slocum
bf69f545d3
Merge pull request #7275 from sfc-gh-jslocum/blob_granule_kms
...
Added blob metadata concept as new secret type, and integrated with blob granule access
2022-06-06 11:25:56 -05:00
Josh Slocum
4310e5d6a4
Merge branch 'main' into blob_granule_kms
2022-06-06 08:07:38 -05:00
Josh Slocum
ff643cce76
compile fix
2022-06-03 11:50:33 -05:00
Hao Fu
96d3951205
Fix versionstamp in Tester ( #7312 )
2022-06-03 08:56:01 -07:00
Josh Slocum
b650410a48
Merge branch 'main' into blob_granule_kms
2022-06-03 09:13:49 -05:00
Josh Slocum
fcd20c479d
addressing review comments
2022-06-03 08:36:07 -05:00
Hao Fu
e7fa8e9f6f
Add versionstamp support in tuple ( #7293 )
...
Tuple in C++ needs to support Versionstamp.
2022-06-02 17:44:10 -07:00
Xiaoge Su
c886a6efe4
Refactor the WriteMap.h
...
Split the interface and implementation, so adding debugging information
in the code will not trigger full rebuild.
2022-06-02 15:57:26 -07:00
Ata E Husain Bohra
b66509eff0
Make EncryptKeyServer and KmsConnector API to be 'tenant' name aware ( #7215 )
...
Description
Major changes proposed include:
1. Update EncryptKeyServer APIs to be tenant aware.
2. Update KmsConnector APIs to be tenant aware
Client of above APIs such as: CP, SS and BlobWorker need to supply
encryption domain info that includes: tenantId and tenantName
Testing
1. Update EncryptKeyProxyTest
2. Update RESTKmsConnectorTest
3. Update SimKmsConnectorTest
2022-06-02 11:55:50 -07:00
Josh Slocum
872c25148f
remove BUILD_ALWAYS from awssdk.cmake
2022-06-02 13:40:56 -05:00
Yao Xiao
c75611bf94
[ShardedRocksDB] 2/N Support range read and integrate with read iterator pool. ( #7266 )
2022-06-02 11:03:49 -07:00
Junhyun Shim
3e79735b2f
Authz JWT support ( #7279 )
...
* Add JWT support to TokenSign
* Encapsulate OpenSSL public/private key type
Type-safe passing around of keys without having to DER/PEM-serialize
(OpenSSL doesn't have distinct types for public and private key)
* Apply Clang format
* Add verify benchmark for JWT and FlatBuffers token
* Unit test base64url::{encode, decode}
* Make all payload fields optional
Let user code validate non-signature fields
* Make all payload fields optional
Completely defer field check to user code
* Move rapidjson from fdbclient to contrib
* Make fdbrpc's rapidjson linkage private
Currently only sources include them.
* Modify rapidjson path in apiversioner.py
* Algorithm::Unknown > Algorithm::UNKNOWN
2022-06-02 13:22:50 +02:00
neethuhaneesha
768655992c
Merge pull request #7295 from neethuhaneesha/traceevent
...
Removing trace event invalid character causing simulation harness to fail.
2022-06-01 21:35:56 -07:00
Andrew Noyes
2e087a6ec6
Fix some spammy trace events ( #7296 )
...
* Exponential backoff for some GlobalConfig retry loops
* Fix incorrect usage of random01() <= p idiom
2022-06-01 16:49:25 -07:00
neethuhaneesha
410ab6352f
Traceevent correction.
2022-06-01 15:21:15 -07:00
Marian Dvorsky
138618eef9
Include symbols from fdb_c_internal.h to C bindings client library for Apple platform ( #7292 )
2022-06-01 14:04:53 -07:00
Josh Slocum
567b1d35f7
Full integration with BlobConnectionProvider for blob granules
2022-06-01 12:39:51 -05:00
Ray Jenkins
8cc51064a5
Add NAPI: prefix to VerifyCausalReadRisky span. ( #7285 )
2022-06-01 11:47:28 -05:00
Junhyun Shim
3a7c8c72e3
Merge pull request #7283 from sfc-gh-vgasiunas/vgasiunas-fix-close-trace
...
Fix race conditions on closeTraceFile and flushTraceFileVoid
2022-06-01 13:24:55 +02:00
Evan Tschannen
473edf3d11
fix: the peek_using_streaming can cause memory corruption ( #7286 )
...
* fix: the peek_using_streaming can cause memory corruption
* changed how ALLOW_DANGEROUS_KNOBS is initialized
* only buggify streaming when simulated
2022-05-31 16:04:28 -07:00
Vaidas Gasiunas
4d6ec7663f
Close file at the end of runNetwork rather than in stopNetwork in order to avoid a race condition,
...
also in order to continue tracing the pending network thread activity.
Poll event throttler only in the network thread in order to avoid a race condition.
2022-05-31 13:59:09 +02:00
Junhyun Shim
46af909411
Merge pull request #7277 from apple/fix-mako-onerror-wait
...
Correctly wait on onError() future
2022-05-28 09:11:55 +02:00
Junhyun Shim
f76d2454f5
Correctly wait on onError() future
...
Currently Mako worker thread waits on the original future that produced the error. Not the future returned by onError. Fix this.
2022-05-27 23:36:33 +02:00
Renxuan Wang
0500bcb3a7
Use unique pointer to avoid memory leak.
2022-05-27 14:15:21 -07:00
Renxuan Wang
d502c47bfe
Avoid creating new RequestStream when retry.
2022-05-27 14:15:21 -07:00
Josh Slocum
ffa4255c65
Added blob metadata concept as new secret type, and verified blob workers can load it
2022-05-27 15:15:56 -05:00
Xiaoxi Wang
173bcfc528
Merge pull request #7262 from sfc-gh-xwang/readaware
...
Fix heap-use-after-free caused by early noErrorsActors destroy
2022-05-27 11:35:11 -07:00
Jingyu Zhou
56af76e406
Merge pull request #7259 from sfc-gh-jslocum/aws_sdk_auth_docs
...
Add documentation for aws sdk auth
2022-05-27 11:17:55 -07:00
Lukas Joswiak
43ece953e1
Remove actor for client profiling get range
...
Since the client profiling special key range now uses global config,
there is no longer any `wait` required.
2022-05-27 10:25:29 -07:00
Lukas Joswiak
43ab5e06a3
Always restart updater
2022-05-27 10:25:29 -07:00
Lukas Joswiak
4c07064632
Fix reference cycle in GlobalConfig
2022-05-27 10:25:29 -07:00
Lukas Joswiak
49e4305760
Initialize GlobalConfig on Database clone
2022-05-27 10:25:29 -07:00
Lukas Joswiak
746261f091
Add retry loop
2022-05-27 10:25:29 -07:00
Xiaoxi Wang
74748c20a0
a.fix heap-use-after-free caused by early noErrorsActors destroy
2022-05-27 10:14:10 -07:00
Jingyu Zhou
ae5818afa8
Merge pull request #7240 from jzhou77/fix-7109
...
CC sends recovery txn version during TLog recruitment
2022-05-27 09:27:19 -07:00
Jingyu Zhou
db5508520c
Merge pull request #7249 from johscheuer/fix-fdbcli-exclude-check
...
Check if all specific processes are excluded
2022-05-26 15:01:01 -07:00
Sreenath Bodagala
4ccaacdd59
Merge pull request #7256 from sbodagala/main
...
Make sequencer accept the recovery transaction version unconditionally
2022-05-26 16:38:57 -04:00
Josh Slocum
07adc873a6
Add documentation for aws sdk auth
2022-05-26 13:18:25 -05:00
Xiaoxi Wang
5bea02cfde
Merge pull request #6686 from sfc-gh-xwang/readaware
...
Read-aware Data Distributor (default disabled)
2022-05-26 11:05:03 -07:00
Yao Xiao
df3d34f8ac
[ShardedRocksDB] 1/N Implement functions for write and single shard read. ( #7184 )
2022-05-26 10:59:14 -07:00
Renxuan Wang
cd2a575e02
Move the resolve of coordinator hostname from getCoordinatorProtocol() to getClusterProtocolImpl(). ( #7245 )
...
* Move the resolve of coordinator hostname from getCoordinatorProtocol() to getClusterProtocolImpl().
* Guard DNS Cache behind a knob.
2022-05-26 09:45:54 -07:00
Sreenath Bodagala
0402de9085
- Make sequencer accept the recovery transaction version unconditionally.
...
Cluster controller could send multiple recovery transaction versions
and not accpeting them unconditionally could cause a discrepancy between
the recovery transaction versions on the sequencer and the resolvers,
resulting in a hung recovery (because the cluster controller won't be able
to commit the recovery transaction version).
2022-05-26 13:37:12 +00:00
Xiaoxi Wang
13a77dd5a2
change priority knob; change PromiseStream to FutureStream; remove comments; add on_sr check
2022-05-25 17:09:34 -07:00
Josh Slocum
458e8018e1
review comments
2022-05-25 17:16:56 -05:00
Josh Slocum
5621fcff40
formatting fix
2022-05-25 17:16:56 -05:00
Josh Slocum
fd7b662767
cleaning up
2022-05-25 17:16:56 -05:00
Josh Slocum
dd637dd6a7
passes tenant simulation test
2022-05-25 17:16:56 -05:00
