apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-05-14 09:58:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,178 Commits 35 Branches 318 Tags
Commit Graph

21178 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Junhyun Shim
0874e553cd Place generateRandomData() under {I|Deterministic}Random 2022-07-20 13:21:11 +02:00
Junhyun Shim
d1dc82629e Clean up TenantInfo and related headers 2022-07-18 14:37:17 +02:00
Junhyun Shim
ca29cd9f41 Make RequestStreams accept empty TenantInfo 
+ Make Authz tokens survive Transaction resets
+ Make tokens explicitly resettable by assigning empty value to authz token TR option
+ Fill out missing trace for some failed token verifications
+ Trace non-sensitive token parts upon failed verification
 2022-07-18 13:30:55 +02:00
Junhyun Shim
03a496c0e0 Make auth token survive transaction resets 2022-07-13 20:34:01 +02:00
Junhyun Shim
11a9fe9aff Move JWT "kid" field from claims to header 2022-07-13 20:21:27 +02:00
Junhyun Shim
24317aa6be Fix incorrect signature extraction function 2022-07-13 19:28:00 +02:00
Junhyun Shim
ac5436a090 Catch up on changes to main 2022-07-12 16:48:09 +02:00
Markus Pilman
2edbcf2c65
Merge pull request #44 from apple/main 
Merge main
 2022-07-12 07:51:22 -06:00
Xiaoxi Wang
cc185c51c6
Merge pull request #7563 from sfc-gh-xwang/feature/dd-refactor-incremental 
[DD Testability] move updateReplicaKey to txnProcessor
 2022-07-11 17:11:55 -07:00
Markus Pilman
fa9e623fc1
Merge pull request #7459 from sfc-gh-ljoswiak/features/module-link-tests 
Add test executables to catch missing symbols in modules
 2022-07-11 17:31:11 -06:00
Markus Pilman
4f4095b6ae
Merge pull request #7385 from sfc-gh-etschannen/fix-multiple-shared-tlogs 
Avoid recruiting multiple shared tlogs
 2022-07-11 17:28:35 -06:00
Markus Pilman
4ece33a0a8
Merge pull request #7445 from sfc-gh-anoyes/anoyes/fix-ubsan 
Fix UBSAN build when statically linking libcxx
 2022-07-11 17:27:37 -06:00
Jingyu Zhou
474a9ab124
Merge pull request #7567 from sfc-gh-fzhao/DuplicateHedaerFiles 
Redwood remove duplicate header files
 2022-07-11 13:59:39 -07:00
Jingyu Zhou
e9d62c0456
Merge pull request #7561 from jzhou77/main 
Add 7.1.14 and 7.1.15 release notes
 2022-07-11 13:53:32 -07:00
Jingyu Zhou
ad8c5e282e
Merge pull request #7520 from johscheuer/operator-docs-unified 
Add docs for how to run the operator with the unified image
 2022-07-11 13:36:20 -07:00
Jingyu Zhou
58aa5a9e1d
Merge pull request #7539 from sfc-gh-fzhao/SetFetchKey 
set isFetchKeys for getRangeStreamFragment
 2022-07-11 13:25:24 -07:00
Fuheng Zhao
3aeb2f17cd Redwood remove duplicate header files 2022-07-11 12:44:44 -07:00
Xiaoxi Wang
f42b8687c2 add comment 2022-07-11 11:26:46 -07:00
Xiaoxi Wang
447eaa1d81 move updateReplicaKey to txnProcessor 2022-07-11 11:16:17 -07:00
Jingyu Zhou
ef37bf3fca Add 7.1.14 and 7.1.15 release notes 2022-07-11 10:29:38 -07:00
Dan Lambright
96bd3dcbf0
custom loopback cluster script (#7550) 2022-07-11 13:02:37 -04:00
Vaidas Gasiunas
0a2e5c830c
C shim library build clean up (#7560) 
* Remove unnecessary Implib.so files

* Improve cmake dependencies on doctest
 2022-07-11 17:57:28 +02:00
Junhyun Shim
dbf8f98481 Apply Clang format 2022-07-11 17:10:45 +02:00
Junhyun Shim
545a9a8043 Fix bugs and add token timeout-in-cache test 2022-07-11 16:58:04 +02:00
Junhyun Shim
7f5049239d Fix LRUCache test 2022-07-11 15:27:22 +02:00
Junhyun Shim
61f3d14ec6 Add TokenCache test 
Add function authz::jwt::TokenRef::toStringRef() for token tracing
Add StringRef::toStringView()
 2022-07-11 13:42:41 +02:00
Jingyu Zhou
347339426b
Merge pull request #7552 from jleach4/7543 
Changing hasIncompleteVersionstamp to use iteration rather than stream processing #7543
 2022-07-08 21:19:14 -07:00
Chaoguang Lin
901d988de9
Add a knob SNAPSHOT_ALL_STATEFUL_PROCESSES to snapshot all processes with stateful class type(storage, log, transaction) even if they are not recruited (#7554) 2022-07-08 20:53:49 -07:00
Xiaoxi Wang
68f3d463e2
Merge pull request #7557 from sfc-gh-xwang/feature/dd-refactor-incremental 
[DD Testability] move getDatabaseConfiguration to txnProcessor
 2022-07-08 20:22:27 -07:00
Xiaoxi Wang
5ce1d7342d Merge branch 'feature/dd-refactor-incremental' of https://github.com/sfc-gh-xwang/foundationdb into feature/dd-refactor-incremental 2022-07-08 16:35:31 -07:00
Xiaoxi Wang
9fe76ecf21 format 2022-07-08 16:34:55 -07:00
Xiaoxi Wang
a941a28de7
Merge branch 'apple:main' into feature/dd-refactor-incremental 2022-07-08 16:07:16 -07:00
Xiaoxi Wang
b48b1e93f9 remove header dependency; move getDatabaseConfiguration to txnProcessor 2022-07-08 16:01:23 -07:00
Xiaoxi Wang
6be20d08ae
Merge pull request #7555 from sfc-gh-xwang/feature/dd-refactor-incremental 
[DD Testability] move takeMoveKeysLock to DDTxnProcessor
 2022-07-08 15:40:14 -07:00
He Liu
aa43956fbd
Sharded RocksDB (#7540) 
* Some fixes.

* Enabled ShardedRocksDB in IKeyValueStore.h

* Added unit test for ShardedRocks for \xff\xff key space read/write.

* Resolved comments.

* Return empty read results if the physical shards are not initialized.

Co-authored-by: He Liu <heliu@apple.com>
 2022-07-08 15:17:38 -07:00
Markus Pilman
f8d66c53a3 add LRU cache and unit test 
the boost LRU cache copies the key into the list when
doing `lru::get`. This is problematic if the memory for
the key is owned by the value (which is the case in our
use-case).
 2022-07-08 15:54:09 -06:00
Bharadwaj V.R
aca44c8644
Increase frequency of RelocateShardStartSplit traces for better observability of splits (#7503) 2022-07-08 14:45:44 -07:00
Xiaoxi Wang
9cead35911 add contract comments 2022-07-08 14:19:14 -07:00
Xiaoxi Wang
f5a81154ef move takeMoveKeysLock to DDTxnProcessor 2022-07-08 14:11:31 -07:00
Markus Pilman
13684042c1 use a VectorRef for tokens to improve memory&copy 
the number of tenants in a token will be typically very small
(maybe 1-2), so hashing seems unnecessary (and potentially expensive).

Also copying the cache entry will be cheaper if VectorRef is used as the
memory will just be ref-counted
 2022-07-08 14:38:43 -06:00
john_leach
afa1120874 Changing hasIncompleteVersionstamp to use iteration rather than stream processing #7543 2022-07-08 13:27:40 -07:00
Markus Pilman
2ae17233d8 addressed review comments 2022-07-08 11:19:14 -06:00
Jingyu Zhou
4103b16793 Fix a performance bug in Resolver 
The erased bytes from recent state transactions was accidently set to 0 and
cause anyPopped to be always false. Thus, when totalStateBytes will never
decrease and can cause high latency between "Resolver.resolveBatch.Before" and
"Resolver.resolveBatch.AfterQueueSizeCheck", in hundreds of milliseconds. This
will cause high server side commit latency.
 2022-07-08 09:58:28 -07:00
Markus Pilman
f268265d96
Apply suggestions from code review 
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
Co-authored-by: Junhyun Shim <junhyun.shim@snowflake.com>
 2022-07-08 10:42:44 -06:00
Vaidas Gasiunas
1e8feb9cb8
Generate a shim library for the FDB C API (#7506) 
* Adding sources of the Implib.so project

* Run C unit tests and API tests with the shim library

* Reuse compilation of C test binaries with and without shim library

* Resolve client library path from an environment variable

* Refactoring: Reusable module for downloading FDB binaries

* Testing client shim library with current version and last release version

* Tests for specifying client library over an environment variable

* Enable C shim library tests on ARM

* Restore the original path for including fdb_api.hpp
 2022-07-08 16:28:35 +02:00
Marian Dvorsky
24d7e0d28b
Add WatchAndWait API client test workload (#7524) 
* Add WatchAndWait workload

* Reimplement without Notification

* Handle errors

* Finish comment

* Simplify the test by introducing commit(/*complete=*/false)

* Fix a race condition

* Refactor

* Remove unused capture

* Add assert for has_value

* Automatically adjust numClientThreads
 2022-07-08 11:57:38 +02:00
He Liu
bc5bfaffda
Shard based move (#6981) 
* Shard based move.

* Clean up.

* Clear results on retry in getInitialDataDistribution.

* Remove assertion on SHARD_ENCODE_LOCATION_METADATA for compatibility.

* Resolved comments.

Co-authored-by: He Liu <heliu@apple.com>
 2022-07-07 20:49:16 -07:00
Steve Atherton
e63cb431e1
Merge pull request #7534 from sfc-gh-satherton/storage-type-improvements 
Add StorageEngine type to StorageMetrics trace events
 2022-07-07 16:26:43 -07:00
A.J. Beamon
346d3c3265
Merge pull request #7487 from sfc-gh-ajbeamon/buggified-commit-helper 
Add a helper to simulate a commit that can fail with unknown result or take a long time
 2022-07-07 16:17:19 -07:00
Jingyu Zhou
5b3521f7f0 Add 7.1.12, 7.1.13 release notes 2022-07-07 15:13:01 -07:00