apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-03 03:41:53 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,119 Commits 35 Branches 318 Tags
Commit Graph

21119 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jingyu Zhou
e9d62c0456
Merge pull request #7561 from jzhou77/main 
Add 7.1.14 and 7.1.15 release notes
 2022-07-11 13:53:32 -07:00
Jingyu Zhou
ad8c5e282e
Merge pull request #7520 from johscheuer/operator-docs-unified 
Add docs for how to run the operator with the unified image
 2022-07-11 13:36:20 -07:00
Jingyu Zhou
58aa5a9e1d
Merge pull request #7539 from sfc-gh-fzhao/SetFetchKey 
set isFetchKeys for getRangeStreamFragment
 2022-07-11 13:25:24 -07:00
Jingyu Zhou
ef37bf3fca Add 7.1.14 and 7.1.15 release notes 2022-07-11 10:29:38 -07:00
Dan Lambright
96bd3dcbf0
custom loopback cluster script (#7550) 2022-07-11 13:02:37 -04:00
Vaidas Gasiunas
0a2e5c830c
C shim library build clean up (#7560) 
* Remove unnecessary Implib.so files

* Improve cmake dependencies on doctest
 2022-07-11 17:57:28 +02:00
Jingyu Zhou
347339426b
Merge pull request #7552 from jleach4/7543 
Changing hasIncompleteVersionstamp to use iteration rather than stream processing #7543
 2022-07-08 21:19:14 -07:00
Chaoguang Lin
901d988de9
Add a knob SNAPSHOT_ALL_STATEFUL_PROCESSES to snapshot all processes with stateful class type(storage, log, transaction) even if they are not recruited (#7554) 2022-07-08 20:53:49 -07:00
Xiaoxi Wang
68f3d463e2
Merge pull request #7557 from sfc-gh-xwang/feature/dd-refactor-incremental 
[DD Testability] move getDatabaseConfiguration to txnProcessor
 2022-07-08 20:22:27 -07:00
Xiaoxi Wang
5ce1d7342d Merge branch 'feature/dd-refactor-incremental' of https://github.com/sfc-gh-xwang/foundationdb into feature/dd-refactor-incremental 2022-07-08 16:35:31 -07:00
Xiaoxi Wang
9fe76ecf21 format 2022-07-08 16:34:55 -07:00
Xiaoxi Wang
a941a28de7
Merge branch 'apple:main' into feature/dd-refactor-incremental 2022-07-08 16:07:16 -07:00
Xiaoxi Wang
b48b1e93f9 remove header dependency; move getDatabaseConfiguration to txnProcessor 2022-07-08 16:01:23 -07:00
Xiaoxi Wang
6be20d08ae
Merge pull request #7555 from sfc-gh-xwang/feature/dd-refactor-incremental 
[DD Testability] move takeMoveKeysLock to DDTxnProcessor
 2022-07-08 15:40:14 -07:00
He Liu
aa43956fbd
Sharded RocksDB (#7540) 
* Some fixes.

* Enabled ShardedRocksDB in IKeyValueStore.h

* Added unit test for ShardedRocks for \xff\xff key space read/write.

* Resolved comments.

* Return empty read results if the physical shards are not initialized.

Co-authored-by: He Liu <heliu@apple.com>
 2022-07-08 15:17:38 -07:00
Bharadwaj V.R
aca44c8644
Increase frequency of RelocateShardStartSplit traces for better observability of splits (#7503) 2022-07-08 14:45:44 -07:00
Xiaoxi Wang
9cead35911 add contract comments 2022-07-08 14:19:14 -07:00
Xiaoxi Wang
f5a81154ef move takeMoveKeysLock to DDTxnProcessor 2022-07-08 14:11:31 -07:00
john_leach
afa1120874 Changing hasIncompleteVersionstamp to use iteration rather than stream processing #7543 2022-07-08 13:27:40 -07:00
Jingyu Zhou
4103b16793 Fix a performance bug in Resolver 
The erased bytes from recent state transactions was accidently set to 0 and
cause anyPopped to be always false. Thus, when totalStateBytes will never
decrease and can cause high latency between "Resolver.resolveBatch.Before" and
"Resolver.resolveBatch.AfterQueueSizeCheck", in hundreds of milliseconds. This
will cause high server side commit latency.
 2022-07-08 09:58:28 -07:00
Vaidas Gasiunas
1e8feb9cb8
Generate a shim library for the FDB C API (#7506) 
* Adding sources of the Implib.so project

* Run C unit tests and API tests with the shim library

* Reuse compilation of C test binaries with and without shim library

* Resolve client library path from an environment variable

* Refactoring: Reusable module for downloading FDB binaries

* Testing client shim library with current version and last release version

* Tests for specifying client library over an environment variable

* Enable C shim library tests on ARM

* Restore the original path for including fdb_api.hpp
 2022-07-08 16:28:35 +02:00
Marian Dvorsky
24d7e0d28b
Add WatchAndWait API client test workload (#7524) 
* Add WatchAndWait workload

* Reimplement without Notification

* Handle errors

* Finish comment

* Simplify the test by introducing commit(/*complete=*/false)

* Fix a race condition

* Refactor

* Remove unused capture

* Add assert for has_value

* Automatically adjust numClientThreads
 2022-07-08 11:57:38 +02:00
He Liu
bc5bfaffda
Shard based move (#6981) 
* Shard based move.

* Clean up.

* Clear results on retry in getInitialDataDistribution.

* Remove assertion on SHARD_ENCODE_LOCATION_METADATA for compatibility.

* Resolved comments.

Co-authored-by: He Liu <heliu@apple.com>
 2022-07-07 20:49:16 -07:00
Steve Atherton
e63cb431e1
Merge pull request #7534 from sfc-gh-satherton/storage-type-improvements 
Add StorageEngine type to StorageMetrics trace events
 2022-07-07 16:26:43 -07:00
A.J. Beamon
346d3c3265
Merge pull request #7487 from sfc-gh-ajbeamon/buggified-commit-helper 
Add a helper to simulate a commit that can fail with unknown result or take a long time
 2022-07-07 16:17:19 -07:00
Jingyu Zhou
5b3521f7f0 Add 7.1.12, 7.1.13 release notes 2022-07-07 15:13:01 -07:00
Fuheng Zhao
207082f03e comment out setting isFetchKeys 2022-07-07 12:55:25 -07:00
Fuheng Zhao
6e7603aa35 set isFetchKeys for getRangeStreamFragment 2022-07-07 11:14:11 -07:00
Markus Pilman
59cdb8ae7c
Merge pull request #7441 from goandrei/add_intel_compiler_support 
Add Intel compiler support
 2022-07-07 10:40:53 -06:00
Andrei Gorneanu
35f693b238 Disable ffast-math for Intel compiler 2022-07-07 17:36:26 +02:00
Andrei Gorneanu
3a0444b569 Merge remote-tracking branch 'upstream/main' into add_intel_compiler_support 2022-07-07 17:30:09 +02:00
Sreenath Bodagala
fa0c3249ca
Merge pull request #7529 from sbodagala/main 
Make sequencer aware of the locality of the primary region
 2022-07-07 14:00:10 +05:30
A.J. Beamon
c4b0f6eaae
Add an internal C API to support connection to a cluster using a connection string (#7438) 
* Add an internal C API to support memory connection records

* Track shared state in the client using a unique and immutable cluster ID from the cluster

* Add missing code to store the clusterId in the database state object

* Update some arguments to pass by const&
 2022-07-07 10:12:49 +02:00
Steve Atherton
03df62e2fc Added StorageEngine detail to StorageMetrics trace event. 2022-07-07 00:10:04 -07:00
Steve Atherton
cf96495bb2 Hardcode StoreType as they cannot change. 2022-07-07 00:08:25 -07:00
Yao Xiao
f98d5ae9e9
[ShardedRocksDB] 5/N Generate and persist metadata for range mapping. (#7408) 2022-07-06 15:57:46 -07:00
A.J. Beamon
5852a55127
Merge pull request #7435 from sfc-gh-jfu/jfu-tenant-rename 
Support Tenant Renaming
 2022-07-06 15:08:04 -07:00
A.J. Beamon
ae6d6e0e72
Merge pull request #7402 from sfc-gh-jfu/jfu-mako-active-tenants 
Introduce concept of "active" versus "total" tenants in mako
 2022-07-06 14:23:11 -07:00
Jon Fu
2ecedc6c5d use refactored tenant entry encoding 2022-07-06 14:12:09 -07:00
Jon Fu
df1f108b78 Merge branch 'main' of github.com:apple/foundationdb into jfu-tenant-rename 2022-07-06 14:10:22 -07:00
Jon Fu
3bdbf0c109 fix compile error 2022-07-06 14:06:57 -07:00
Dan Lambright
bb99b59deb
Change VersionVectorTagUpdates to LatencySample (#7531) 2022-07-06 16:48:15 -04:00
Jon Fu
61b3e1f51e add comment about our tenant encoding 2022-07-06 13:16:24 -07:00
Jon Fu
af78a2ef5f move tr options to outside loop 2022-07-06 13:07:47 -07:00
Jon Fu
48b0f6e22b code review changes 2022-07-06 13:04:21 -07:00
A.J. Beamon
8897a03913 Allow for random delays in buggifiedCommit that don't cause timeouts or that occur before we throw commit_unknown_result. Add a delay(0) to avoid a nowait buggifiedCommit in the typical case. 2022-07-06 12:48:13 -07:00
A.J. Beamon
1e8225a19e
Merge pull request #7511 from sfc-gh-ajbeamon/add-subrange-support-to-tenant-special-keys 
Update the tenant special keys submodule to support multiple sub-ranges
 2022-07-06 10:33:14 -07:00
Sreenath Bodagala
a84112d30b - Propagate the locality of the primary region from ClusterController 
to the sequencer, rather than deriving it from "MasterInterface" on
the sequencer (which is not correct).
 2022-07-06 11:57:06 +00:00
Johannes M. Scheuermann
b9afde3d4c Fix permission in Dockerfile 2022-07-05 20:02:51 -07:00
Jingyu Zhou
2d9b854a9f
Merge pull request #7527 from sbodagala/main 
Microbenchmark version vector serialization/deserialization code
 2022-07-05 15:04:02 -07:00