apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-05-14 09:58:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
20,218 Commits 35 Branches 318 Tags
Commit Graph

20218 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
pranavPandit1
195a196392 crc32 support added for ppc64le 2022-04-28 08:35:42 -07:00
Lukas Joswiak
0ae0bf9e31 Add proxy debug ID 2022-04-28 10:48:57 -04:00
Lukas Joswiak
0dc662bfd2 Move trace below where is updated 2022-04-28 10:48:57 -04:00
Lukas Joswiak
8b489ae0bf Lower max compute duration cutoff and increase suppression duration 2022-04-28 10:48:57 -04:00
Lukas Joswiak
802c45f843 Add estimated compute duration 2022-04-28 10:48:57 -04:00
Lukas Joswiak
f13a8df5d9 Add logging measuring commit compute duration 2022-04-28 10:48:57 -04:00
Xiaoxi Wang
02fc80f12e
Merge pull request #6982 from sfc-gh-xwang/xwang/main/ppw-bug-fix 
Fix excludedServer overwritten bug and correct some trace event field
 2022-04-27 23:23:27 -07:00
Renxuan Wang
c69a07a858
Check in the new Hostname logic. (#6926) 
* Revert #6655.

20220407-031010-renxuan-c101052c21da8346           compressed=True data_size=31004844 duration=4310801 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=1:04:15 sanity=False started=100047 stopped=20220407-041425 submitted=20220407-031010 timeout=5400 username=renxuan

* Revert #6271.

20220407-051532-renxuan-470f0fe6aac1c217           compressed=True data_size=30982370 duration=3491067 ended=100002 fail_fast=10 max_runs=100000 pass=100002 priority=100 remaining=0 runtime=0:59:57 sanity=False started=100141 stopped=20220407-061529 submitted=20220407-051532 timeout=5400 username=renxuan

* Revert #6266.

Remove resolving-related functionalities in connection string. Connection string will be used for storing purpose only, and non-mutable.

20220407-175119-renxuan-55d30ee1a4b42c2f           compressed=True data_size=30970443 duration=5437659 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=0:59:31 sanity=False started=100154 stopped=20220407-185050 submitted=20220407-175119 timeout=5400 username=renxuan

* Add hostname to coordinator interfaces.

* Turn on the new hostname logic.

* Add the corresponding change in config txns.

The most notable change is before calling basicLoadBalance(), we need to call tryInitializeRequestStream() to initialize request streams first.

Passed correctness tests.

* Return error when hostnames cannot be resolved in coordinators command.

* Minor fixes.
 2022-04-27 21:54:13 -07:00
Xiaoxi Wang
c8a8ebd150 Merge branch 'main' of https://github.com/apple/foundationdb into xwang/main/ppw-bug-fix 2022-04-27 20:46:07 -07:00
A.J. Beamon
79063d5fc4
Better accounting for tenant prefixes when working with key size limits (#6973) 
* Consider tenant prefix sizes when doing key size limit checks

* Fix formatting
 2022-04-27 14:38:59 -07:00
Josh Slocum
14e7738455 review comments 2022-04-27 16:08:00 -05:00
Josh Slocum
92da9d12d4 Improvements to fix 2022-04-27 16:08:00 -05:00
Josh Slocum
1bd72dc99e Allowing for blob granules to initialize at start of TesterBlobGranuleCorrectness 2022-04-27 16:08:00 -05:00
Xiaoxi Wang
1f046e4be5 fix excludedServer overwritten bug; change some trace event field 2022-04-27 13:05:02 -07:00
Ata E Husain Bohra
333aadb903
Interface to enable clients to send/receive REST requests/responses (#6866) 
* Interface to enable clients to send/receive REST requests/responses

Description

Major changes:
1. Add RESTClient interface enabling client to send/receive REST HTTP
   requests. Support REST APIs are: get, head, put, post, delete, trace
2. Add RESTUtil file introducing below interfaces:
 2.1. RESTUrl - Extract URI information: host, service, request-parameters.
 2.2. RESTConnectionPool-
      Connection establishment, life-cycle management, connection-pool (TTL)
 2.3. RESTClientKnobs - supports REST Knob parameter management and updates

Testing

Unit test - fdbrpc/RESTClient, fdbrpc/RESTUtils
 2022-04-27 12:17:52 -07:00
Vaidas Gasiunas
6f841446a5 API Tests: Enable client logs. Dump out the logs in case of an error 2022-04-27 10:02:20 -04:00
Vaidas Gasiunas
d021b404ea ApiTester: Fix error code handing in case of a timeout 2022-04-27 10:02:20 -04:00
Junhyun Shim
1ee7702779
Merge pull request #6489 from sfc-gh-jshim/mako-cpp-async 
Refactor Mako for C++ and add asynchronous execution support
 2022-04-27 10:49:21 +02:00
greid
508ee73f86 Fix compile errors in Java tutorial code 
Use CompletableFuture::join instead of CompletableFuture::get
when blocking on futures in java tutorial snippets. This avoids
the unreported checked exceptions which prevent the snippets from
compiling (and is in line with the full tutorial code).
 2022-04-26 14:10:05 -07:00
Andrew Noyes
9f8e2a4517
Test compiling an fdb_c app in pkg_tester (#6940) 
* Use execstack to test executable stack permissions

The output of readelf wasn't stable

* Tee output to stdout in pkg_tester "run" function

* Test compiling an app that includes fdb_c.h

Featuring both cmake and pkg_tester, since we intend to support those in
our packages.

* Fix packaging bug

The libdir in the pkg-config file in the packages was wrong
 2022-04-26 11:54:52 -07:00
Jingyu Zhou
23b51e34fd Fix spurious test failure 
The timed_out error, if happens, could cause the test to fail, even though
there is nothing wrong with the database.
 2022-04-26 09:40:43 -07:00
Junhyun Shim
2f9506f5cd Introduce hard cap to latency sampling & apply clang format 2022-04-26 11:19:48 +02:00
Junhyun Shim
81211989f1 Disable new sample collection after first bad_alloc 
- Add more info to --async_xacts description
- Clean up unused macro in fdb_api.hpp
 2022-04-26 10:54:39 +02:00
Steve Atherton
fe338ced8f
Merge pull request #6896 from sfc-gh-mpilman/features/validate-trace-events-in-simulation 
Reduce excessive tracing and fail after 1M traces
 2022-04-25 18:02:59 -07:00
Markus Pilman
cbe4a873d2 Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-25 17:39:29 -06:00
Renxuan Wang
ec95fb7e74 Disable hostname in simulations. 
Hostnames are causing simulation failures. Turn on again in #6926.
 2022-04-25 11:05:25 -07:00
Ray Jenkins
1c5bf135d5
Revert "Migrate to OpenTelemetry tracing. (#6855)" (#6941) 
This reverts commit 5df3bac110d9b5b88931b008b852433688bb7eb0.
 2022-04-25 09:29:56 -05:00
Vaidas Gasiunas
a9ff7b52e4
Merge pull request #6944 from sfc-gh-vgasiunas/vgasiunas-upgrade-test-fix-concurrent-download 
Upgrade Tests: Avoid corrupting downloaded files in case of parallel test execution
 2022-04-25 16:23:26 +02:00
Junhyun Shim
81f9279db2 Fix GCC error about memset-ing atomic vars 2022-04-25 15:09:29 +02:00
Vaidas Gasiunas
9921a9bd02 Upgrade Tests: Avoid corrupting downloaded files in case of parallel test execution 2022-04-25 15:02:38 +02:00
Junhyun Shim
d431a9f11b Wrap platform-specific PATH_MAX header in another 2022-04-25 13:53:05 +02:00
Junhyun Shim
c4ac1ab9d0 Fix SGETRANGE 2022-04-25 13:24:56 +02:00
Junhyun Shim
cfdff223ff Merge remote-tracking branch 'origin/main' into mako-cpp-async 2022-04-25 13:21:14 +02:00
Junhyun Shim
3536cab730 Apply clang format 2022-04-25 10:48:11 +02:00
Junhyun Shim
6224ea834b Emulate mako.c's commit behavior during populate() 2022-04-25 10:44:20 +02:00
Evan Tschannen
a40c8f231a fix: perpetual wiggle would not react to a pause that happened while starting the wiggle 2022-04-24 20:35:02 -07:00
Bharadwaj V.R
9b66447783
Merge pull request #6762 from sfc-gh-bvr/block-down 
Fail upon running server versions that are too old and incompatible with the newest software that has run on a cluster
 2022-04-22 17:28:49 -07:00
Bharadwaj V.R
08323de905 fix formatting 2022-04-22 15:10:24 -07:00
Bharadwaj V.R
588b2fa509
Merge branch 'main' into block-down 2022-04-22 14:53:09 -07:00
Bharadwaj V.R
988a70f064
Merge pull request #6858 from sfc-gh-bvr/dbcorever 
Track newest and lowest compatible protocol versions in DBCoreState
 2022-04-22 14:46:21 -07:00
Bharadwaj V.R
4a5c2268da
Merge branch 'apple:main' into block-down 2022-04-22 14:45:54 -07:00
Markus Pilman
9e65e15b45 Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-22 15:39:55 -06:00
Markus Pilman
681314b0d9
Merge pull request #6937 from sfc-gh-ahusain/ahusain-fix-build 
Fix Build: use boost::hash to compute hash for std::pair
 2022-04-22 15:39:17 -06:00
Junhyun Shim
3205fe8ca4 Fix key selector handling 
Also match selectors for OP_(S)GETRANGE
Add Transaction::getKey()
 2022-04-22 22:31:32 +02:00
Ata E Husain Bohra
6c9030408e Fix Build: use boost::hash to compute hash for std::pair 
Description

Fix Build: use boost::hash to compute hash for std::pair

Testing

1. Build - gcc/clang
2. Simulation test: EncryptKeyProxyTest, EncryptionOps
3. Unit test: flow/BlobCipher
4. Running 10k correctness Joshua run
 2022-04-22 13:16:30 -07:00
Sreenath Bodagala
706164d8ae - Address seg fault in "storageRecruiter" actor 2022-04-22 12:38:59 -07:00
Xiaoxi Wang
b8fbd18199
Merge pull request #6927 from sfc-gh-xwang/main 
Run completeDest after clear destination set
 2022-04-22 09:23:36 -07:00
Vaidas Gasiunas
ac057d79fb
Merge pull request #6930 from sfc-gh-vgasiunas/vgasiunas-upgrade-tests-check-binaries 
Check the hash sum of the dowloaded binaries in the upgrade tests, retry on errors
 2022-04-22 17:59:11 +02:00
Ata E Husain Bohra
670d40ef79
FDB native KMS Connector Framework (#6846) 
* FDB native KMS Connector Framework

Description

Major changes includes:
1. Framework code to enable FDB native KMS connector implementation.
2. SERVER_KNOBS->KMS_CONNECTOR_TYPE controls the connector type selection.
3. KmsConnectorInterface endpoint definitions, every KMSConnector
   implementation needs to support defined endpoints.
4. Update EncryptKeyProxy to leverage KmsConnectorInterface endpoints
   to fetch encryption keys on-demand and/or periodic refreshes.
   Integrate SimKmsConnector implementation.
5. Implement SimKmsConnector by leveraging existing SimKeyProxy
   implementation.

Testing

Unit test: fdbserver/SimKmsConnector
Simulation: EncryptKeyProxy
 2022-04-22 08:53:39 -07:00
Bharadwaj V.R
822eb9ec26
Merge branch 'apple:main' into dbcorever 2022-04-22 08:08:34 -07:00