20247 Commits

Author SHA1 Message Date
Jon Fu
ff216c2f57 add tenant list metadata to binding tester 2022-05-02 13:42:11 -04:00
Jon Fu
d953b961b7 Merge branch 'main' of github.com:apple/foundationdb into jfu-list-tenants 2022-04-29 13:16:54 -04:00
Jon Fu
2afaf55a48 fixed some binding tests and split stack operation between key and value of tenant list 2022-04-29 13:16:04 -04:00
Vaidas Gasiunas
c8b1662ab7
Merge pull request #6917 from LukasMoll/fix/make-code-pythonic
made python files inside TestRunner more pythonic
2022-04-29 13:59:13 +02:00
Vaidas Gasiunas
e52662c774
Upgrade Tests: Fix resetting of already initialized variables 2022-04-29 12:47:05 +02:00
Renxuan Wang
154de018ff
One place in PaxosConfigConsumer was missed out in #6926. (#7006)
* One place in PaxosConfigConsumer was missed out.

* Minor improvements.
2022-04-28 18:32:55 -07:00
Hao Fu
0362beb3f3
Fix limit bug in indexPrefetch (#7004)
limit for getRange was incorrectly set to 1, while
a single logical record is consists of at least 2
keyValue, causing record layer fail to unsplit the
logical record.
2022-04-28 17:44:19 -07:00
Sam Gwydir
5403a29ecb
add WolfSSL support (#6682)
remove extraneous include
2022-04-28 16:53:38 -07:00
Josh Slocum
db6d7396ca
Add delay between quickly re-recruiting the same singleton process, to avoid recruit thrashing when there are temporarily multiple cluster controllers (#7000) 2022-04-28 15:45:09 -07:00
Andrew Noyes
13a388ff14
Disable leak checks for some tests that intentionally leak (#6997) 2022-04-28 12:55:34 -07:00
A.J. Beamon
cc72d541e4
Merge pull request #6971 from sfc-gh-svemuri/verify-tenant-prefixes-on-commit-proxy
Validate commit request tenant prefixes on commit proxy
2022-04-28 12:40:56 -07:00
Aaron Molitor
74ec6962b0 update build-images.sh to play nice with AWS IMDSv2 2022-04-28 14:20:46 -05:00
pranavPandit1
a192264e7e missing file added 2022-04-28 08:35:42 -07:00
pranavPandit1
5794fd4e91 clang format corrected for file 2022-04-28 08:35:42 -07:00
pranavPandit1
195a196392 crc32 support added for ppc64le 2022-04-28 08:35:42 -07:00
Lukas Joswiak
0ae0bf9e31 Add proxy debug ID 2022-04-28 10:48:57 -04:00
Lukas Joswiak
0dc662bfd2 Move trace below where is updated 2022-04-28 10:48:57 -04:00
Lukas Joswiak
8b489ae0bf Lower max compute duration cutoff and increase suppression duration 2022-04-28 10:48:57 -04:00
Lukas Joswiak
802c45f843 Add estimated compute duration 2022-04-28 10:48:57 -04:00
Lukas Joswiak
f13a8df5d9 Add logging measuring commit compute duration 2022-04-28 10:48:57 -04:00
Xiaoxi Wang
02fc80f12e
Merge pull request #6982 from sfc-gh-xwang/xwang/main/ppw-bug-fix
Fix excludedServer overwritten bug and correct some trace event field
2022-04-27 23:23:27 -07:00
Renxuan Wang
c69a07a858
Check in the new Hostname logic. (#6926)
* Revert #6655.

20220407-031010-renxuan-c101052c21da8346           compressed=True data_size=31004844 duration=4310801 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=1:04:15 sanity=False started=100047 stopped=20220407-041425 submitted=20220407-031010 timeout=5400 username=renxuan

* Revert #6271.

20220407-051532-renxuan-470f0fe6aac1c217           compressed=True data_size=30982370 duration=3491067 ended=100002 fail_fast=10 max_runs=100000 pass=100002 priority=100 remaining=0 runtime=0:59:57 sanity=False started=100141 stopped=20220407-061529 submitted=20220407-051532 timeout=5400 username=renxuan

* Revert #6266.

Remove resolving-related functionalities in connection string. Connection string will be used for storing purpose only, and non-mutable.

20220407-175119-renxuan-55d30ee1a4b42c2f           compressed=True data_size=30970443 duration=5437659 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=0:59:31 sanity=False started=100154 stopped=20220407-185050 submitted=20220407-175119 timeout=5400 username=renxuan

* Add hostname to coordinator interfaces.

* Turn on the new hostname logic.

* Add the corresponding change in config txns.

The most notable change is before calling basicLoadBalance(), we need to call tryInitializeRequestStream() to initialize request streams first.

Passed correctness tests.

* Return error when hostnames cannot be resolved in coordinators command.

* Minor fixes.
2022-04-27 21:54:13 -07:00
Xiaoxi Wang
c8a8ebd150 Merge branch 'main' of https://github.com/apple/foundationdb into xwang/main/ppw-bug-fix 2022-04-27 20:46:07 -07:00
Sagar Vemuri
ed0732a012 Address review comments: Update TraceEvents and an assert in versionstampkey check 2022-04-27 15:20:41 -07:00
A.J. Beamon
79063d5fc4
Better accounting for tenant prefixes when working with key size limits (#6973)
* Consider tenant prefix sizes when doing key size limit checks

* Fix formatting
2022-04-27 14:38:59 -07:00
Josh Slocum
14e7738455 review comments 2022-04-27 16:08:00 -05:00
Josh Slocum
92da9d12d4 Improvements to fix 2022-04-27 16:08:00 -05:00
Josh Slocum
1bd72dc99e Allowing for blob granules to initialize at start of TesterBlobGranuleCorrectness 2022-04-27 16:08:00 -05:00
Xiaoxi Wang
1f046e4be5 fix excludedServer overwritten bug; change some trace event field 2022-04-27 13:05:02 -07:00
Ata E Husain Bohra
333aadb903
Interface to enable clients to send/receive REST requests/responses (#6866)
* Interface to enable clients to send/receive REST requests/responses

Description

Major changes:
1. Add RESTClient interface enabling client to send/receive REST HTTP
   requests. Support REST APIs are: get, head, put, post, delete, trace
2. Add RESTUtil file introducing below interfaces:
 2.1. RESTUrl - Extract URI information: host, service, request-parameters.
 2.2. RESTConnectionPool-
      Connection establishment, life-cycle management, connection-pool (TTL)
 2.3. RESTClientKnobs - supports REST Knob parameter management and updates

Testing

Unit test - fdbrpc/RESTClient, fdbrpc/RESTUtils
2022-04-27 12:17:52 -07:00
Sagar Vemuri
d013ff7457 Remove unnecessary include 2022-04-27 11:27:19 -07:00
Sagar Vemuri
ed60afc964 Handle versionstamped keys, and include additonal trace information 2022-04-27 11:12:01 -07:00
LukasMol
f4fb45abac tests/ black code reformat 2022-04-27 17:01:20 +02:00
Vaidas Gasiunas
6f841446a5 API Tests: Enable client logs. Dump out the logs in case of an error 2022-04-27 10:02:20 -04:00
Vaidas Gasiunas
d021b404ea ApiTester: Fix error code handing in case of a timeout 2022-04-27 10:02:20 -04:00
Junhyun Shim
1ee7702779
Merge pull request #6489 from sfc-gh-jshim/mako-cpp-async
Refactor Mako for C++ and add asynchronous execution support
2022-04-27 10:49:21 +02:00
greid
508ee73f86 Fix compile errors in Java tutorial code
Use CompletableFuture::join instead of CompletableFuture::get
when blocking on futures in java tutorial snippets. This avoids
the unreported checked exceptions which prevent the snippets from
compiling (and is in line with the full tutorial code).
2022-04-26 14:10:05 -07:00
Sagar Vemuri
fd993df807 Minor cleanup 2022-04-26 13:52:38 -07:00
Sagar Vemuri
35baf4d745 Validate commit request tenant prefixes on commit proxy 2022-04-26 13:28:29 -07:00
Andrew Noyes
9f8e2a4517
Test compiling an fdb_c app in pkg_tester (#6940)
* Use execstack to test executable stack permissions

The output of readelf wasn't stable

* Tee output to stdout in pkg_tester "run" function

* Test compiling an app that includes fdb_c.h

Featuring both cmake and pkg_tester, since we intend to support those in
our packages.

* Fix packaging bug

The libdir in the pkg-config file in the packages was wrong
2022-04-26 11:54:52 -07:00
Jingyu Zhou
23b51e34fd Fix spurious test failure
The timed_out error, if happens, could cause the test to fail, even though
there is nothing wrong with the database.
2022-04-26 09:40:43 -07:00
LukasMol
50ec536c1b tests/pythonÂ_tests make Python files Pythonic 2022-04-26 17:28:12 +02:00
LukasMol
1771869167 made merge Pythonic + fixed func and var identical name 2022-04-26 15:16:50 +02:00
Junhyun Shim
2f9506f5cd Introduce hard cap to latency sampling & apply clang format 2022-04-26 11:19:48 +02:00
Junhyun Shim
81211989f1 Disable new sample collection after first bad_alloc
- Add more info to --async_xacts description
- Clean up unused macro in fdb_api.hpp
2022-04-26 10:54:39 +02:00
Vaidas Gasiunas
e44a906c4b
Merge branch 'main' into fix/make-code-pythonic 2022-04-26 10:48:23 +02:00
Steve Atherton
fe338ced8f
Merge pull request #6896 from sfc-gh-mpilman/features/validate-trace-events-in-simulation
Reduce excessive tracing and fail after 1M traces
2022-04-25 18:02:59 -07:00
Markus Pilman
cbe4a873d2 Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-25 17:39:29 -06:00
Jon Fu
a5e52c9450 Merge branch 'main' of github.com:apple/foundationdb into jfu-list-tenants 2022-04-25 14:56:20 -04:00
Renxuan Wang
ec95fb7e74 Disable hostname in simulations.
Hostnames are causing simulation failures. Turn on again in #6926.
2022-04-25 11:05:25 -07:00