1677 Commits

Author SHA1 Message Date
Markus Pilman
03d913a1de Flow compiling 2022-06-27 17:05:55 -06:00
Markus Pilman
a47ed89018 Linux fixes and addressed review comments 2022-06-23 20:52:13 -06:00
Markus Pilman
38e100ebc5 flow bindings are compiling 2022-06-23 19:06:05 -06:00
Markus Pilman
d35445a868 enforce include modularization in cmake 2022-06-23 14:37:35 -06:00
Vaidas Gasiunas
e28a8401fb
Update coordinator list from cluster file (#7382)
* Log failed connection attempts in monitorProxies

* Update coordinator list from the cluster file after failing to connect to all coordinators

* Wiggle and upgrade test with legacy version monitoring; updating tests to use 7.1.9

* Update coordinator list from the cluster file: addressing review comments

* Update coordinator list from the cluster file: addressing review comments

* Wait on future for all setAndPersistConnectionString calls
2022-06-23 09:22:09 +02:00
Josh Slocum
34e6a8f942
Merge pull request #7399 from sfc-gh-jslocum/bg_tenant_improvements
Bg tenant improvements
2022-06-17 11:19:41 -05:00
Josh Slocum
1cc466e068 fixes and review comments 2022-06-17 08:17:44 -05:00
sfc-gh-tclinkenbeard
111e28d0ea Merge remote-tracking branch 'origin/main' into fix-unused-var 2022-06-16 17:20:18 -07:00
Josh Slocum
b3597ef3a8 Added plumbing for tenant-aware purge granules 2022-06-16 13:04:34 -05:00
Jon Fu
06c8f9068e fix arg parse ordering 2022-06-14 16:45:58 -07:00
Jon Fu
184c266bdf adjust rows calculation after parsing all arguments but before validation 2022-06-14 16:34:39 -07:00
Jon Fu
6999ebc86f When provided tenants, divide number of rows by number of tenants. Adjust population and range reads to account for this scenario 2022-06-14 16:22:07 -07:00
Hao Fu
9cee4c94e7
Safely remove fdb_transaction_get_range_and_flat_map (#7314) 2022-06-13 19:05:00 -07:00
Andrew Noyes
2a8d8a1932
Fix more heap overflows (#7360)
From calling strlen on a not necessarily null-terminated buffer.
2022-06-13 13:13:05 -07:00
sfc-gh-tclinkenbeard
13efda66fd Fix -Wunused-but-set-variable warning in DDSketchBase::percentile 2022-06-13 10:18:31 -07:00
Junhyun Shim
631a59a65e
Merge pull request #7299 from sfc-gh-mdvorsky/mdvorsky/remove_tester_api_wrapper
Remove TesterApiWrapper, replace its uses with fdb_api.hpp
2022-06-09 10:42:05 +02:00
Robert Barabas
8606923da2
Arm64 related build fixes (#7319)
* Add missing include

* Fix open call on arm64

* Bump up doctest to 2.4.8
2022-06-08 11:20:27 -07:00
Andrew Noyes
07f49392ac
Avoid using structured bindings in doctest assertions (#7335)
* Avoid using structured bindings in doctest assertions

clang doesn't allow this with the latest releases of doctest

This will unblock #7319

* Add constructor to MappedKV
2022-06-08 09:36:18 -07:00
Andrew Noyes
e0eedc6a37
Fix asan message detection (#7338)
* Fix asan message detection

* Fix heap-buffer-overflow

Call to strlen on a not necessarily null terminated string

* Fix gcc build
2022-06-08 09:35:30 -07:00
Marian Dvorsky
21b041317c Address review comments 2022-06-08 16:45:29 +02:00
Ray Jenkins
5a4082bfe8
Add DistributedTracerClient enum to mako. (#7297) 2022-06-07 14:07:08 -05:00
A.J. Beamon
c97a1168cb Fix formatting issue 2022-06-07 08:51:10 -07:00
A.J. Beamon
0431635674
Merge branch 'main' into jfu-mako-tenant-support 2022-06-07 08:43:56 -07:00
Kevin Hoxha
e579038018
Add DDSketch to mako (#7167)
* Add logic for DDSketch in mako

* Return double from percentile() and fix crash in deserialize()

* make sure to serialize and print result from mergeSketchReport()

* clean up comments

* move ddsketch into its own file

* remove LatencySampleBin and add DDSketch to ThreadStatistics

* Update DDSketch implementation

* remove assertions that cause circular references

* add DDSketchMako as a subsclass from DDSketch

* Merge branch 'ddsketch_mako' of github.com:sfc-gh-khoxha/foundationdb into ddsketch_mako

* Revert "Merge branch 'ddsketch_mako' of github.com:sfc-gh-khoxha/foundationdb into ddsketch_mako"

This reverts commit cc29a68aefd1b385b563bfbaa09a32e399c0d233.

* add ddsketch mako class and rename export flag

* remove redundant decimal roundings

* print max/min/avg from ddsketch

* remove latency sample bin completly

* Make ThreadStatistics dump latency to a file and read from file in printReport()

* make sure to add latency data from file to final stats

* change mergeSketchReport to use new ThreadStatistics serialization (1)

* use C-style string arrays in Arguments instead of std::string

* remove unused header

* only serialize non-empty sketches

* fix CentOS build error

* Update report file count properly

* avoid deserializing empty sketches

* fix segmentation fault when getting file name for export_sketch_path

* make sure to properly add file to report_files list

* fix printing bugs when running in report mode

* fix incorrect insertion of report files

* don't use range based loop for char array

* don't reset args.num_report_files

* Update the usage info for new options

* switch to using std::vector for sketches instead of std::array

* make sure to use true/false instead of 1/0 for booleans

* remove op_name if not being used

* remove fp code in dumpThreadSamples

* replace lambda with function in printReport

* merge and print stats in seperate functions

* make sure to exit after printing report

* address review feedback

* make defaultMin, defaultMax static and move setBucketSize to protected

* switch to reverse iterators when moving backwards along bucket array
2022-06-06 18:19:31 -07:00
Clement Pang
043bc411ee
Make KeyArrayResult constructor public. (#7308) 2022-06-06 13:15:33 -07:00
Marian Dvorsky
f887e3e364 Address review comments 2022-06-06 16:29:42 +02:00
Hao Fu
96d3951205
Fix versionstamp in Tester (#7312) 2022-06-03 08:56:01 -07:00
Marian Dvorsky
d41ec69b23 Remove TesterApiWrapper, replace its uses with fdb_api.hpp 2022-06-03 11:55:33 +02:00
Hao Fu
e7fa8e9f6f
Add versionstamp support in tuple (#7293)
Tuple in C++ needs to support Versionstamp.
2022-06-02 17:44:10 -07:00
Junhyun Shim
3e79735b2f
Authz JWT support (#7279)
* Add JWT support to TokenSign

* Encapsulate OpenSSL public/private key type

Type-safe passing around of keys without having to DER/PEM-serialize
(OpenSSL doesn't have distinct types for public and private key)

* Apply Clang format

* Add verify benchmark for JWT and FlatBuffers token

* Unit test base64url::{encode, decode}

* Make all payload fields optional

Let user code validate non-signature fields

* Make all payload fields optional

Completely defer field check to user code

* Move rapidjson from fdbclient to contrib

* Make fdbrpc's rapidjson linkage private

Currently only sources include them.

* Modify rapidjson path in apiversioner.py

* Algorithm::Unknown > Algorithm::UNKNOWN
2022-06-02 13:22:50 +02:00
Marian Dvorsky
138618eef9
Include symbols from fdb_c_internal.h to C bindings client library for Apple platform (#7292) 2022-06-01 14:04:53 -07:00
A.J. Beamon
526d8b217e Fix formatting issues 2022-05-31 11:37:52 -07:00
A.J. Beamon
ee3508c2f8 Address review comments. Primarily, this changes Tenant creation to be done via a method call on Database. 2022-05-31 11:19:02 -07:00
Junhyun Shim
f76d2454f5
Correctly wait on onError() future
Currently Mako worker thread waits on the original future that produced the error. Not the future returned by onError. Fix this.
2022-05-27 23:36:33 +02:00
Jon Fu
3bf4a8d521 move transaction creation to outside outer populate loop 2022-05-27 15:59:57 -04:00
Jon Fu
55972ca07e address code review comments 2022-05-27 10:57:57 -04:00
Jon Fu
8a7a8d0d59 delete tenants in memory when workload is done running 2022-05-26 17:14:41 -04:00
Jon Fu
8180414b4a remove printf debugging statements 2022-05-26 16:51:31 -04:00
Jon Fu
c6ac9cf2a5 Merge branch 'main' of github.com:apple/foundationdb into jfu-mako-tenant-support 2022-05-26 16:29:52 -04:00
Jon Fu
ddda238c01 fix issues with tenant creation/deletion and temporary tenants and strings 2022-05-26 16:29:16 -04:00
Jon Fu
01fa56630a WIP commit attempting to solve some tenant open and deletion issues 2022-05-26 14:55:59 -04:00
Jon Fu
c24970915f fix off-by-one error 2022-05-25 12:16:15 -04:00
Jon Fu
f25450ddd8 keep tenants in memory when running workload and introduce tenants to async run 2022-05-25 11:23:58 -04:00
Lukas Joswiak
18f80256b0 Add versionepoch fdbcli tests
Also removes the old targetversion fdbcli tests, as this command has
been removed (at least for now).
2022-05-23 11:45:18 -07:00
Junhyun Shim
02b2f97e99
mTLS test helpers (#7218)
* Add TLS option to (local_cluster|tmp_cluster).py

* Add TLS-enabled C API test
2022-05-23 12:47:51 +02:00
Kao Makino
a9d62ea031
Merge pull request #7169 from sfc-gh-khoxha/main
Use correct transaction latency in async mako
2022-05-20 15:49:39 -07:00
Chaoguang Lin
5e8c3130e6 Extend the reboot interface to accept comma-delimited string;
Only fetch requested worker interfaces in rebootWorkerActor
Add killall test to multiprocess_fdbcli_tests
Make the rebootWorker only sends requests if all the requested workers are valid
Add comments; Organize print texts; Fix the bug clear the map every time run kill/suspend/expensive_data_check
2022-05-20 12:06:33 -07:00
Jon Fu
8ae951079f remove extra space for CI formatting 2022-05-20 13:28:26 -04:00
Jon Fu
612b94efa3 remove tenant_main arg and use CharsRef in error message format 2022-05-20 13:16:49 -04:00
Jon Fu
b92b3b21b0 Refactor Tenant class in fdb_api header to match conventions of existing classes and move tenant creation into populate function 2022-05-20 13:03:59 -04:00