18592 Commits

Author SHA1 Message Date
Vaidas Gasiunas
1e75ffd880 ApiTester: Options to run each transaction in new database & to execute callbacks on external threads 2022-03-04 18:34:36 +01:00
Vaidas Gasiunas
20c1e893c7 ApiTester: fix build dependencies 2022-03-04 17:22:30 +01:00
Vaidas Gasiunas
ef96231db0 Merge remote-tracking branch 'apple/main' into vgasiunas-system-tester 2022-03-04 16:25:18 +01:00
neethuhaneesha
49bd0c34cc
Merge pull request #6493 from neethuhaneesha/rocks-compaction
RocksDB increasing background threads to speedup compaction.
2022-03-04 07:24:19 -08:00
Vaidas Gasiunas
b8386f15d6 ApiTester: configuration for ApiCorrectness workload; Better error handing and reporting 2022-03-04 16:22:49 +01:00
Andrew Noyes
0ff13c1bb6
Allow for mako tmp directory to already exist (#6494) 2022-03-03 18:07:29 -08:00
Xiaoxi Wang
6024bf0109
Merge pull request #6482 from sfc-gh-xwang/ppw-status
Print the IP:Port address of wiggling server in status
2022-03-03 15:50:58 -08:00
Neethu Haneesha Bingi
83e0368eaa RocksDB increasing background threads to speedup compaction. 2022-03-03 15:14:37 -08:00
Vaidas Gasiunas
5d15a2d623 ApiTester: Loading test configuration from files, calling from ctest 2022-03-03 15:01:05 +01:00
Trevor Clinkenbeard
e7a82b68f2
Merge pull request #6486 from sfc-gh-tclinkenbeard/fix-commitlatencybands-sample
Fix name of `ProxyCommitData::commitLatencyBands` sample
2022-03-02 16:24:19 -08:00
sfc-gh-tclinkenbeard
8b2b74980e Fix name of ProxyCommitData::commitLatencyBands sample 2022-03-02 14:57:42 -08:00
Xiaoxi Wang
887d5a25cb add storage wiggle to status 2022-03-02 11:31:55 -08:00
Xiaoxi Wang
e73c0a31e6 add wiggle_server_ids and wiggle_server_addresses in status json 2022-03-02 10:03:23 -08:00
Andrew Noyes
9a45df8e6c
Change fdb_c's dep on fdbclient to be private (#6466)
That way transitive dependencies (e.g. libfdb_java.so) don't include
unnecessary fdbclient code. Related: #6455
2022-03-01 18:08:50 -08:00
Vaidas Gasiunas
9f520ae8eb ApiTester: testing clear & clearRange 2022-03-01 20:58:52 +01:00
A.J. Beamon
1ab963eb5b
Merge pull request #6477 from sfc-gh-ajbeamon/trace-overflow-debug-line
Add some extra print debugging if we overflow the trace buffer
2022-03-01 10:12:09 -08:00
Josh Slocum
92a888910f Fix many repeated recruitment bug 2022-03-01 12:00:53 -06:00
Vaidas Gasiunas
e3de8c6847 ApiTester: Prepopulating database; commit-read operation for testing GRV correctness 2022-03-01 18:33:46 +01:00
A.J. Beamon
beac368ba9 Add a mechanism to enable error backtrace logging for select errors 2022-03-01 09:11:21 -08:00
A.J. Beamon
f6b24cd644 Add some extra print debugging if we overflow the trace buffer. 2022-03-01 09:04:15 -08:00
Renxuan Wang
fa2eee8279 Use PRId64 and PRIu64 to replace lld and llu.
This fixes https://github.com/apple/foundationdb/pull/6148#issuecomment-1054575608.
2022-02-28 21:30:14 -08:00
Xiaoge Su
5e39da7741 fixup! Reformat the source 2022-02-28 18:03:52 -08:00
Xiaoge Su
02e396274f Fix the compile error on NativeAPI.actor.cpp 2022-02-28 18:03:52 -08:00
Zhe Wu
aadd706a0a Port back addressed comments for fixing get key location issue 2022-02-28 16:08:57 -08:00
zhenfeng yang
847cff72b7
Add a target to generate profile (#6396)
add a target to generate profile
2022-02-28 17:00:30 -06:00
Andrew Noyes
2e8bce04c6 Remove brittle fdbcli help text snapshot test
This seems to be more trouble than value so far.
2022-02-28 15:24:29 -06:00
Andrew Noyes
24f37aceb7 Avoid conflict between versioned client/server rpms
Building locally this seems to cause a conflict between the versioned
client and server rpms. Not sure why this doesn't always show up.
2022-02-28 15:24:29 -06:00
Andrew Noyes
d559caefea Use centos:7 for pkg_tester
yum update with just `centos` seems to have problems
2022-02-28 15:24:29 -06:00
Trevor Clinkenbeard
fe957deef8
Merge pull request #6399 from sfc-gh-bvr/fdb#4271
Introduce a new server knob and use it to test if storage servers are…
2022-02-28 13:02:23 -08:00
Vaidas Gasiunas
328c5dad28 Merge remote-tracking branch 'apple/main' into vgasiunas-system-tester 2022-02-28 20:00:55 +01:00
Vaidas Gasiunas
e89eba3b15 ApiTester: Apply client knob settings 2022-02-28 20:00:27 +01:00
Vaidas Gasiunas
99f210e198 ApiTester: Buggify option; Fixing transaction executor in error paths 2022-02-28 19:01:31 +01:00
Vaidas Gasiunas
bd1bf72304 ApiTester: Test mixed insert/get workload; support concurrent execution of multiple gets 2022-02-28 16:05:00 +01:00
sfc-gh-tclinkenbeard
90927cffe9 Set disableHostname=true in CycleTestRestart downgrade test 2022-02-26 17:56:56 -08:00
Renxuan Wang
233c918ffb Replace printf() and fprintf() with fmt::print(). 2022-02-25 19:06:57 -08:00
Renxuan Wang
f7eb66441d Try eliminating warnings in macOS and Windows CI builds.
MacOS warnings are format warnings, e.g., `format specifies type 'long' but the argument has type 'Version' (aka 'long long')`.
Windows warnings are `ACTOR does not contain a wait() statement`.
2022-02-25 19:06:57 -08:00
Markus Pilman
079de5ba57 Enable rocksdb unit tests 7.1.0-rc1 2022-02-25 15:38:16 -08:00
Markus Pilman
a61dd41b45 Add an empty test to make sure noSim tests succeed 2022-02-25 15:38:16 -08:00
Vaidas Gasiunas
3967f9ed14 ApiTester: Introduce workload manager 2022-02-26 00:09:37 +01:00
Vaidas Gasiunas
c3e6eea41a ApiTester: In memory key-value store 2022-02-26 00:08:21 +01:00
Andrew Noyes
276cf3a402
Fix minor bugs turned up by _GLIBCXX_DEBUG (#6375)
* Fix a benign bug turned up by _GLIBCXX_DEBUG

Just calling std::vector::operator[] with an out of bounds index at all
is technically undefined behavior.

* Fix compilation issue with _GLIBCXX_DEBUG

For some reason std::max with an initializer list isn't constexpr with
_GLIBCXX_DEBUG set
2022-02-25 13:50:41 -08:00
Andrew Noyes
b58739093e
Account for possibility that fopen might fail in mako (#6442)
Fix an issue in mako where the stats process would hang if the worker process
was unable to open a file. Previously, the worker process would segfault when
trying to dereference a null FILE* and never increment the stopcount variable
in shared memory. Now we check for a null FILE* and increment stopcount when
the worker process stops regardless of success or failure.

Also don't ignore the return value from mkdir
2022-02-25 13:18:59 -08:00
Andrew Noyes
7a9217a392
Add contrib/debug_determinism (#6389)
* Add contrib/debug_determinism

Add an instrumentation-based technique for debugging unseen mismatches. Also guard a few existing sources of nondeterminism that don't affect unseen with the DEBUG_DETERMINISM macro.

Also change the simulated run loop to not run as the only task inside the real run loop, since that was a source of nondeterminism.

Also fix nondeterminism from calling timer_int

* Add StorageMetadataType::currentTime

Basically a deterministic-in-simulation version of timer_int that we can
use instead of timer_int for StorageMetadataType::createdTime
2022-02-25 12:54:31 -08:00
Zhe Wu
57e931b489 Update 6.3.24 release notes 2022-02-25 12:12:17 -08:00
A.J. Beamon
d4e6123971
Merge pull request #6457 from Doxense/fix-6449-windows-build
Fix Windows build broken by #6449
2022-02-25 09:07:20 -08:00
Mohamed Oulmahdi
5b6098b5be Fix Windows build broken by #6449 2022-02-25 16:25:45 +01:00
Vaidas Gasiunas
64873b6873 ApiTester: Rename files and namespace 2022-02-25 11:35:57 +01:00
Renxuan Wang
06b1d06d38 Support hostname in coordinators commands. 2022-02-24 23:02:29 -08:00
Renxuan Wang
70d723f70c Move the construction of ConnectionString in changeQuorumChecker() to coordinatorsCommitActor(). 2022-02-24 23:02:29 -08:00
Renxuan Wang
3e761aef3b Add resetConnectionString() function to ClusterConnectionString. 2022-02-24 23:02:29 -08:00