78 Commits

Author SHA1 Message Date
Josh Slocum
83806b4a31 disable movekeys granule test and shift other granule tests around 2022-08-01 14:48:38 -05:00
Josh Slocum
1ea43aa878 Merge branch 'main' into improved_cf_testing 2022-07-26 18:12:58 -05:00
Josh Slocum
35056060b0 fixing specific unit test 2022-07-26 17:05:46 -05:00
Josh Slocum
0609aa57d1 Merge branch 'main' into improved_cf_testing 2022-07-26 16:44:13 -05:00
Josh Slocum
095a5a4868 First version of key-sorted delta files 2022-07-22 11:43:49 -05:00
Josh Slocum
3f8f44dd16 Merge branch 'main' into improved_cf_testing 2022-07-20 08:19:52 -05:00
Ankita Kejriwal
bb05321d24 Introduce storage quotas per tenant.
This change adds:
* ability to store the mapping from tenants to quota in the system keyspace,
* a setter and getter function
* a new workload to test this functionality

FDBCORE-2437
2022-07-14 16:35:12 -07:00
Josh Slocum
9831be866f Adding RandomMoveKeys blob granule cycle test and moving lower value fast/ tests to rare/ 2022-07-11 15:49:55 -05:00
sfc-gh-tclinkenbeard
df71a49bf6 Merge remote-tracking branch 'origin/main' into global-tag-throttling3 2022-06-13 10:03:10 -07:00
sfc-gh-tclinkenbeard
75c858eb2c Differentiate between different quotas in GlobalTagThrottling workload 2022-06-13 10:01:55 -07:00
Dan Adkins
bd47f390bd
Add simulation test for three_data_hall configuration (#7305)
* Add simulation test for 1 data hall + 1 machine failure case.

* Disable BUGGIFY for DEGRADED_RESET_INTERVAL.

A simulation test discovered a situation where machines attempting to connect
to a dead coordinator (with a well-known endpoint) were getting themselves
marked degraded. This flapping of the degraded state prevented recovery from
completing, as it started over any time it noticed that tlogs on degraded
hosts could be relocated to non-degraded ones.

bin/fdbserver -r simulation -f tests/rare/CycleWithDeadHall.toml -b on -s 276841956
2022-06-06 13:14:49 -07:00
sfc-gh-tclinkenbeard
2ae5a6c86b Add GlobalTagThrottling test 2022-06-03 13:12:48 -07:00
Xiaoxi Wang
a94be36e03 add test spec file 2022-05-06 09:42:37 -07:00
Lukas Joswiak
85da80a9ce Split ConfigIncrement workload
Adds a new ConfigIncrement workload that tests the ability of the
configuration database to remain correct under minority node data loss
situations.
2022-02-09 14:18:40 -08:00
Lukas Joswiak
d5a562e6b8 Fix dynamic knobs correctness issues 2022-02-09 13:43:32 -08:00
Mohamed Oulmahdi
f10b549bdf Remove Downgrade test
This test seems broken
2022-02-03 23:52:42 +01:00
A.J. Beamon
6affc58e97 Rename high contention allocator implementation in fdbclient 2022-01-31 14:25:38 -08:00
A.J. Beamon
027fe80594 Added a generic high contention allocator implementation to fdbclient. This is an adapted version of the flow bindings HCA implementation. 2022-01-28 15:34:30 -08:00
Markus Pilman
d6fad2e489 readded old tlog tests 2021-11-08 15:52:08 -07:00
Markus Pilman
648b9c97ab fixed stupid mistake 2021-11-08 15:47:32 -07:00
Markus Pilman
7df059570a Make sure unit tests are run often enough 2021-11-08 15:43:32 -07:00
A.J. Beamon
f78a68735a Add a specific unit test file for use by tooling. 2021-08-31 15:06:13 -07:00
sfc-gh-tclinkenbeard
6ecc38d22a Strengthen ConfigIncrement.toml test 2021-08-27 15:18:32 -07:00
sfc-gh-tclinkenbeard
288933bdf6 Add MachineAttrition to ConfigIncrement workload 2021-08-24 11:30:41 -07:00
sfc-gh-tclinkenbeard
9e7ed1f18c Randomize configuration database type for ConfigIncrement test 2021-08-24 11:08:06 -07:00
sfc-gh-tclinkenbeard
d8bdc972ba Only test simple configuration database in ConfigIncrement.toml
There are still some issues with the Paxos implementation that are
causing test failures at the moment.
2021-08-10 11:18:56 -07:00
sfc-gh-tclinkenbeard
c126e6239b Weaken ConfigIncrement.toml test
This test is not yet stable, so simplify the test in order to make
debugging easier.
2021-08-09 10:18:18 -07:00
sfc-gh-tclinkenbeard
f6b6e11d6a Support randomizing configuration database type in simulation 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard
cdbcb69d86 Add configuration database type to ISimulator 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard
6524dd1567 Add random sleep to ConfigIncrement workload 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard
7deb339a0c Added ConfigIncrement.toml test 2021-08-09 10:04:35 -07:00
Markus Pilman
64608fe86b allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
Steve Atherton
1c5013f6ec Removed btree cleanup parameter override. 2021-04-13 20:19:25 -07:00
Steve Atherton
7b08886caf Updated btree unit test name. 2021-04-07 18:29:17 -07:00
Steve Atherton
e7573d546f Some unit tests names had a prefixed "!" in order to be excluded from random selection, this has been changed to a ":" as it is less problematic on the command line. Some Redwood unit tests have been enabled for random selection. 2021-04-05 00:03:15 -07:00
sfc-gh-tclinkenbeard
45c9a0abc7 Revert "Revert "Add limiting health metrics""
This reverts commit 209ebcc5950fe246ee0a6b995dcbe9ecc2688c68.
2020-11-13 17:24:57 -08:00
Trevor Clinkenbeard
209ebcc595
Revert "Add limiting health metrics" 2020-11-13 17:08:46 -08:00
sfc-gh-tclinkenbeard
9bb93dadf1 Reenabled Throttling.toml test (as a rare test) 2020-11-13 11:34:32 -08:00
Xiaoxi Wang
f930f9bbb6 update toml test spec 2020-09-02 05:25:40 +00:00
Evan Tschannen
a49cb41de7 Merge branch 'release-6.3'
# Conflicts:
#	CMakeLists.txt
#	cmake/ConfigureCompiler.cmake
#	fdbserver/Knobs.cpp
#	fdbserver/StorageCache.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	flow/ThreadHelper.actor.h
#	flow/serialize.h
#	tests/CMakeLists.txt
2020-07-29 00:31:55 -07:00
Alex Miller
2841efe938 Rewrite most .txt tests into (pretty) .toml files.
This includes build/txt-to-toml.py which did the rewrites, and
can be used to rewrite other no-in-tree test spec files to toml.

I didn't touch status or restarting tests yet.  Restarting will be handled
later.  It turns out that I don't understand how status tests work.
2020-07-12 14:47:40 -07:00
sfc-gh-tclinkenbeard
10a4b8e321 Make Downgrade test rare 2020-07-09 17:52:41 -07:00
Alex Miller
17570b5b10 Make the testspec more restrictive in terms of what can be set where.
Testspec is currently very permissive in very misleading ways.  In particular,
the tester parser itself will swallow K=V settings and apply them at the test
level, which breaks how a person would expect the scoping to work.  Other
settings apply to the entire simulation run globally, but appear to be workload
specific.  Even further, others affect simulation cluster creation or test
harness behavior, but can again be set anywhere in a testspec.

This changes testspec parsing to error if a setting that applies globally is
anywhere but the top of the file, or if a setting that applies test-wide is
applied to a workload instead of a test.
2020-07-06 02:03:30 -07:00
A.J. Beamon
80a235aa80 Add some correctness tests 2020-05-04 10:15:18 -07:00
Stephen Atherton
9227de5c20 Redwood correctness unit test was using wallclock based time limit which breaks determinism. 2019-11-11 15:13:58 -08:00
Evan Tschannen
d8ea3dbf9a Added the ability to configure a cluster from a JSON file 2018-08-16 17:34:59 -07:00
Evan Tschannen
9c918a28f6 fix: status was reporting no replicas remaining when the remote datacenter was initially configured with usable_regions=2 2018-08-09 13:16:09 -07:00
Evan Tschannen
6d76ff67a3 added the connection string to status 2018-07-09 22:11:58 -07:00
Evan Tschannen
507b3bacb0 fix: kill all tlogs in one region prevents the remote logs from recovering in that region, do not allow that to prevent us from configuring usable_regions=1.
added more recovery states.
2018-07-05 00:08:51 -07:00
Evan Tschannen
866ccfe344 added the ability to allow the master to finish recovery before all storage servers in both regions have their mutations. This allows you to recover from scenarios where you lose all your tlogs in one dc. 2018-07-04 01:59:04 -04:00