199 Commits

Author SHA1 Message Date
Andrew Noyes
7a9217a392
Add contrib/debug_determinism (#6389)
* Add contrib/debug_determinism

Add an instrumentation-based technique for debugging unseen mismatches. Also guard a few existing sources of nondeterminism that don't affect unseen with the DEBUG_DETERMINISM macro.

Also change the simulated run loop to not run as the only task inside the real run loop, since that was a source of nondeterminism.

Also fix nondeterminism from calling timer_int

* Add StorageMetadataType::currentTime

Basically a deterministic-in-simulation version of timer_int that we can
use instead of timer_int for StorageMetadataType::createdTime
2022-02-25 12:54:31 -08:00
Steve Atherton
f995b4a502 Merge branch 'main' of https://github.com/apple/foundationdb into redwood-bug-fixes-and-memory-leak 2022-02-18 18:44:28 -08:00
Steve Atherton
31ed478488 Invert sort order of periodic memory usage dumps to make looking at live output easier. 2022-02-17 16:03:33 -08:00
Josh Slocum
38a75a8b89 Merge branch 'main' into blob_integration 2022-02-17 17:47:38 -06:00
Josh Slocum
fc0c0ac21e script for debugging MemSample traces 2022-02-17 16:09:05 -06:00
Andrew Noyes
00ceaeb1b3 Move generated part of Program.cs to its own file
This way editors/tools will understand that it's a c sharp file
2022-02-07 13:28:06 -08:00
Andrew Noyes
4bf14e6c47
Create joshua package from ctest tests (#6237)
* Add ctest_to_joshua.py

* WIP

* Normalize python3

* set -euxo pipefail

* Strip binary files

* Remove unnecessary file copy

* Redirect stderr to stdout

* Fix syntax

* Set BASH_XTRACEFD=1
2022-02-03 15:07:41 -08:00
Andrew Noyes
f4b0de7a56 Add support for 7.0 and 7.1 in transaction_profiling_analyzer
I painstakingly went through both transaction_profiling_analyzer.py and
fdbclient/ClientLogEvents.h to make sure that we really can read these
versions.
2022-01-19 14:00:21 -08:00
A.J. Beamon
496000477c
Merge pull request #6144 from sfc-gh-ajbeamon/unify-flags
Convert command line arguments to use hyphens rather than underscores
2021-12-15 10:47:32 -08:00
A.J. Beamon
ca47b436ac
Apply suggestions from code review
Co-authored-by: Markus Pilman <markus.pilman@snowflake.com>
2021-12-14 14:44:20 -08:00
A.J. Beamon
30e2c2d9a6 Don' use new-style arguments in test harness. 2021-12-14 12:31:12 -08:00
A.J. Beamon
f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
Andrew Noyes
66b387916a Add test for correct permissions for libfdb_c execstack 2021-12-09 17:15:22 -08:00
Aaron Molitor
77db63274b use FDB_VERSION in lieu of PROJECT_VERSION or CMAKE_PROJECT_VERSION
write FDB_VERSION to a file to avoid regex golf in other build scripts
2021-11-29 15:11:20 -08:00
Steve Atherton
8a6df5c31c Remove unsupported .clang-format setting. 2021-11-17 09:59:38 -08:00
Markus Pilman
b1633b90f1 Added fmt to flow 2021-11-16 12:03:49 -07:00
Josh Slocum
7492a9e7d7 fixing fdbcli packages 2021-10-22 11:58:10 -05:00
Chaoguang Lin
0d1382eeba Add comments for the change 2021-09-03 14:32:27 -07:00
Chaoguang Lin
56ed0f3b9c Return if no available binary in the given range 2021-09-03 14:21:16 -07:00
Chaoguang Lin
8622363395 Simplify the condition and update the comment 2021-09-02 18:51:39 -07:00
Chaoguang Lin
3ad620b2df Update comment to be more clear 2021-09-02 18:13:04 -07:00
Chaoguang Lin
e7028b7915 Handle the edge case correctly when the upper bound version is less than the binary verion 2021-09-02 17:42:46 -07:00
Chaoguang Lin
82e1e850c2 Add syntax until_*.*.* in restarting test to specify upper bound of binary version 2021-09-02 14:07:15 -07:00
Andrew Noyes
cbd0c33e13 Try using less privileges in for running systemd 2021-08-24 17:40:44 +00:00
Andrew Noyes
97568645a1 Move .venv to main .gitignore 2021-08-19 20:25:18 +00:00
Andrew Noyes
82d0ef705d Tests pass for versioned packages 2021-08-19 16:32:22 +00:00
Andrew Noyes
8bbcfca8a0 Run all tests for versioned packages 2021-08-19 16:32:22 +00:00
Andrew Noyes
505ba2fc42 Works for ubuntu 2021-08-19 16:32:22 +00:00
Andrew Noyes
357c3ca2f8 Add simple test for versioned packages 2021-08-19 16:32:22 +00:00
Andrew Noyes
1bc944e8b9 Add development header to readme 2021-08-19 16:32:22 +00:00
Andrew Noyes
f42e8d2407 Typing fixes found with mypy 2021-08-19 16:32:22 +00:00
Andrew Noyes
b425d495cf Mention potential leaked containers 2021-08-19 16:32:22 +00:00
Andrew Noyes
1e202da08d Reduce likelihood of leaking containers/images 2021-08-19 16:32:22 +00:00
Andrew Noyes
a62f84b84a Basic tests for rpm and deb packages 2021-08-19 16:32:22 +00:00
Jingyu Zhou
fffb0d6fb9
Merge pull request #5305 from sajjadrahnama/test_harness_buggify_fault_injection
Test harness Buggify/FaultInjection argument
2021-07-30 09:15:59 -07:00
Sajjad
5b191fccfe
Update contrib/TestHarness/Program.cs.cmake - Minor change
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2021-07-29 23:18:15 -07:00
Sajjad Rahnama
12e1a5fe92 TestHarness Buggify/FaultInjection Enable/Disable - Update Old Binaries arguments 2021-07-29 11:26:14 -07:00
Steve Atherton
b3e22ad573 Move stderr exception checking so that ignored output does not count against the error limit. 2021-07-26 18:10:03 -07:00
Sajjad Rahnama
c7ef116c12 TestHarness Buggify/FaultInjection Enable/Disable 2021-07-26 16:44:10 -07:00
Steve Atherton
ff8a1e0ed2 Ignore warning from valgrind about F_SET_RW_HINT usage. 2021-07-26 16:37:55 -07:00
Steve Atherton
26d886c600
Merge pull request #5227 from sfc-gh-satherton/redwood-io-priority
Add Priority to Redwood IO, also fixes several bugs with the recent Redwood metrics changes
2021-07-20 16:50:58 -07:00
Steve Atherton
09a8561606 Merge branch 'master' of github.com:apple/foundationdb into redwood-io-priority
# Conflicts:
#	fdbserver/IPager.h
#	fdbserver/VersionedBTree.actor.cpp
2021-07-18 01:49:36 -07:00
Oleg Samarin
97bcb16000 Fixed formatting 2021-07-14 19:24:04 +03:00
Oleg Samarin
e97fb31d9b Added some comment 2021-07-14 17:46:15 +03:00
Oleg Samarin
04549c59ed Fixed 'NoTraceFileGenerated' error in simulation tests when fdbserver process could not start 2021-07-14 17:41:08 +03:00
Aaron Molitor
c5a9ff02a9 move file out of build directory 2021-07-12 13:06:29 -07:00
Daniel Smith
efdda3cd0e Revert "Revert "Add support for running non-simulation tests on Joshua"" 2021-06-15 14:15:02 -04:00
Daniel Smith
549cf0512b
Revert "Add support for running non-simulation tests on Joshua" 2021-06-14 19:23:56 -04:00
Steve Atherton
3a70012c08
Merge pull request #4971 from Daniel-B-Smith/test-nonsim
Add support for running non-simulation tests on Joshua
2021-06-14 13:56:24 -07:00
Daniel Smith
8af0affeff Add support for running non-simulation tests on Joshua 2021-06-14 15:00:45 -04:00