57 Commits

Author SHA1 Message Date
Markus Pilman
0906afbbf7 Add coverage file to correctness package 2020-10-22 13:49:53 -06:00
Markus Pilman
c7324761c1 pass the library path to Java tests 2020-09-25 09:38:33 -06:00
Markus Pilman
33d6c412c1 return error code correctly and cmake fixes 2020-09-24 15:58:41 -06:00
Markus Pilman
4c25214085 Add ability to run tests on fdb in ctest 2020-09-24 15:43:05 -06:00
Alex Miller
878254497a Merge remote-tracking branch 'upstream/master' into toml-testspec 2020-07-19 22:18:31 -07:00
Alex Miller
eb7ad07df0 Final cleanups. 2020-07-12 19:53:44 -07:00
Alex Miller
2841efe938 Rewrite most .txt tests into (pretty) .toml files.
This includes build/txt-to-toml.py which did the rewrites, and
can be used to rewrite other no-in-tree test spec files to toml.

I didn't touch status or restarting tests yet.  Restarting will be handled
later.  It turns out that I don't understand how status tests work.
2020-07-12 14:47:40 -07:00
A.J. Beamon
970c6d02be Fix: correctness packages included removed/future tests 2020-06-18 15:59:08 -07:00
A.J. Beamon
f9d96225ab Use add_custom_command instead of file(COPY ...) when copying external files into correctness packages 2020-05-27 11:34:15 -07:00
A.J. Beamon
cb119c76d7
Don't use non-existent variables
Co-authored-by: Markus Pilman <markus.pilman@snowflake.com>
2020-05-27 10:25:13 -07:00
A.J. Beamon
9656542cca Create the bin directory in the correctness staging directories 2020-05-22 10:10:34 -07:00
A.J. Beamon
56e14a25fe Normal correctness package can be built when USE_VALGRIND is on. Correctness and valgrind now stage their files in separate directories. Add CMakeCache.txt to testing packages. 2020-05-21 13:35:54 -07:00
Alex Miller
378951360d
Merge pull request #3086 from alexmiller-apple/ctest-use-crash
Make ctest use --crash when running simulation tests.
2020-05-05 12:49:21 -07:00
Alex Miller
f040694bf0 Make ctest use --crash when running simulation tests.
So that tests with ASSERTion failures don't cause CI to run slow and
produce massive logs.  There's also rarely a reason to continue through
assertion failures.
2020-05-05 03:11:09 -07:00
A.J. Beamon
1bcbb98656
Merge pull request #3040 from vishesh/issue-3029
cmake: Copy generated files to bindingtester bundle
2020-04-30 08:15:13 -07:00
Evan Tschannen
ddb8515b89
Merge pull request #3042 from mpilman/features/filter-correctness-tests
Added possibility to include and exclude tests
2020-04-29 10:43:41 -07:00
Vishesh Yadav
fab4d698dc build: Add JAR and Go's _stacktester to bindingtester bundle 2020-04-29 00:10:18 -07:00
Vishesh Yadav
17221b3e9a cmake: Copy generated files to bindingtester bundle
Source generated by vexilographer were not copied into bindingtester. This patch
manually adds those files in `cmake/AddFdbTest.cmake`, since there doesn't seem
to be any easy way to make bindingtester script know about these generated
files (except copying these files to source directory).

FIXES #3029
2020-04-29 00:10:18 -07:00
Markus Pilman
50ad4a33fe Added possibility to include and exclude tests
Description

Testing
2020-04-28 16:19:04 +00:00
Markus Pilman
3024162196 Don't create package directories in source dir
This fixes one part of #2973
2020-04-22 11:55:26 -07:00
mpilman
7aa030a850 fix weird typo 2020-04-13 21:08:48 -07:00
mpilman
f0ab168368 attempt on fixing make bug 2020-04-13 20:34:09 -07:00
Markus Pilman
e004d912bd Also depend on Joshua scripts 2020-04-10 18:23:29 -07:00
Markus Pilman
4b5fdef976 fix correctness dependencies 2020-04-10 18:16:52 -07:00
Alvin Moore
cbcd0abdc0 Fixed the creation of binding test package 2020-03-31 18:40:25 -07:00
Markus Pilman
644e0ff30b Use full version string in package names 2020-03-27 09:47:37 -07:00
Markus Pilman
0f224ead7a fixed formatting 2020-03-27 09:38:20 -07:00
Markus Pilman
c5191f5c51
Update cmake/AddFdbTest.cmake
Co-Authored-By: Alvin Moore <36203359+AlvinMooreSr@users.noreply.github.com>
2020-03-27 09:36:57 -07:00
Markus Pilman
ce318c18fa
Update cmake/AddFdbTest.cmake
Co-Authored-By: Alvin Moore <36203359+AlvinMooreSr@users.noreply.github.com>
2020-03-27 09:36:46 -07:00
Markus Pilman
893a38008c
Update cmake/AddFdbTest.cmake
Co-Authored-By: Alvin Moore <36203359+AlvinMooreSr@users.noreply.github.com>
2020-03-27 09:36:38 -07:00
Markus Pilman
55e5d5b4d9
Update cmake/AddFdbTest.cmake
Co-Authored-By: Alvin Moore <36203359+AlvinMooreSr@users.noreply.github.com>
2020-03-27 09:36:30 -07:00
Markus Pilman
def7f39328
Update cmake/AddFdbTest.cmake
Co-Authored-By: Alvin Moore <36203359+AlvinMooreSr@users.noreply.github.com>
2020-03-27 09:36:08 -07:00
Markus Pilman
ac9f79116e Build bindingtester 2020-03-26 16:01:58 -07:00
Markus Pilman
99e4bb92c0 Generate valgrind tar file for Joshua 2020-03-26 14:02:21 -07:00
Markus Pilman
c095d26830 include joshua scripts 2020-03-26 13:52:18 -07:00
Markus Pilman
74f21c831c fixed correctness tar name 2020-03-26 13:45:12 -07:00
mpilman
7fe56ccb00 always build correctnes package 2020-03-25 18:01:08 -07:00
mpilman
ce6c4cb8d8 Build and package TestHarness 2020-03-25 17:36:47 -07:00
Markus Pilman
653b180004 make it work if external dir has trailing / 2019-11-08 23:13:32 +00:00
Markus Pilman
94791fbd12 remove this functionality from Windows
Windows file paths are a pain to work with. Currently I don't know
of anyone who needs this feature on Windows - so I just remove it there
2019-11-08 22:21:47 +00:00
Markus Pilman
01c2676152 Add feature to add external dependencies to test package 2019-11-08 22:15:38 +00:00
Markus Pilman
d0d036b3a7 Add cmake command to package tests 2019-11-08 21:39:21 +00:00
negoyal
fe53b5e7a7 Add a parameter to enable/disable valgrind for ctest. 2019-08-15 11:56:34 -07:00
mpilman
1ac2d01b03 Merge remote-tracking branch 'upstream/master' into flatbuffers-fixes2 2019-07-18 09:50:08 -07:00
dyoungworth
baf8e020d1 use one index to track tests in ctest 2019-07-15 14:52:24 -07:00
Andrew Noyes
274cb40eb8 Run tests under valgrind when USE_VALGRIND 2019-07-11 23:03:31 -07:00
dyoungworth
62d7ee9424 Fix ctests so each restart test has a seed unique to the first test
and any other test
2019-07-11 09:56:51 -07:00
Alex Miller
30b27349a7 Fix addFdbTest 2019-06-25 21:57:09 -07:00
sramamoorthy
8370871e4c stale RESTORE option related code removed 2019-05-28 22:07:46 -07:00
sramamoorthy
281c785f94 '--restoring' cmd line arg removed for fdbserver
'--restoring' command line option was introduced to indicate
simulated fdbserver to restore from snapshot and restart the cluster.
As part of this change that option is removed and restore
information is stored in the restartInfo.ini.
2019-05-28 22:07:46 -07:00