13 Commits

Author SHA1 Message Date
Andrew Noyes
da1ffebcb0
Improve test harness logging when there are no trace files (#7785)
* Log OldBinary even if there are no trace files

DeterminismCheck and OldBinary attributes don't actually depend on
information in the ProgramStart event, so we can add them
unconditionally.

* Add JoshuaSeed attribute to Test element in test harness

* Add NoTraceFilesFound event in test harness

There's already something similar: NoTraceFileGenerated. It appears that
the original author only wants to log that if the process exited 0
though. I'm not sure what the reason for that is so I think it's safer
to add a new event. This will make it more clear if say an old binary is
corrupt.
2022-08-03 17:14:33 -07:00
Markus Pilman
92b1d1f647 Don't fail TestHarness if comment doesn't exist 2022-07-28 11:03:09 -06:00
Markus Pilman
3327ab395b Change test harness to include comments 2022-07-19 15:41:53 -06:00
Andrew Noyes
17140a2645 Always run valgrind on the binary under test (if valgrind is enabled) 2022-05-10 14:46:22 -07:00
Andrew Noyes
68c03a7e32
Jemalloc integration fixes (#6626)
* Set default for USE_JEMALLOC initially in ConfigureCompiler

Instead of trying to change the value later on. This fixes the valgrind
build, which was previously incorrectly getting jemalloc involved.

* Check aligned_alloc result for null

And OOM if so - don't assert

* Check that we can allocate magazines with no internal fragmentation

We may want to do this so that the jemalloc heap profiler has some
knowledge of FastAlloc

* Populate TestFile field for noSim tests in TestHarness

* Remove handling for nonexistent "ActualRun"
2022-03-17 15:17:27 -07:00
A.J. Beamon
00277140ec Non-simulated test harness runs don't check the unseed. 2022-03-17 11:09:14 -07:00
Andrew Noyes
00ceaeb1b3 Move generated part of Program.cs to its own file
This way editors/tools will understand that it's a c sharp file
2022-02-07 13:28:06 -08:00
Alvin Moore
c07aaf2d72 Removed Application config
Made TestHarness source file a cmake file
2020-08-07 12:03:35 -04:00
Alvin Moore
005b59cc84 Added support for storing and displaying version within TestHarness 2020-08-07 10:46:38 -04:00
sfc-gh-tclinkenbeard
369d1be562 Fixed test harness bug 2020-07-12 16:06:23 -07:00
sfc-gh-tclinkenbeard
949a17359a Added to_6.3.0 downgrade test to test harness 2020-07-09 14:29:43 -07:00
Evan Tschannen
a38a7fc8b4 updated copyright date 2020-03-20 10:15:33 -07:00
Evan Tschannen
d7ab4db2b8 added TestHarness and TraceLogHelper for assisting with automated simulation testing 2020-02-20 11:50:12 -08:00