93 Commits

Author SHA1 Message Date
Meng Xu
64c7155305 test:mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore temporarily 2020-10-15 15:24:58 -07:00
Meng Xu
ca486fdcd4 FastRestoreOldBackupTest:Revert workload time to 30s 2020-08-27 09:31:57 -07:00
Meng Xu
3d2b18b663 FastRestore:AtomicRestore:Add resetDBTimeout option 2020-08-26 10:21:17 -07:00
Meng Xu
a8bd628216 FastRestoreAtomicRestoreTest:Increase timeout from 2100 to 36000 2020-08-26 09:48:52 -07:00
Meng Xu
1b7a0d9b1d FastRestoreTest:Increase cycle test duration from 40 to 60s 2020-08-25 22:47:39 -07:00
Meng Xu
57584f41a0 FastRestoreOldBackup:Change backup latency from 60 to 40s 2020-08-25 10:42:28 -07:00
Meng Xu
23c8d0154b FastRestoreOldBackupTest:Increase test duragion
Add comment on Rollback test as well
2020-08-25 09:14:37 -07:00
sfc-gh-tclinkenbeard
d0189ad0d4 Relax commit latency requirement for LowLatency workload 2020-07-12 20:01:57 -07:00
Jingyu Zhou
e78cc9ee4b Use KeyRangeMap for splitMutation
This simplifies code by reuse KeyRangeMap class.
2020-07-08 09:53:34 -07:00
Meng Xu
90861ead6a Reenable all tests in BackupAndParallelRestoreWithAtomicOp 2020-06-23 08:29:31 -07:00
Meng Xu
b122575dda BackupAndParallelRestoreWithAtomicOp:Turn on debug options 2020-06-22 16:53:43 -07:00
Meng Xu
16898408ae FastRestore:Rename tests for new backup by adding NewBackup keyword 2020-04-01 21:31:54 -07:00
Meng Xu
1eea388278 Add unit test for splitMutation test file
Comment out debug trace as well.
2020-04-01 21:27:18 -07:00
Meng Xu
321b1b6ee7 Add RunRestoreWorkerWorkload into Parallel Restore WriteDuringReadAtomicRestore tests 2020-03-31 18:48:29 -07:00
Meng Xu
a1d2779f04 Add ParallelRestoreWriteDuringReadAtomicRestore.txt
Test for fast restore with new backup.
2020-03-31 18:25:17 -07:00
Meng Xu
0fa3bfa6f3 Increase timeout threshold for ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt 2020-03-31 18:21:36 -07:00
Meng Xu
faab8a0d19 Add ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
Add tests/ParallelRestoreApiCorrectnessAtomicRestore.txt back which
was mistakenly deleted in the previous commit.
2020-03-30 21:59:47 -07:00
Meng Xu
73345a7ebd Add new tests for parallel restore
Add two tests for parallel restore with old backup data
ParallelRestoreApiCorrectnessAtomicRestore.txt
ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt
2020-03-30 21:53:26 -07:00
Meng Xu
6e60c62d7b Add ParallelRestoreCorrectnessAtomicOp.txt 2020-03-28 16:00:51 -07:00
Meng Xu
f7233bade7 Rename ParallelRestoreCorrectnessAtomicOpTinyData.txt by removing TinyData 2020-03-27 13:08:59 -07:00
Meng Xu
5c6752fb24 Add tests for new restore with old backup 2020-03-27 13:07:38 -07:00
Meng Xu
97f8e46388 Sanity check subversion for log mutations 2020-03-27 13:07:08 -07:00
Jingyu Zhou
96a7b4b459 Disable ParallelRestoreApiCorrectnessAtomicRestore test 2020-03-26 14:59:50 -07:00
Jingyu Zhou
cffcac92ad Disable partitioned log for atomic restore workload
This will be reenabled after fixing test failures related to it.
2020-03-26 13:07:40 -07:00
Meng Xu
6a8d6ddb8e Introduce ParallelRestoreApiCorrectnessAtomicRestore.txt test
This covers ApiCorrectnessTest as workload for parallel restore.
2020-03-24 22:30:51 -07:00
Meng Xu
d185359422 ApiCorrectnessAtomicRestore test: Increase timeout value 2020-03-24 17:36:17 -07:00
Meng Xu
d7cf562ec4 Enable rollback workload for multi cycle restore test 2020-03-23 16:33:11 -07:00
Meng Xu
85a9f6ab96 Merge branch 'master' into mengxu/fr-enable-rollback-and-abort-test-PR 2020-03-23 16:32:00 -07:00
Meng Xu
14c641ce2b Enable rollback workload 2020-03-23 16:29:01 -07:00
Meng Xu
4756447b74 Enable abortAndRestartAfter option for restore cycle test 2020-03-23 15:15:14 -07:00
Meng Xu
f936adedb0 Change tab to space for test workload file 2020-03-23 15:10:35 -07:00
Meng Xu
9c2c3b26d3 Merge branch 'master' into mengxu/fr-multi-cycle-test-PR 2020-03-23 13:54:20 -07:00
Meng Xu
00ada7e086 Enable attrition workload for restore multi cycle tests 2020-03-23 13:50:05 -07:00
Meng Xu
ace19eefe4 Introduce multi cycle tests for fast restore 2020-03-23 12:59:43 -07:00
Meng Xu
5b2b2a8767 Enable assassination for restore cycle test 2020-03-23 12:28:04 -07:00
Meng Xu
48db54424f Add assassination workload to restore test workload
Add assert to ensure restore worker is reliable and not killed.
2020-03-23 11:11:13 -07:00
Meng Xu
e9fa7803a8 FastRestore:Test:Let simulation tests turn buggify on and off 2020-02-20 07:06:04 -08:00
Meng Xu
0507e9703c FastRestore:Disable abort fast restore test 2020-02-20 06:54:14 -08:00
Meng Xu
e794003b16 FastRestore:AtomicOpTest:Enable buggify 2020-02-19 20:25:07 -08:00
Meng Xu
4d027428df FastRestore:Test:Increase txn load to 2500txn per second
More transactions per second can create more data in a backup version,
this can help test if fast restore handles large memory allocation correctly.
2019-12-16 12:13:29 -08:00
Meng Xu
64abaaf02d FastRestore:Reenable tests for nightly test 2019-12-12 07:57:52 -08:00
Meng Xu
04230b59bf Increase load a bit 2019-12-07 21:14:56 -08:00
Meng Xu
78b8961891 Move parallel restore tests to tests folder
Valgrind found errors on these two parallel restore tests,
although correctness test confirms these two tests have no correctness error.

To prevent these two parallel restore tests from spamming valgrind test results,
we exclude these two tests from our nightly tests for now.
2019-11-25 10:53:10 -08:00
Meng Xu
7cf87e9ae3 FastRestore:Add ParallelRestoreCorrectnessCycle.txt test 2019-11-03 17:31:54 -08:00
Meng Xu
63359bfc8b FastRestore:handleInitVersionBatchRequest:Ensure exact once execution
Also increase the test workload for BackupAndParallelRestoreWithAtomicOp test
2019-11-03 17:26:13 -08:00
Jingyu Zhou
a30e6ec147
Merge pull request #2277 from xumengpanda/mengxu/fastrestore-atomicOpTest-increaseLoadAndBugFix-PR
Performant restore [7/XX]: Add tests for transactionBatchSizeThreshold when apply mutations
2019-10-24 21:21:14 -07:00
Meng Xu
7af3239ee7 FastRestore:AtomicOpTest:Debug:1 key per group for ops keyspace 2019-10-23 14:36:34 -07:00
Meng Xu
ba7e499efe FastRestore:AtomicOpTest:Limit 1 actor per client 2019-10-23 14:04:14 -07:00
Meng Xu
e676348710
Merge pull request #1955 from fzhjon/mark-ss-failed
Add fdbcli and API command to mark storage servers as permanently failed
2019-10-22 23:36:30 -07:00
Meng Xu
96d463bab6 FastRestore:Fix bug in applying mutations and increase atomicOp test worload
When Applier applies mutations to the destination cluster, it advances the
mutation cursor twice when it should only advance it once.
This makes restore miss some mutations when the applying txn includes
more than 1 mutations.
2019-10-22 23:24:23 -07:00