13066 Commits

Author SHA1 Message Date
A.J. Beamon
76838a20b7 A model used to quickly simulate various GRV scenarios and algorithms 2020-10-30 09:11:08 -07:00
Steve Atherton
125776491b
Merge pull request #3995 from sfc-gh-tclinkenbeard/rename-blobstore-s3blobstore
Rename BlobStore to S3BlobStore
2020-10-29 23:08:17 -07:00
sfc-gh-tclinkenbeard
55e86c1336 Disambiguate between S3BlobStore and other blob stores 2020-10-29 20:42:23 -07:00
Trevor Clinkenbeard
731073bd52
Merge pull request #3991 from sfc-gh-almiller/fdb3-in-joshua
Ignore old binaries before 4.x when running restarting tests
2020-10-29 12:41:48 -07:00
Alex Miller
362bd757c6 Make FDB >=4.x ignore old binaries before FDB 4.x
The motivation for this is so that Snowflake can add use TestHarness to run
FDB3 in Joshua, and be able to load FDB3 binaries into the image for restarting
tests.
2020-10-29 02:23:51 -07:00
Alex Miller
89a1559910 Handle versions being >1 digits. 2020-10-29 02:23:39 -07:00
Alex Miller
f2de49332c TestHarness should check --version before choosing an old binary.
This allows joshua to run on binaries older than the most recent version,
because restarting/upgrade tests won't start with a newer version than what is
under test.
2020-10-29 02:23:34 -07:00
Steve Atherton
96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
Xin Dong
25ded032c5
Merge pull request #3989 from sfc-gh-tclinkenbeard/fix-writeduringreadclean-failure
Decrease maximumTotalData in WriteDuringRead workload
2020-10-28 23:42:14 -07:00
sfc-gh-tclinkenbeard
d543082f33 Decrease maximumTotalData in WriteDuringRead workload 2020-10-28 22:49:24 -07:00
Trevor Clinkenbeard
82339c1ea3
Merge pull request #3941 from sfc-gh-tclinkenbeard/fix-upgrade-and-backup-test
Fix UpgradeAndBackupTest failures
2020-10-28 19:08:22 -07:00
sfc-gh-tclinkenbeard
4c110c5e80 Ignore backup_unneeded errors when discontinuing in RestoreBackup 2020-10-28 16:42:21 -07:00
sfc-gh-tclinkenbeard
95e5130903 Don't rewrite BeforeRestart prefix in UpgradeAndBackupRestore-2 2020-10-28 14:06:40 -07:00
Meng Xu
8f432406f0
Merge pull request #3937 from sfc-gh-mpilman/features/Dockerfile.centos7
New CentoOS7 based image
2020-10-28 10:30:08 -07:00
Andrew Noyes
e82339f40e
Merge pull request #3906 from sfc-gh-anoyes/anoyes/use-gcov
Add USE_GCOV cmake option
2020-10-27 08:27:46 -07:00
A.J. Beamon
8e512f3109
Merge pull request #3943 from sfc-gh-anoyes/anoyes/valgrind-precise
Increase valgrind precision if env var FDB_VALGRIND_PRECISE is set
2020-10-26 14:01:58 -07:00
sfc-gh-tclinkenbeard
0f42f0c486 Start backup agent earlier in RestoreBackup workload 2020-10-26 12:26:31 -07:00
Andrew Noyes
a15bc32b14
Merge pull request #3945 from sfc-gh-clin/add-consistencycheck-to-special-keys
Add consistencycheck command to special keys
2020-10-26 10:59:17 -07:00
Markus Pilman
6fa9acb567 renamed docker file 2020-10-26 11:34:06 -06:00
Markus Pilman
72839af1c0 install python36 with the first install 2020-10-26 09:51:30 -06:00
Xiaoge Su
1fe775d393
Merge pull request #3962 from sfc-gh-tclinkenbeard/add-optional-get-overload
Support rvalue reference overload for Optional::get
2020-10-24 23:17:14 -07:00
Trevor Clinkenbeard
e963c3bc61
Merge pull request #3946 from ajbeamon/fix-memory-issue-due-to-iterator-invalidation
Fix memory error due to iterator invalidation
2020-10-24 22:51:10 -07:00
sfc-gh-tclinkenbeard
dd55eeeaca Start backup agent in RestoreBackup workload 2020-10-24 22:28:46 -07:00
sfc-gh-tclinkenbeard
8191a38b88 Support rvalue reference overload for Optional::get 2020-10-24 21:05:42 -07:00
sfc-gh-tclinkenbeard
2a849dc52c Update BackupContainerAzureBlobStoreImpl::WriteFile::sync 2020-10-24 16:48:06 -07:00
sfc-gh-tclinkenbeard
195873e1cc Cleaned up unnecessary backup container includes 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard
195ca30a20 Azure backup cleanup 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard
e389a5dabe Fix issues with Azure credentials 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard
c6739f7075 Add skeleton for BackupContainerAzureBlobStore::listURLs 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard
bb09f0e657 Improve AsyncTaskThread encapsulation 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard
7cba81316a Fix some race conditions in AsyncTaskThread (some more remain) 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard
4d127a29cc Added testing and fixed some bugs in AsyncTaskThread 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard
456a7c77a2 Add random delay to AsyncTaskThread::execAsync in simulation 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard
f3c52ed41e Guard Azure backup compilation behind CMake variable 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard
e3f94c80fc Added BackupContainerAzureBlobStore::getURLFormat 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard
dc3738b97f Improve encapsulation for BackupContainerFileSystem 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard
6a27619544 Remove unnecessary copies in BackupContainer code 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard
1d28285cc5 Made BackupContainer.h header guard consistent with other header guards 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard
ae91cf1d44 Make BackupContainerFileSystem.h a non-actor file 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard
9242456d71 Improve encapsulation for BackupContainerAzureBlobStore 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard
226b3f6bf2 Improve encapsulation for BackupContainerS3BlobStore 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard
e1d58d3c66 Moved BackupContainerS3BlobStore into its own files 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard
e15a268548 Use anonymous namespace for BackupContainerLocalDirectory helper functions 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard
961aeaecac Moved BackupContainerAzureBlobStore into its own files 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard
e5338d213b Moved BackupContainerLocalDirectory into its own files 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard
3c6de425a1 Moved BackupContainerFileSystem implementation to cpp file 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard
cd50d53b1e Created BackupContainerFileSystem.actor.h 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard
29d6fc5dff Clarify scope of IBackupFile_impl namespace 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard
0879e529d2 Add error handling to AsyncTaskThread::execAsync 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard
e9de39f525 Add machine attrition to BackupBlobCorrectness test 2020-10-24 16:48:00 -07:00