apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-03 03:41:53 +08:00
Code Issues Packages Projects Releases Wiki Activity
foundationdb/fdbclient
History
Ata E Husain Bohra 017709aec6
Introduce BlobCipher interface and cipher caching interface (#6391) 
* Introduce BlobCipher interface and cipher caching interface

 diff-3: Update the code to avoid deriving encryption key periodically.
         Implement EncyrptBuf interface to limit memcpys.
         Improve both unit test and simulation to better code coverage.
 diff-2: Add specific error code for OpenSSL AES call failures
 diff-1: Update encryption scheme to AES-256-CTR. Minor
         updates to Header to capture more information.

Major changes proposed are:
1. Introduce encyrption header format.
2. Introduce a BlobCipher cipher key representation encoding
following information: baseCipher details, derived encryption cipher
details, creationTime and random salt.
3. Introduce interface to support block cipher encrytion and decrytion
operations. Encyrption populates encryption header allowing client to
persist them on-disk, this header is then read allowing decryption
on reads.
4. Introduce interface to allow in-memory caching of cipher keys. The
cache allowing mapping of "encryption domain" -> "base cipher id" ->
"derived cipher keys" (3D hash map). This cache interface will be used
by FDB processes participating in encryption to cache recently used
ciphers (performance optimization).

Testing:
1. Unit test to validate caching interface.
2. Update EncryptionOps simulation test to validate block cipher
operations.
2022-03-24 07:31:49 -07:00
..
json_spirit
Replace <boost/bind.hpp> with <boost/bind/bind.hpp>.
2021-11-18 14:00:13 -08:00
libb64
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
md5
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
rapidjson
apply formatting with clang 13
2021-12-02 05:13:59 +00:00
rapidxml
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
sha1
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
vexillographer
Add tenant support in the FDB native client
2022-03-15 09:21:27 -07:00
ActorLineageProfiler.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ActorLineageProfiler.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
AnnotateActor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
AnnotateActor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
AsyncFileS3BlobStore.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
AsyncFileS3BlobStore.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
AsyncTaskThread.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
AsyncTaskThread.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
Atomic.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
AutoPublicAddress.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
azurestorage.cmake
First draft of Azure blob storage backup container
2020-10-24 16:47:51 -07:00
BackupAgent.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupAgentBase.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainer.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainer.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerAzureBlobStore.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerAzureBlobStore.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerFileSystem.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerFileSystem.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerLocalDirectory.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerLocalDirectory.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerS3BlobStore.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BackupContainerS3BlobStore.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BlobGranuleCommon.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
BlobGranuleFiles.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BlobGranuleFiles.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BlobGranuleReader.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
BlobGranuleReader.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
BlobWorkerCommon.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
BlobWorkerInterface.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
BuildFlags.h.in
Fix macOS compilation issue
2021-01-19 11:21:21 -08:00
ClientBooleanParams.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClientBooleanParams.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClientKnobCollection.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClientKnobCollection.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClientKnobs.cpp
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
ClientKnobs.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
ClientLogEvents.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClientVersion.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClientWorkerInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClusterConnectionFile.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClusterConnectionFile.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClusterConnectionKey.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClusterConnectionKey.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClusterConnectionMemoryRecord.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClusterConnectionMemoryRecord.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ClusterInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
CMakeLists.txt
Implement some tenant tests
2022-03-17 12:10:18 -07:00
CommitProxyInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
CommitTransaction.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ConfigKnobs.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ConfigKnobs.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ConfigTransactionInterface.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ConfigTransactionInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ConvertUTF.h
Move SimpleIni.h to fdbclient
2022-02-07 13:31:04 -08:00
CoordinationInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
DatabaseBackupAgent.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
DatabaseConfiguration.cpp
Make overwriteProxiesCount a function of conf keys (#6645)
2022-03-23 17:15:28 -07:00
DatabaseConfiguration.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
DatabaseContext.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
EventTypes.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
FDBOptions.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
FDBTypes.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
FDBTypes.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
FileBackupAgent.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
FluentDSampleIngestor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
GenericManagementAPI.actor.h
Avoid promoting transactions to have system key access when using special keys
2022-03-17 08:33:53 -07:00
GlobalConfig.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
GlobalConfig.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
GlobalConfig.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
GrvProxyInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
HighContentionPrefixAllocator.actor.h
Rename high contention allocator implementation in fdbclient
2022-01-31 14:25:38 -08:00
HTTP.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
HTTP.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
IClientApi.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
IConfigTransaction.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
IConfigTransaction.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
IKnobCollection.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
IKnobCollection.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ISingleThreadTransaction.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ISingleThreadTransaction.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
JsonBuilder.cpp
Add missing copyright headers
2022-03-16 11:25:02 -07:00
JsonBuilder.h
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
JSONDoc.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
KeyBackedTypes.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
KeyRangeMap.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
KeyRangeMap.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
Knobs.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
LocalClientAPI.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
LocalClientAPI.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ManagementAPI.actor.cpp
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
ManagementAPI.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
MonitorLeader.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
MonitorLeader.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
MultiVersionAssignmentVars.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
MultiVersionTransaction.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
MultiVersionTransaction.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
MutationList.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
MutationLogReader.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
MutationLogReader.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
NameLineage.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
NameLineage.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
NativeAPI.actor.cpp
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
NativeAPI.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
Notified.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
ParallelStream.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ParallelStream.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
PaxosConfigTransaction.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
PaxosConfigTransaction.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
PImpl.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ProcessInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ReadYourWrites.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ReadYourWrites.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
RestoreInterface.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
RestoreInterface.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
RunTransaction.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
RYWIterator.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
RYWIterator.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
S3BlobStore.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
S3BlobStore.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
Schemas.cpp
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
Schemas.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ServerKnobCollection.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ServerKnobCollection.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ServerKnobs.cpp
Introduce BlobCipher interface and cipher caching interface (#6391)
2022-03-24 07:31:49 -07:00
ServerKnobs.h
Introduce BlobCipher interface and cipher caching interface (#6391)
2022-03-24 07:31:49 -07:00
SimpleConfigTransaction.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
SimpleConfigTransaction.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
SimpleIni.h
Move SimpleIni.h to fdbclient
2022-02-07 13:31:04 -08:00
SnapshotCache.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
SpecialKeySpace.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
SpecialKeySpace.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
StackLineage.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
StackLineage.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
Status.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
StatusClient.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
StatusClient.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
StorageCheckpoint.h
Fixed uninitialized member issue.
2022-03-18 09:12:59 -07:00
StorageServerInterface.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
StorageServerInterface.h
Merge pull request #6582 from sfc-gh-tclinkenbeard/global-tag-throttling2
2022-03-23 12:54:30 -07:00
Subspace.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
Subspace.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
SystemData.cpp
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
SystemData.h
Merge branch 'main' into blob_integration
2022-03-22 11:41:58 -05:00
TagThrottle.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
TagThrottle.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
TaskBucket.actor.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
TaskBucket.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
Tenant.cpp
Implement some tenant tests
2022-03-17 12:10:18 -07:00
Tenant.h
Fix a couple bugs. Don't store old versions in tenant map indefinitely.
2022-03-06 21:54:21 -08:00
TestKnobCollection.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
TestKnobCollection.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
ThreadSafeTransaction.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
ThreadSafeTransaction.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
TransactionLineage.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
TransactionLineage.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
Tuple.cpp
Update copyright header dates
2022-03-21 13:36:23 -07:00
Tuple.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
VersionedMap.actor.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
VersionedMap.cpp
Add missing copyright headers
2022-03-16 11:25:02 -07:00
VersionedMap.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
versions.h.cmake
…
WellKnownEndpoints.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
WriteMap.h
Update copyright header dates
2022-03-21 13:36:23 -07:00
zipf.c
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
zipf.h
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00