apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-05-16 02:42:23 +08:00
Code Issues Packages Projects Releases Wiki Activity
19,418 Commits 35 Branches 318 Tags
Commit Graph

286 Commits

Author SHA1 Message Date
Bharadwaj V.R
dd3a453f5b Address suggestions to make new SSI member private, and reduce the number of serialization methods for serverList value 2022-03-28 23:52:26 -07:00
Bharadwaj V.R
726cb3a18f merge commits from main 2022-03-28 22:49:03 -07:00
Bharadwaj V.R
301e64a1b6 Remove unit tests added for SSI upgrade/downgrade 2022-03-25 13:27:55 -07:00
Bharadwaj V.R
961e4ae7fd ratekeeper and ser-des fixes 2022-03-24 17:25:07 -07:00
Josh Slocum
f27475e2f4 Merge branch 'main' into blob_integration 2022-03-22 11:41:58 -05:00
sfc-gh-tclinkenbeard
a71099471b Update copyright header dates 2022-03-21 13:36:23 -07:00
Bharadwaj V.R
2a8d39d5e5 Update ser-des unit test for the SSI boolean 2022-03-21 10:41:28 -07:00
Josh Slocum
37e7c80f26 Merge branch 'main' into blob_integration 2022-03-17 18:45:42 -05:00
He Liu
c3a68d661e
Physical Shard Move (#6264) 
Physical Shard Move part I: Checkpoint creation, transfer and restore.
 2022-03-15 13:03:23 -07:00
A.J. Beamon
c635dcd3ad Add tenant support in the FDB native client 2022-03-15 09:21:27 -07:00
Josh Slocum
8c35ceb684 switching bg file keys to sort on version then type, and using that to fix race where 2 blob workers try to split the same granule at different versions 2022-03-14 17:38:31 -05:00
Josh Slocum
e71b3533f9 Merge branch 'main' into blob_integration 2022-03-09 08:59:56 -06:00
A.J. Beamon
5fa9d3e1b7 Add a tenant parameter to read and commit requests. Store a map of all tenants on commit proxy and storage servers. Add an option to require tenant mode. 2022-03-06 21:54:21 -08:00
Evan Tschannen
8f8987ad67 Merge branch 'blob_integration' of https://github.com/apple/foundationdb into blob_integration 2022-03-01 10:12:36 -08:00
Josh Slocum
ed9f95b299 simplifying blob manager recovery by always treating the DB granule mapping as the source of truth, and persisting all boundary changes there BEFORE updating workers 2022-02-25 14:46:14 -06:00
Evan Tschannen
330b2b48ec improved file cleanup execution and testing 2022-02-22 12:00:09 -08:00
Josh Slocum
38a75a8b89 Merge branch 'main' into blob_integration 2022-02-17 17:47:38 -06:00
Vaidas Gasiunas
092b5cee4b MVC2.0: Rollback added code 2022-02-14 13:50:42 -08:00
Xiaoxi Wang
6dc5921575
createdTime based storage wiggler (#6219) 
* add storagemetadata

* add StorageWiggler;

* fix serverMetadataKey bug

* add metadata tracker in storage tracker

* finish StorageWiggler

* update next storage ID

* change pid to server id

* write metadata when seed SS

* add status json fields

* remove pid based ppw iteration

* fix time expression

* fix tss metadata nonexistence; fix transaction retry when retrieving metadata

* fix checkMetadata bug when store type is wrong

* fix remove storage status json

* format code

* refactor updateNextWigglingStoragePID

* seperate storage metadata tracker and store type tracker

* rename pid

* wiggler stats

* fix completion between waitServerListChange and storageRecruiter

* solve review comments

* rename system key

* fix database lock timeout by adding lock_aware

* format code

* status json

* resolve code format/naming comments

* delete expireNow; change PerpetualStorageWiggleID's value to KeyBackedObjectMap<UID, StorageWiggleValue>

* fix omit start rount

* format code

* status json reset

* solve status json format

* improve status json latency; replace binarywriter/reader to objectwriter/reader; refactor storagewigglerstats transactions

* status timestamp
 2022-02-04 15:04:30 -08:00
Lukas Joswiak
13da5d394b Remove extra StringRef copy 2022-01-26 19:22:40 -08:00
Lukas Joswiak
e2e853a30b Use ObjectWriter to write storage cache data 
This allows deserialization of the on disk data in lower FDB versions
that don't contain fields added in main.
 2022-01-25 19:24:14 -08:00
Josh Slocum
1494f8216b Reworked blob manager recovery to be more efficient and handle overlapping ongoing splits 2022-01-24 14:12:45 -06:00
Josh Slocum
08f8700636 Fixed a couple bugs in blob manager recovery 2022-01-18 18:47:42 -06:00
Josh Slocum
9d9cb961a1 reworked blob manager recovery to be more efficient 2022-01-18 14:22:58 -06:00
Suraj Gupta
932f68e1b3 Refactor bstore and add watch key. 2021-12-10 16:43:58 -06:00
Suraj Gupta
22d72ec9dd init 2021-12-10 16:43:58 -06:00
Josh Slocum
efb21ca6a1 Merge branch 'master' into blob_integration 2021-11-24 13:17:54 -06:00
Evan Tschannen
964d0209ca
Merge pull request #5637 from sfc-gh-ljoswiak/features/data-loss-prevention 
Data loss protection when joining new cluster
 2021-11-15 15:26:32 -08:00
Josh Slocum
f140028086 Merge branch 'master' into blob_integration 2021-11-15 15:09:40 -06:00
Lukas Joswiak
30867750b5 Add protection against storage and tlog data deletion when joining a new cluster 2021-11-09 12:29:47 -08:00
Josh Slocum
3b711af061 Fixed a couple rollback issues and endianness of versionstamp version 2021-10-29 12:07:16 -05:00
Vaidas Gasiunas
875824b186 MVC2.0: Notify clients about relevant changes of client libraries 2021-10-27 23:43:40 +02:00
Vaidas Gasiunas
40da5a80f9 Merge remote-tracking branch 'apple/master' into multi-version-client-2 2021-10-26 19:29:10 +02:00
Vaidas Gasiunas
37bc41abbb Merge remote-tracking branch 'apple/master' into multi-version-client-2 2021-10-26 18:51:43 +02:00
Josh Slocum
773886515e Merge branch 'feature-range-feed' into blob_full_clean 2021-10-22 11:07:51 -05:00
Evan Tschannen
3f7df58a77 fixed a number of issues 2021-10-19 13:56:52 -07:00
Josh Slocum
912ef76f1c cleanup before merge 2021-10-18 17:11:14 -05:00
Josh Slocum
b5074fd597 Reworked all of the system data to encode granule data more efficiently for persistence 2021-10-13 16:28:04 -05:00
Josh Slocum
5f0ec0612a Merge branch 'feature-range-feed' into blob_full 2021-10-13 15:44:35 -05:00
Evan Tschannen
5b6f8b2abb added the known committed version to change feeds 2021-10-11 13:53:36 -07:00
Evan Tschannen
5c642f706e Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed 
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
 2021-10-09 19:34:16 -07:00
Vaidas Gasiunas
cda0a5f931 Operation to upload client library binary in to system keyspace 2021-10-06 18:01:46 +02:00
Neethu Haneesha Bingi
3e79299898 Locality filter support to perpetual storage wiggler feature. 2021-09-30 10:00:33 -07:00
Josh Slocum
a986679b7f More bug fixes 2021-09-24 10:02:02 -05:00
Josh Slocum
5ddf08dfe5 Got basic range reassignment working 2021-09-22 16:48:44 -05:00
He Liu
a1f6dcc2d5 merge from master 2021-09-22 13:07:38 -07:00
He Liu
914b1ee960 fmt 2021-09-20 12:01:47 -07:00
He Liu
95f64f97de resolved some fmt issues 2021-09-20 11:58:30 -07:00
Xiaoge Su
abf73047ca Enforce std:: specifier rather than using namespace 2021-09-16 19:40:28 -07:00
helium
cf1626f553 Added comments. 2021-09-10 11:10:10 -07:00