Jingyu Zhou
00b57d4cce
Merge branch 'main-67eba5ec7' into vv
...
Fix Conflicts:
fdbclient/CommitProxyInterface.h
fdbclient/NativeAPI.actor.cpp
fdbclient/StorageServerInterface.h
fdbserver/CommitProxyServer.actor.cpp
fdbserver/storageserver.actor.cpp
2022-03-30 20:05:55 -07:00
Jingyu Zhou
e9659b5dd4
Merge branch 'master-PR-6500' into vv
...
Fix Conflicts:
fdbclient/CommitProxyInterface.h
fdbclient/NativeAPI.actor.cpp
fdbserver/masterserver.actor.cpp
2022-03-30 14:53:49 -07:00
Sreenath Bodagala
bb1a8bd7bd
- Set default value of SEND_ENTIRE_VERSION_VECTOR to false.
2022-03-09 19:21:29 +00:00
Sreenath Bodagala
91b75ae014
- Intoduce a new knob "CLIENT_KNOBS::SEND_ENTIRE_VERSION_VECTOR"
...
- Send the entire version vector on the read version code path
(sequencer -> grv proxy and grv proxy -> client)
2022-03-08 21:21:10 +00:00
Josh Slocum
665e182bcc
TSS Metrics improvements
2022-03-07 11:20:24 -06:00
A.J. Beamon
cdebda35ab
Merge pull request #5725 from sfc-gh-jfu/jfu-grv-cache
...
Add transaction option for clients to use cached read versions
2022-03-04 09:17:27 -08:00
Zhe Wu
9c99c59b0c
Fix get key location overloading proxies
2022-02-24 16:35:30 -08:00
Jon Fu
9ab21fe873
remove unused knob
2022-02-23 13:49:53 -05:00
Jon Fu
31d56b2f50
adjust knob setting, revert trace changes, and disable cache if onError retries transactions
2022-02-22 12:42:53 -05:00
Jon Fu
d399daebed
Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache
2022-02-15 15:09:40 -05:00
Vaidas Gasiunas
092b5cee4b
MVC2.0: Rollback added code
2022-02-14 13:50:42 -08:00
Jon Fu
7492b755d8
Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache
2022-02-14 14:06:49 -05:00
Lukas Joswiak
cdc1549282
Fix client timeout errors
2022-02-09 13:43:33 -08:00
Lukas Joswiak
d5a562e6b8
Fix dynamic knobs correctness issues
2022-02-09 13:43:32 -08:00
Bala Namasivayam
9fe7a99e11
Make AWS V4 header default
2022-02-07 17:53:05 -08:00
Bala Namasivayam
a420098fc5
Support AWS v4 header for s3 backup and restore
2022-02-07 17:53:05 -08:00
Jon Fu
ec2bbf0343
clean up some more trace lines and leftover code snippets
2022-02-07 14:50:04 -05:00
Jon Fu
5d9843ec32
Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache
2022-01-24 13:20:51 -05:00
Josh Slocum
cf45354833
switched buggified and expected shard size for simulation
2022-01-20 20:37:03 -08:00
Josh Slocum
4bfef29e4c
Changed small shards in simulation logic
2022-01-20 20:37:03 -08:00
Josh Slocum
6a8e9d71d2
Raising default minimum shard size, as it causes unecessary merging on growing clusters.
2022-01-20 20:37:03 -08:00
Jon Fu
2b0ade5250
Change throttling threshold to count loop iterations instead of time
2021-11-25 13:31:55 -05:00
Jon Fu
bba7ed8ac0
Add panic knob to shut down cache from outside txn options
2021-11-25 13:22:28 -05:00
Jon Fu
beae9ccfa1
tweak some knob default settings and trace formatting
2021-11-23 14:58:17 -05:00
Jon Fu
3f24128da4
Merge branch 'master' of github.com:apple/foundationdb into jfu-grv-cache
2021-11-19 14:46:55 -05:00
Jon Fu
e9c58d9f86
Check for sustained throttling in the proxy to lower threshold time and avoid false positives
2021-11-19 14:33:06 -05:00
Jon Fu
1e2060a52b
add extra tracking in dbcontext to periodically contact GRV proxies
2021-11-17 15:24:37 -05:00
Jon Fu
16e551e834
change knob to be an adjustable probability instead of binary on/off
2021-11-16 13:41:19 -05:00
Evan Tschannen
6909754b21
changefeeds now have a whenAtLeast function for efficiently learning when the version has updated but no mutations have been committed
2021-11-14 19:08:46 -08:00
Vaidas Gasiunas
40da5a80f9
Merge remote-tracking branch 'apple/master' into multi-version-client-2
2021-10-26 19:29:10 +02:00
Vaidas Gasiunas
37bc41abbb
Merge remote-tracking branch 'apple/master' into multi-version-client-2
2021-10-26 18:51:43 +02:00
Jon Fu
7273d352a2
Add extra debug traces and ignore "IMMEDIATE" priority txns for rk throttling
2021-10-25 13:44:45 -04:00
Jon Fu
6d74239760
Track throttling by measuring time spent left in queue on the proxy
2021-10-22 13:55:01 -04:00
Josh Slocum
773886515e
Merge branch 'feature-range-feed' into blob_full_clean
2021-10-22 11:07:51 -05:00
Vaidas Gasiunas
dff95dc143
MVC2.0: Fix whitespace alignment
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2021-10-22 09:57:56 +02:00
Vaidas Gasiunas
e4ade0831a
MVC2.0: Addressing code review comments for client lib management operations
...
- Delete clientlib metadata and all chunks in one transaction
- Read all chunks of a download transaction in concurrently
- Configure number of chunks per transaction instead of transaction size
- Make all transactions lock-aware
2021-10-21 11:25:50 +02:00
Jon Fu
f1c8d3fbc8
Add code to disable cache when ratekeeper begins throttling
2021-10-20 15:52:43 -04:00
Evan Tschannen
3f7df58a77
fixed a number of issues
2021-10-19 13:56:52 -07:00
Josh Slocum
912ef76f1c
cleanup before merge
2021-10-18 17:11:14 -05:00
Josh Slocum
b5074fd597
Reworked all of the system data to encode granule data more efficiently for persistence
2021-10-13 16:28:04 -05:00
Suraj Gupta
2ec8781224
Merge knobs into one.
2021-10-13 14:00:37 -04:00
Suraj Gupta
bde90f058b
Gate the client API.
2021-10-13 13:26:27 -04:00
Jon Fu
cc38c48123
Add debug knob to use grv cache for performance testing
2021-10-06 14:35:42 -04:00
Vaidas Gasiunas
abcef299e1
MVC2.0: Operation to delete a client library; enum for client lib status
2021-10-06 18:01:46 +02:00
Vaidas Gasiunas
6c103c72d9
MVC2.0: Use ClientKnobs to configure chunk and transaction size for client lib upload
2021-10-06 18:01:46 +02:00
Josh Slocum
fa1fe5f08b
added blob worker rollbacks that handle (most) cases
2021-09-24 17:52:36 -05:00
Jon Fu
d971b63bbf
Merge branch 'master' of github.com:apple/foundationdb into jfu-grv-cache
2021-09-13 12:47:42 -04:00
A.J. Beamon
2d6fb93316
Compute a burstiness score based on the max busyness interval in a measurement period.
2021-08-27 16:29:15 -07:00
Lukas Joswiak
d554205db3
Move common knob initialization macros to header
2021-08-23 11:41:01 -07:00
Lukas Joswiak
7998ec4232
Add atomicity to knobs
2021-08-23 11:41:00 -07:00
