8345 Commits

Author SHA1 Message Date
Andrew Noyes
d39b881045
Avoid a call to VersionedMap::ViewAtVersion::lower_bound (#6606)
* Avoid a call to VersionedMap::ViewAtVersion::lower_bound in some cases

* Avoid lower_bound in both cases
2022-03-17 09:03:20 -07:00
sfc-gh-tclinkenbeard
c4bc35da09 Merge remote-tracking branch 'origin/main' into fix-includes 2022-03-16 22:29:18 -07:00
Evan Tschannen
a0ba3f73f8
Merge pull request #6619 from sfc-gh-ajbeamon/storage-cache-request-handling
Update the storage cache to handle all requests types
2022-03-16 17:37:24 -07:00
Evan Tschannen
f28dfc12b2
Merge pull request #6484 from kakaiu/adaptive-fetchKey
Quick fix fetchKeys
2022-03-16 15:06:22 -07:00
A.J. Beamon
31bd9c8b3e Use the new name for mapped key values requests 2022-03-16 15:05:06 -07:00
A.J. Beamon
052220f8ab Update the storage cache to handle all requests types. Most assert false, one is updated to send a broken_promise as a workaround to the fact that we do expect some requests to go there. 2022-03-16 14:57:53 -07:00
sfc-gh-tclinkenbeard
320c115c71 Apply clang-format to mis-formatted files 2022-03-16 14:25:32 -07:00
sfc-gh-tclinkenbeard
0e7dc83f25 Fix compilation issues with ModelInterface construction in configuration database code 2022-03-16 14:25:32 -07:00
sfc-gh-tclinkenbeard
58de6e22cc Add BalanceOnRequests boolean parameter for ModelInterface 2022-03-16 14:25:32 -07:00
sfc-gh-tclinkenbeard
62f547ff6e Add line before actorcompiler.h include (to prevent IDE from reordering includes) 2022-03-16 14:15:48 -07:00
Trevor Clinkenbeard
765e018afb
Merge pull request #6580 from sfc-gh-tclinkenbeard/const-smoother
Mark `Smoother::smooth*` methods `const`
2022-03-16 13:43:25 -07:00
Zhe Wang
73fd5c01ae quick-fix-fetch-key 2022-03-16 16:39:35 -04:00
Trevor Clinkenbeard
10c536c700
Merge pull request #6435 from sfc-gh-ljoswiak/fixes/dynamic-knobs-release-readiness
Dynamic knobs improvements
2022-03-16 10:26:56 -07:00
Lukas Joswiak
c3e48fff9f
Update fdbserver/PaxosConfigConsumer.actor.cpp
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
2022-03-16 08:59:12 -07:00
sfc-gh-tclinkenbeard
66d71e107d Move actorcompiler.h include to the end of includes 2022-03-16 00:09:16 -07:00
Trevor Clinkenbeard
cd5247b377
Merge pull request #6608 from xis19/dataDistribution
Fix the includes in DataDistribution.actor.cpp
2022-03-15 19:53:43 -07:00
Xiaoge Su
cbd381778e Fix the includes in DataDistribution.actor.cpp
Update the comment to re-trigger failed checks
2022-03-15 18:05:55 -07:00
Steve Atherton
59762fc784
Merge pull request #6423 from sfc-gh-satherton/redwood-bug-fixes-and-memory-leak
Redwood memory usage and small memory leak fixes
2022-03-15 16:52:28 -07:00
Xiaoxi Wang
22040583aa
Merge pull request #6596 from sfc-gh-xwang/ppw-getteam
Deprioritize seleting team in the wiggle paused state
2022-03-15 14:26:47 -07:00
A.J. Beamon
7464c7747c
Merge pull request #6600 from sfc-gh-ajbeamon/add-tenant-support-back-to-mapped-range
Add tenant support back to mapped range requests
2022-03-15 13:46:32 -07:00
He Liu
c3a68d661e
Physical Shard Move (#6264)
Physical Shard Move part I: Checkpoint creation, transfer and restore.
2022-03-15 13:03:23 -07:00
A.J. Beamon
a04934465c Add tenant support back to mapped range requests. Fix ACTOR warning. 2022-03-15 12:41:08 -07:00
A.J. Beamon
e8077b65e1
Merge pull request #6559 from sfc-gh-ajbeamon/fdb-tenant-client
Add client support for tenants
2022-03-15 12:40:17 -07:00
Josh Slocum
67eba5ec7c Limiting DD Moves by destination SS. 2022-03-15 13:52:19 -05:00
Lukas Joswiak
582ba5d519 Fix issue with stuck config nodes
In rare circumstances where the cluster controller dies / moves to a new
machine, sometimes only a minority of `ConfigNode`s received messages
telling them they were registered. When the `ConfigNode`s attempt to
register with the new broadcaster (on the new cluster controller), the
knob system would get stuck because only a minority would be registered.
Part of this change allows registration of unregistered `ConfigNode`s if
there is no path to a majority of registered nodes.
2022-03-15 11:42:58 -07:00
Jingyu Zhou
e89ee7d5a0
Merge pull request #6589 from sfc-gh-tclinkenbeard/fix-typos
Fix typos
2022-03-15 10:10:23 -07:00
A.J. Beamon
1d44ef1c8e Specify system key access for a few move keys transactions 2022-03-15 09:23:30 -07:00
A.J. Beamon
fb73e1857a Some get key requests should not happen within a tenant. Don't set read_system_keys in watch logic unless necessary. Set access_system_keys in a couple movekeys functions. 2022-03-15 09:23:30 -07:00
A.J. Beamon
2a21126028 Don't apply read prefixes on the client. Cache tenant data locally. 2022-03-15 09:23:30 -07:00
A.J. Beamon
c635dcd3ad Add tenant support in the FDB native client 2022-03-15 09:21:27 -07:00
Yao Xiao
09df9d83fd
Enable RocksDB with Valgrind. (#6595) 2022-03-14 21:11:44 -07:00
Xiaoxi Wang
7855dc70f2 add unit test 2022-03-14 16:43:02 -07:00
Xiaoxi Wang
87640673f7 add hasWigglePausedServer method; add new sort criteria 2022-03-14 16:02:42 -07:00
Trevor Clinkenbeard
6a28bddd35
Fix file names in copyright headers (#6578) 2022-03-14 13:24:25 -07:00
Lukas Joswiak
d0da6c63c1 Rollforward out of date nodes, compaction fixes 2022-03-14 11:20:56 -07:00
sfc-gh-tclinkenbeard
8dcac2f76d Fix typos 2022-03-13 10:02:11 -03:00
Bharadwaj V.R
8be519a5d8 Make getServerMetrics private to TCServerInfo class and rename some methods to remove redundant reference to 'server' 2022-03-12 17:30:50 -04:00
Bharadwaj V.R
7bad6c5093 Make server API for load metrics 2022-03-12 17:30:50 -04:00
Bharadwaj V.R
2d2f7ed2c6 Refactor team space methods and create new TCServerInfo method to expose space metrics 2022-03-12 17:30:50 -04:00
Bharadwaj V.R
c5a17f48c0 Make some TCServerInfo methods that are only used in DDTCUnitTest class private 2022-03-12 17:30:50 -04:00
Josh Slocum
26e95d43ef SS needs to persist its TSS pair ID to make metrics accurate (and avoid buggify issues in simulation) 2022-03-11 11:38:58 -06:00
sfc-gh-tclinkenbeard
184f0d7586 Improve const correctness of storage wiggler classes 2022-03-11 09:20:53 -04:00
sfc-gh-tclinkenbeard
3a6568580a Improve encapsulation of TimerSmoother 2022-03-11 07:47:26 -04:00
sfc-gh-tclinkenbeard
e00820cdd7 Reduce mutable access to *QueueInfo objects in Ratekeeper.actor.cpp 2022-03-11 01:04:13 -04:00
sfc-gh-tclinkenbeard
9aca5f8011 Mark several methods const 2022-03-11 00:47:35 -04:00
Steve Atherton
30957c3a43 Fix unclear comment. 2022-03-10 14:22:45 -08:00
Ata E Husain Bohra
944ec48415
Introduce a simulate EncryptKeyVaultProxy interface (#6576)
Description

Major changes proposed are:
1. Rename ServerKnob->ENABLE_ENCRYPT_KEY_PROXY to
   ServerKnob->ENABLE_ENCRYPTION. Approach simplifies enabling
   controlling encyrption code change using a single knob (desirable)
2. Implement EncyrptKeyVaultProxy simulated interface to assist
   validating encyrption workflows in simulation runs. The interface
   is leveraged to satisfy "encryption keys" lookup which otherwise
   gets satisfied by integrating organization preferred Encryption
   Key Management solution.

Testing

Unit test to validate the newly added code
2022-03-10 12:06:49 -08:00
Tao Lin
e2c7c30faf
GetMappedRange support serializable & check RYW & continuation (#6181) 2022-03-10 10:05:44 -08:00
A.J. Beamon
402fa4dd9e
Merge pull request #6428 from sfc-gh-ajbeamon/fdb-tenant-add-interfaces
Add server-side and protocol support for tenants
2022-03-08 15:33:18 -08:00
A.J. Beamon
63b8b838a2
Merge pull request #6558 from sfc-gh-ajbeamon/special-keys-limits
Add support for a limits hint in special keys range reads
2022-03-08 15:32:59 -08:00