1730 Commits

Author SHA1 Message Date
Alex Moundalexis
67049518b9
updated copyright year on web site 2022-10-27 15:05:52 -04:00
Vaidas Gasiunas
feee5ddb80 Updating API Tester documentation 2022-10-21 14:21:55 +02:00
Nim Wijetunga
025359a974
Add Options to restore user/system keys in backup agent (#8497)
* add options to restore user/system keys

* format help commands

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbbackup/backup.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbbackup/backup.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* address pr comments

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-10-20 09:58:00 -07:00
Zhe Wu
550e1e86e8 Also add fetch_consistency_scan_info_timeout to mr-status-json-schemas.rst.inc 2022-10-17 15:35:32 -07:00
Kevin Hoxha
2f898fb006 fdbcli: Add documentation for setknob/getknob commands 2022-10-11 15:32:01 -07:00
Jon Fu
461e42bfe1 restructure updater code and add capacity check in metacluster management workload 2022-09-29 16:24:02 -07:00
Jon Fu
a29b853979 add assigned_cluster to tenant command hints in fdbcli 2022-09-29 12:18:30 -07:00
Sam Gwydir
61ce598aef Specify cert and key files separately 2022-09-26 11:59:42 -07:00
Sam Gwydir
a5a0028e65 document TLS cert and key file behavior change. 2022-09-26 11:37:24 -07:00
A.J. Beamon
97a325adab Add an fdbcli command to get tenant group metadata 2022-09-22 13:24:21 -07:00
A.J. Beamon
64c8e0e2b1 Convert fdbcli tenant commands to a single command with subcommands. Update the structure of fdbcli tenant tests. 2022-09-21 16:22:58 -07:00
Markus Pilman
9c062a220e clarify statistics of TestHarness 2022-09-21 09:29:49 -06:00
Markus Pilman
a8cec4f05c clarify how code probes are reported 2022-09-21 09:27:28 -06:00
Markus Pilman
90b48e862e
Apply suggestions from code review
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
Co-authored-by: Bharadwaj V.R <bharadwaj.vr@snowflake.com>
2022-09-21 08:28:01 -06:00
Markus Pilman
24aced6d4a Upgrade sphinx and document test harness and code probes 2022-09-20 16:43:02 -06:00
Jingyu Zhou
890681a52f Added 7.1.22, 7.1.23 release notes 2022-09-19 20:35:32 -07:00
A.J. Beamon
4fd64630e8 Convert literal string ref instances to use _sr suffix 2022-09-19 11:35:58 -07:00
Junhyun Shim
dcdb347ff1 Address review comments 2022-09-15 21:59:54 +02:00
Junhyun Shim
f57c5f1f16 Further formatting and phrasing changes 2022-09-15 08:13:21 +02:00
Junhyun Shim
e6e67a271c Rephrase client auth requirement 2022-09-14 19:49:59 +02:00
Junhyun Shim
29b89eddae Add description of ALLOW_TOKENLESS_TENANT_ACCESS knob
Also fix typos and formatting
2022-09-14 19:46:05 +02:00
Junhyun Shim
bb3e8e9e5e Add documentation for Authz 2022-09-14 16:23:43 +02:00
A.J. Beamon
726d5215a0
Remove API 720 guards for tenants (experimental feature) and the cluster ID special keys (#8108)
* Remove API 720 guards for tenants (experimental feature) and the cluster ID special keys (no need to guard)

* Enable the relaxed special key access in transactions that need to use special key-space APIs introduced in 7.2
2022-09-08 17:22:36 +02:00
Ata E Husain Bohra
28e608e717
Encryption data at-rest db-config (#7929)
* Encryption data at-rest db-config

Description

 diff-1: Handle 'force' updates to encryption_at_rest db-config

Major changes proposed:
1. Introduce 'encryption_data_at_rest_mode" 'configure new'
option to enable Encryption data at-rest. The feature is disabled
by default.
2. The configuration is meant to be set at the time of database
creation, addition checks will be done to avoid updating the config
in subsequent PR.
3. DatabaseConfiguration validity check to account for "tenant_mode"
set to `required` if Encryption data at-rest is selected given
EncryptionDomain matches Tenant boundaries.

Testing

devCorrectness - 100K
2022-09-02 14:11:38 -07:00
Jingyu Zhou
7abf487c50 Address a comment 2022-08-30 16:01:41 -07:00
Jingyu Zhou
c982f9a370 Add 7.1.20, 7.1.21 release notes 2022-08-30 15:54:08 -07:00
Ata E Husain Bohra
7a056997c7
Improve FDB architecture documentation related to cluster recruitment (#8012)
Description

Improve FDB architecture documentation to explicitly mention that
Stateless processes may get recruited on a single cluster process

Testing
2022-08-29 09:24:13 -07:00
Lukas Joswiak
e705b055b0 Improve wording
Co-authored-by: Bharadwaj V.R <bharadwaj.vr@snowflake.com>
2022-08-23 10:46:59 -07:00
Lukas Joswiak
4a7122c802 Document the three_data_hall_fallback datacenter mode 2022-08-23 10:46:59 -07:00
Chaoguang Lin
3fed0456ca
Add an verify option for \xff\xff/worker_interfaces special keys (#7873)
* Add the verify option for \xff\xff/worker_interfaces

* Remove unused code

* update documentations

* update documentations

* solve comments from review

* update some of the comments to be more clear
2022-08-15 14:05:07 -04:00
Vaidas Gasiunas
f04ab582dd
Add documentation for API Tester (#7869)
* Add documentation for API Tester

* API Tester documentation: addressing review comments
2022-08-15 15:10:15 +02:00
Evan Tschannen
a9d3c9f9b3
Added throttling when a blob worker falls behind (#7751)
* throttle the cluster when blob workers fall behind

* do not throttle on blob workers if they are not enabled

* remove an unnecessary actor

* fixed a compile error

* fetch blob worker metrics at the same interval as the rate is updated, avoid fetching the complete blob worker list too frequently

* fixed another compilation bug

* added a 5 second delay before bw throttling to prevent false positives caused by the 100e6 version jump during recovery. Lower the throttling thresholds to react much quicker to bw lag.

* fixed a number of problems

* changed the minBlobVersionRequest to look at storage server versions since this will be a lot more efficient

* fix: do not let desired go backwards

* fix: track the version of notAtLatest changefeeds for throttling

* ratekeeper now throttled blob workers by estimating the transaction per second throughput of the blob workers

* added metrics for blob worker change feeds

* added a knob to disable bw throttling

* fixed the transaction options in blob manager
2022-08-12 13:15:56 -07:00
Xiaoge Su
0326d53965 Split proxy_memory_limit_exceeded to commit/grv specific exceptions
Currently GRV is reporting proxy_memory_limit_exceeded error which has
error message claiming Commit proxy failing. This split should remove
such confusion.
2022-08-12 00:45:57 -07:00
Jingyu Zhou
7ee6d1719d Added 7.1.18, 7.1.19 release notes 2022-08-09 11:28:05 -07:00
A.J. Beamon
ff23d5994e
Merge pull request #7729 from sfc-gh-ajbeamon/feature-metacluster
Metacluster
2022-08-04 15:29:44 -07:00
Chaoguang Lin
48e46cbc81
Add test coverage for SpecialKeyRangeAsyncImpl::getRange (#7671)
* Add getRange test coverage for SpecialKeyRangeAsyncImpl

* Fix the bug in SpecialKeyRangeAsyncImpl found by the test

* Refactor ConflictingKeysImpl::getRange to use containedRanges to simplify the code

* Fix file format

* Initialize SpecialKeyRangeAsyncImpl cache with correct end key

* Add release notes

* Revert "Refactor ConflictingKeysImpl::getRange to use containedRanges to simplify the code"

This reverts commit fdd298f469bf73b107e5ca29072c49774820d3d6.
2022-08-02 12:04:40 -07:00
A.J. Beamon
7f53b340f5 Merge branch 'main' into feature-metacluster
# Conflicts:
#	bindings/python/tests/fdbcli_tests.py
#	fdbcli/TenantCommands.actor.cpp
#	fdbclient/ClientKnobs.cpp
#	fdbclient/include/fdbclient/ClientKnobs.h
#	fdbclient/include/fdbclient/Tenant.h
#	fdbserver/BlobManager.actor.cpp
#	fdbserver/BlobWorker.actor.cpp
#	fdbserver/TenantCache.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	fdbserver/workloads/TenantManagementWorkload.actor.cpp
#	flow/include/flow/error_definitions.h
2022-07-28 11:43:21 -07:00
A.J. Beamon
9b060aacf6
Merge pull request #7715 from sfc-gh-jfu/jfu-tenant-rename-special-keys
Tenant renaming special key-space support
2022-07-27 16:12:03 -07:00
Jingyu Zhou
38d2d39001 Add 7.1.16, 7.1.17 release notes 2022-07-27 09:53:02 -07:00
A.J. Beamon
7c6b3fb0b8 Merge branch 'main' into feature-metacluster 2022-07-27 08:55:10 -07:00
Jon Fu
fbf566ac4a
Update documentation/sphinx/source/special-keys.rst
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-07-26 15:53:21 -04:00
Jon Fu
0950d82fe5 add documentation and fix merge errors 2022-07-26 11:58:49 -07:00
Jingyu Zhou
88cfaf8793
Merge pull request #7681 from jzhou77/main
Add timeout during Status generation
2022-07-25 11:04:00 -07:00
Jingyu Zhou
16519a9e5f Update status json doc with fetch_storage_wiggler_stats_timeout error 2022-07-24 15:24:21 -07:00
A.J. Beamon
3e1763e7ac Merge branch 'main' into feature-metacluster 2022-07-21 14:48:53 -07:00
A.J. Beamon
190ad8c7e9 Convert existing tuple usages to use Tuple::makeTuple() 2022-07-19 13:45:59 -07:00
A.J. Beamon
1b81e72604 Add a Tuple::makeTuple function to easily construct a tuple. Update Tuple to allow all types to be passed via .append() so they can be used with makeTuple. 2022-07-19 11:50:58 -07:00
A.J. Beamon
c7c7bd5f17 Undo change to mark tenant modes non-experimental. Other minor cleanup. 2022-07-19 09:18:53 -07:00
A.J. Beamon
0fe6f6ad36 Merge remote-tracking branch 'origin/update-prefix-encoding-in-tenant-metadata-json' into feature-metacluster
# Conflicts:
#	bindings/python/tests/fdbcli_tests.py
#	fdbcli/TenantCommands.actor.cpp
#	fdbclient/include/fdbclient/TenantManagement.actor.h
#	fdbclient/include/fdbclient/TenantSpecialKeys.actor.h
#	fdbserver/workloads/TenantManagementWorkload.actor.cpp
2022-07-14 14:32:29 -07:00
A.J. Beamon
cb499fa5db Merge branch 'main' into feature-metacluster 2022-07-13 15:28:34 -07:00