1692 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard
0f14647bbf Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2023-01-05 08:10:49 -08:00
Andrew Noyes
91a2010a34 Add .cluster.idempotency_ids to status json 2022-12-14 07:37:44 -08:00
sfc-gh-tclinkenbeard
4b6098931c Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2022-12-04 08:40:04 -08:00
Lukas Joswiak
ecfb6e4f5d Fix typo 2022-11-22 11:20:04 -08:00
sfc-gh-tclinkenbeard
118fdd3f43 Addressed review comments 2022-11-21 09:27:02 -08:00
sfc-gh-tclinkenbeard
453f3f44c6 Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2022-11-21 09:17:48 -08:00
Jon Fu
50d616bb69 add metacluster status details to schemas 2022-11-17 12:59:59 -08:00
Jon Fu
349f5821d7
Merge pull request #8592 from sfc-gh-jfu/tenant-list-filter
Add option to filter the tenant list command for metacluster
2022-11-17 09:04:58 -08:00
Junhyun Shim
72166b5a5b Update authorization documentation 2022-11-15 14:43:44 +01:00
sfc-gh-tclinkenbeard
37b992c405 Add tag throttling functions in C bindings to api-c.rst 2022-11-13 15:37:17 -08:00
Jon Fu
631538537f Merge branch 'main' of github.com:apple/foundationdb into tenant-list-filter 2022-11-09 10:45:45 -08:00
Jingyu Zhou
ec471aa63c
Merge pull request #8684 from jzhou77/fix
Fix ASan failure heap use after free in status json generation
2022-11-03 18:48:26 -07:00
Josh Slocum
d68cd3493e
making read caching configurable for blob store (#8607) 2022-11-03 16:42:46 -05:00
Jingyu Zhou
2a5ff5bba5 Update 7.1 release notes 2022-11-03 12:45:01 -07:00
Jon Fu
8ef0411b32 address code review comments and introduce offset parameter 2022-11-03 11:39:39 -07:00
Jingyu Zhou
80afd5e449 Add 6.3.25 release notes
Documentation only change.
2022-11-02 15:52:43 -07:00
Jingyu Zhou
81e0e7c4df Add 7.1.24, 7.1.25 release notes 2022-11-02 15:16:19 -07:00
Jon Fu
f21fcf67ce initial commit to allow tenant list filtering in metacluster 2022-10-25 12:01:29 -07:00
Vaidas Gasiunas
feee5ddb80 Updating API Tester documentation 2022-10-21 14:21:55 +02:00
Nim Wijetunga
025359a974
Add Options to restore user/system keys in backup agent (#8497)
* add options to restore user/system keys

* format help commands

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbbackup/backup.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbbackup/backup.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* address pr comments

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-10-20 09:58:00 -07:00
Zhe Wu
550e1e86e8 Also add fetch_consistency_scan_info_timeout to mr-status-json-schemas.rst.inc 2022-10-17 15:35:32 -07:00
Kevin Hoxha
2f898fb006 fdbcli: Add documentation for setknob/getknob commands 2022-10-11 15:32:01 -07:00
Jon Fu
461e42bfe1 restructure updater code and add capacity check in metacluster management workload 2022-09-29 16:24:02 -07:00
Jon Fu
a29b853979 add assigned_cluster to tenant command hints in fdbcli 2022-09-29 12:18:30 -07:00
Sam Gwydir
61ce598aef Specify cert and key files separately 2022-09-26 11:59:42 -07:00
Sam Gwydir
a5a0028e65 document TLS cert and key file behavior change. 2022-09-26 11:37:24 -07:00
A.J. Beamon
97a325adab Add an fdbcli command to get tenant group metadata 2022-09-22 13:24:21 -07:00
A.J. Beamon
64c8e0e2b1 Convert fdbcli tenant commands to a single command with subcommands. Update the structure of fdbcli tenant tests. 2022-09-21 16:22:58 -07:00
Markus Pilman
9c062a220e clarify statistics of TestHarness 2022-09-21 09:29:49 -06:00
Markus Pilman
a8cec4f05c clarify how code probes are reported 2022-09-21 09:27:28 -06:00
Markus Pilman
90b48e862e
Apply suggestions from code review
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
Co-authored-by: Bharadwaj V.R <bharadwaj.vr@snowflake.com>
2022-09-21 08:28:01 -06:00
Markus Pilman
24aced6d4a Upgrade sphinx and document test harness and code probes 2022-09-20 16:43:02 -06:00
Jingyu Zhou
890681a52f Added 7.1.22, 7.1.23 release notes 2022-09-19 20:35:32 -07:00
A.J. Beamon
4fd64630e8 Convert literal string ref instances to use _sr suffix 2022-09-19 11:35:58 -07:00
Junhyun Shim
dcdb347ff1 Address review comments 2022-09-15 21:59:54 +02:00
Junhyun Shim
f57c5f1f16 Further formatting and phrasing changes 2022-09-15 08:13:21 +02:00
Junhyun Shim
e6e67a271c Rephrase client auth requirement 2022-09-14 19:49:59 +02:00
Junhyun Shim
29b89eddae Add description of ALLOW_TOKENLESS_TENANT_ACCESS knob
Also fix typos and formatting
2022-09-14 19:46:05 +02:00
Junhyun Shim
bb3e8e9e5e Add documentation for Authz 2022-09-14 16:23:43 +02:00
A.J. Beamon
726d5215a0
Remove API 720 guards for tenants (experimental feature) and the cluster ID special keys (#8108)
* Remove API 720 guards for tenants (experimental feature) and the cluster ID special keys (no need to guard)

* Enable the relaxed special key access in transactions that need to use special key-space APIs introduced in 7.2
2022-09-08 17:22:36 +02:00
Ata E Husain Bohra
28e608e717
Encryption data at-rest db-config (#7929)
* Encryption data at-rest db-config

Description

 diff-1: Handle 'force' updates to encryption_at_rest db-config

Major changes proposed:
1. Introduce 'encryption_data_at_rest_mode" 'configure new'
option to enable Encryption data at-rest. The feature is disabled
by default.
2. The configuration is meant to be set at the time of database
creation, addition checks will be done to avoid updating the config
in subsequent PR.
3. DatabaseConfiguration validity check to account for "tenant_mode"
set to `required` if Encryption data at-rest is selected given
EncryptionDomain matches Tenant boundaries.

Testing

devCorrectness - 100K
2022-09-02 14:11:38 -07:00
Jingyu Zhou
7abf487c50 Address a comment 2022-08-30 16:01:41 -07:00
Jingyu Zhou
c982f9a370 Add 7.1.20, 7.1.21 release notes 2022-08-30 15:54:08 -07:00
Ata E Husain Bohra
7a056997c7
Improve FDB architecture documentation related to cluster recruitment (#8012)
Description

Improve FDB architecture documentation to explicitly mention that
Stateless processes may get recruited on a single cluster process

Testing
2022-08-29 09:24:13 -07:00
Lukas Joswiak
e705b055b0 Improve wording
Co-authored-by: Bharadwaj V.R <bharadwaj.vr@snowflake.com>
2022-08-23 10:46:59 -07:00
Lukas Joswiak
4a7122c802 Document the three_data_hall_fallback datacenter mode 2022-08-23 10:46:59 -07:00
Chaoguang Lin
3fed0456ca
Add an verify option for \xff\xff/worker_interfaces special keys (#7873)
* Add the verify option for \xff\xff/worker_interfaces

* Remove unused code

* update documentations

* update documentations

* solve comments from review

* update some of the comments to be more clear
2022-08-15 14:05:07 -04:00
Vaidas Gasiunas
f04ab582dd
Add documentation for API Tester (#7869)
* Add documentation for API Tester

* API Tester documentation: addressing review comments
2022-08-15 15:10:15 +02:00
Evan Tschannen
a9d3c9f9b3
Added throttling when a blob worker falls behind (#7751)
* throttle the cluster when blob workers fall behind

* do not throttle on blob workers if they are not enabled

* remove an unnecessary actor

* fixed a compile error

* fetch blob worker metrics at the same interval as the rate is updated, avoid fetching the complete blob worker list too frequently

* fixed another compilation bug

* added a 5 second delay before bw throttling to prevent false positives caused by the 100e6 version jump during recovery. Lower the throttling thresholds to react much quicker to bw lag.

* fixed a number of problems

* changed the minBlobVersionRequest to look at storage server versions since this will be a lot more efficient

* fix: do not let desired go backwards

* fix: track the version of notAtLatest changefeeds for throttling

* ratekeeper now throttled blob workers by estimating the transaction per second throughput of the blob workers

* added metrics for blob worker change feeds

* added a knob to disable bw throttling

* fixed the transaction options in blob manager
2022-08-12 13:15:56 -07:00
Xiaoge Su
0326d53965 Split proxy_memory_limit_exceeded to commit/grv specific exceptions
Currently GRV is reporting proxy_memory_limit_exceeded error which has
error message claiming Commit proxy failing. This split should remove
such confusion.
2022-08-12 00:45:57 -07:00