1747 Commits

Author SHA1 Message Date
neethuhaneesha
cb3dac21a9
Release notes for 7.1.38/7.1.39 (#10883) 2023-09-09 10:23:43 -07:00
Zhe Wu
cb1e792169 Fix status json schemas perpetual_storage_wiggle_engine 2023-09-05 11:10:53 -07:00
Zhe Wu
e2f5c50a7b
Merge pull request #10828 from halfprice/zhewu/clear-wiggle-storage-engine
Add option to set perpetual_storage_wiggle_engine to none
2023-09-05 11:06:21 -07:00
Lukas Joswiak
bfb1c51299 Add clearknob fdbcli command
The `clearknob` command clears the value that a knob has been set to in
the configuration database. Note that this does not mean the knob value
itself gets cleared - only the value in the configuration database is
cleared. The value of the knob will revert to whatever is hardcoded in
the corresponding `*Knobs.cpp` file.

Sample `fdbcli` session:

```
Welcome to the fdbcli. For help, type `help'.
fdb> getknob min_trace_severity
`min_trace_severity' is not found
fdb> setknob min_trace_severity 20
Please set a description for the change. Description must be non-empty
description: test
Committed (2)
fdb> getknob min_trace_severity
`min_trace_severity' is `20'
fdb> clearknob min_trace_severity
Please set a description for the change. Description must be non-empty
description: clear
Committed (4)
fdb> getknob min_trace_severity
`min_trace_severity' is not found
```

Transactions are also supported with the new `clearknob` command:

```
Welcome to the fdbcli. For help, type `help'.
fdb> begin
Transaction started
fdb> setknob min_trace_severity 20
fdb> clearknob min_trace_severity
fdb> commit
Please set a description for the change. Description must be non-empty.
description: test
Committed (16)
fdb> getknob min_trace_severity
`min_trace_severity' is not found
```
2023-08-31 17:36:05 -07:00
Zhe Wu
314d1b66a5 Fix StatusWorkload after adding perpetual_storage_wiggle_engine 2023-08-29 13:58:23 -07:00
Johannes Scheuermann
957573da02
Update C documentation of installed files and locations (#10737)
Update C documentation of installed files and locations
2023-08-22 16:21:26 -05:00
He Liu
3b295b4c93
Release notes for 7.1.36/37. (#10768) 2023-08-11 14:35:08 -07:00
Aaron Molitor
195e51cb21 update release notes 2023-08-10 16:48:08 -05:00
FoundationDB CI
c71a6834a2
remove release notes files that are blocking CI builds 2023-08-07 21:22:13 +00:00
Jingyu Zhou
7691835a66
Merge pull request #10728 from apple/ahusain/release-notes-71.3.2-main
Release notes snowflake/71.3.2
2023-08-07 14:17:40 -06:00
Ata E Husain Bohra
67b9543e77 Release notes snowflake/71.3.2
Description

Release notes snowflake/71.3.2

Testing
2023-08-03 08:44:45 -07:00
Ata E Husain Bohra
188a383a2f Merge branch 'main' into ahusain/release-notes-71.3.0 2023-07-31 11:32:08 -07:00
Ata E Husain Bohra
d634f9247c Remove the latest release marker
Description

Testing
2023-07-31 11:31:32 -07:00
Aaron Molitor
71510aafb3 remove errant release notes file 2023-07-31 12:32:42 -05:00
Ata E Husain Bohra
33b98d91bc Address review comments
Description

Testing
2023-07-28 15:03:58 -07:00
Jingyu Zhou
e1bde1ebf3
Merge pull request #10668 from apple/ahusain/release-notes-71.3.1-main
Release notes - snowflake/71.3.1
2023-07-28 10:28:37 -07:00
Jingyu Zhou
b39c8ef7cb
Add 7.1.34, 7.1.35 release notes (#10695) 2023-07-28 08:45:22 -07:00
Ata E Husain Bohra
f642c3e2e9 Release notes - snowflake/71.3.1
Description

Release notes - snowflake/71.3.1a

Testing
2023-07-24 09:17:21 -07:00
Ata E Husain Bohra
454c5a62b1 Release notes - snowflake/release-71.3
Description

Release notes for snowflake/release-71.3

Testing
2023-07-24 09:14:20 -07:00
Yanqin Jin
09d44d9d9f Merge remote-tracking branch 'origin/main' into update-doc-building_cluster 2023-07-02 16:43:55 -07:00
Jingyu Zhou
e5728fcb84
Fix the version for deprecated keys (#10553) 2023-06-26 13:49:41 -07:00
Zhe Wu
5c8a163c72
Update main branch to 7.4 (#10459)
* Update main branch to 7.4

* Update API version to 740

* Makes fdb_c_client_config_tests.py passing after API version update

* Remove from_7.3.0_until_7.4.0 and add from_7.3.0

* Update tests in fdb_c_client_config_tests.py
2023-06-15 10:19:39 +02:00
Josh Slocum
31e4610b56
misc operational and documentation improvements (#10465)
* misc operational and documentation improvements

* fixing doc build
2023-06-12 15:14:01 -05:00
Yanqin Jin
c87be8e5b8
Update documentation/sphinx/source/building-cluster.rst
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-05-24 21:33:49 -07:00
Josh Slocum
2916a11a86
New ConsistencyScan (#10265)
* Remove duplicate getRange() for DB handles and update existing GetRange to accept DB handles.

* Initial progress checkpoint on new ConsistencyScan role.

* Updated TODOs, finished most if not all state updates.

* placeholder

* Add more TODOs, documentation and comment improvements.

* Checkpoint round state to avoid advancing progress if commit fails.

* Bug fix, check is supposed to be for overlap, not lack of overlap.

* Added more TODO's and added faked read results / exceptions and faked DB size retrieval to prove the consistencyScanCore logic works.

* Update JSON schemas and command help.

* Add comment about lifetime stats reset.

* More TODO comments and some renames for clarity, some bug fixes.

* properly stopping consistency scan in simulation so that it doesn't run forever and cause quiet database to fail

* removing trailing comma from consistency_scan json schema

* Making CC inconsistency not an error if it's intentional tss corruption

* consistency scan actually reads storage locations

* added check that consistency scan actually completes a round in simulation, fixed bug and added debugging around consistency scan getting stuck

* made consistency scan properly fetch database size

* refactoring data check to be used in both consistency scan and consistency check

* checking that consistency scan always completes at least one round and doesn't get stuck

* cleanup

* fixing ide build

* consistencyscan fdbcli command wasn't actually changing db state

* consistencyscan fdbcli command always said enabled even when it wasn't

---------

Co-authored-by: Steve Atherton <steve.atherton@snowflake.com>
2023-05-18 15:02:41 -05:00
Sam Gwydir
6c16875c34
Add networkoption to disable non-TLS connections (#9984)
* Add networkoption to disable non-TLS connections

* add disable plaintext connection to fdbserver

* python doc

* Formatting

* Add tls disable plaintext connection to client api test

* review

* fix negative test

* formatting

* add TLS support to c client config tests

Adds support for TLS in the client and server separately

* add tests for disable_plaintext_connections

Test TLS and Plaintext Clusters and Clients

* Fix documentation

* Rename option to indicate it is client-only

* clearer formatting

* default to allowing plaintext connections

* add SetTLSDisablePlaintextConnection to go bindings
2023-05-13 00:14:11 +02:00
Zhe Wu
e3490a1af8 Update API version to 730 2023-05-10 11:26:46 -07:00
Jingyu Zhou
dd25fae3d9
Add 7.1.32, 7.1.33 release notes (#10122) 2023-05-03 14:56:43 -07:00
Xiaoxi Wang
3605d8c74c populate storage metadata for tss 2023-05-01 18:08:08 -07:00
A.J. Beamon
b258159d3a Change enum capitalization. Improve error reporting if we cannot read metacluster registration when fetching metacluster metrics. Improve timeliness of metacluster metrics updates. 2023-05-01 11:21:42 -07:00
Jingyu Zhou
c5b8908828
Update 7.1.30 release notes (#9887) 2023-04-04 14:31:21 -07:00
neethuhaneesha
44fba4e84c
RocksDB 7.10.2 version upgrade (#9828) 2023-04-03 10:01:22 -07:00
Jingyu Zhou
f94257e9a3
Add 7.1.30, 7.1.31 release notes (#9823) 2023-03-28 13:13:11 -07:00
Alex Miller
249588146b Make fdbmonitor understand $PID, so that --parentpid is usable on fdbserver.
Previously, --parentpid was only supported on windows.  #1496 extended that
to other platforms for a CI usecase.  On Linux, `prctl(PR_SET_PDEATHSIG,
SIGHUP)` should arrange for the subsequently exec()'d fdbserver to get a SIGHUP
and die if fdbmonitor is killed.  In local testing, I've confirmed that this
works, but I've also seen evidence that on some hosts/clusters it appears to
possibly not work.

Therefore, having --parentpid as a backup for the cases where it seems like
hosts might not properly support PR_SET_PDEATHSIG is nice.
2023-03-28 10:05:00 -07:00
A.J. Beamon
45056370b8 Merge branch 'main' into metacluster-improvements 2023-03-13 13:14:09 -07:00
Jingyu Zhou
d6a7708de3 Added 7.1.28 and 7.1.29 release notes 2023-03-12 21:34:02 -07:00
A.J. Beamon
605fdacd64 Fix misplaced link in fdbcli documentation 2023-03-07 11:48:21 -08:00
Steve Atherton
5ff0bc3f87
Merge pull request #9576 from sfc-gh-satherton/storage-configure-refactor
Storage and log engine configuration support / refactor a few things.
2023-03-07 02:10:14 -08:00
Chaoguang Lin
7273723a43
Add the hotrange fdbcli command (#9570)
* Add the hotrange fdbcli command

* Remove the unnecessary state

* Add the doc about the hotrange command
2023-03-06 14:46:52 -08:00
Steve Atherton
50d567b5a5 Refactored some parts of database configuration to support log_engine=<name> and storage_engine=<name> and generate these when converting a DatabaseConfig JSON object to a configure command. Refactored fileconfigure and simulation setup to use the same JSON -> configure function as the same code was copy/pasted to both places but only one has been kept up to date with new features. Renamed Redwood to ssd-redwood-1 canonically but the experimental name is still supported for backward compatibility. 2023-03-04 20:52:31 -08:00
Vaidas Gasiunas
93c5147e03
Add documentation for fdb_database_get_client_status (#9471)
* Documentation for fdb_database_get_client_status

* Update documentation of fdb_database_get_client_status
2023-02-28 10:08:04 +01:00
Xiaoxi Wang
c26ef88059 knob lower case 2023-02-25 09:26:21 -08:00
Xiaoxi Wang
998a5b7c0e enable read-aware DD by default and write release notes/doc 2023-02-24 11:11:25 -08:00
sfc-gh-tclinkenbeard
09ad864eb5 Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2023-02-08 11:25:14 -08:00
Steve Atherton
b1ed45688e Added documentation for consistencyscan CLI command. 2023-01-31 23:09:28 -08:00
Lukas Joswiak
2b5c0ebe7b Add version epoch to status json
Adds a new `version_epoch` object to `status json`, which includes the
status of the feature, and the current epoch if it is enabled. If the
version epoch is disabled, the `epoch` field will not be present.

```
{
    "client" : {
        ...
    },
    "cluster" : {
        ...
        "version_epoch" : {
            "enabled" : "true",
            "epoch" : "100000"
        },
        ...
    }
}
```
2023-01-30 13:21:19 -08:00
Yanqin Jin
f346df606f Merge remote-tracking branch 'origin/main' into update-doc-building_cluster 2023-01-20 11:20:56 -08:00
Yanqin Jin
f37c84f928 Address comments 2023-01-20 11:20:50 -08:00
Jingyu Zhou
19f027d7c3 Add 7.1.26, 7.1.27 release notes 2023-01-19 20:03:38 -08:00
Yanqin Jin
35f4d20b8d Address review comments 2023-01-19 17:05:14 -08:00