44 Commits

Author SHA1 Message Date
Yi Wu
994b8c92f8
Add option to limit resident memory and remove default memory limit (#6719)
Changing `memory` option to limit resident memory instead of virtual memory, in config file and fdbserver/fdbbackup/fdbcli command-line argument. Since `rlimit` doesn't support limiting virtual memory, the current implementation have both of fdbmonitor and the fdbserver/fdbbackup process checking process RSS periodically and kill and restart the process if the limit is exceeded.

Adding a new `memory_vsize` option to limit virtual memory, if backward-compatible behavior is desired.

closes #6671, closes #6672
2022-04-06 20:06:24 -07:00
A.J. Beamon
f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
A.J. Beamon
f29f487823
Unify flags (#25)
* Unify flags implementation and change help text in backup.actor.cpp
Description

Testing

* Keep LOG_GROUP unchanged

Description

Testing

* Transfer the hyphens to underscores for internal options and user's input, EXCEPT leading hyphens

Description

Testing

* Use a deep copy of the user's input flag to do the match

Description

Testing

* Convert the _ to - in Option arrays of backup.actor.cpp

Description

Testing

* Transter _ to - for files:
        TLSConfig.actor.h, fdbcli.actor.cpp, fdbserver.actor.cpp, FileConverter.h, FileConverter.cpp

Description

Testing

* Change another way to unify flag: using SO_O_ICASE_HYPHEN_AND_UNDERSCORE to determine whether we do the conversion in function IsEqual

Description

Testing

* Change the config command's name from SO_O_ICASE_HYPHEN_AND_UNDERSCORE to SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Update the comment for the SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Fix left underscore in SOption arrays

Description

Testing

* Convert _ to - in several files for commands

Description

Testing

* Make the FDBService and fdbmonitor backward compatible

Description

Testing

* Fix bugs about pointers

Description

Testing

* Check underscore and hyphen at the same time for --knob_, --localily_ and --test_
And fix bugs in fdbmonitor and FDBService
Description

Testing

* Simplify the function in fdbmonitor and FDBService about retrieving arguments.
And fix some documents in masterserver.actor.cpp

Description

Testing

* Convert _ to - for knob in the setKnob functions

Description

Testing

* Convert - to _ in the setKnob functions

Description
Since key in the knob related maps only contain _

Testing

* Rename varialbe name in the fdbmonitor and FDBService for clarification

Description

Testing

Co-authored-by: Chang Liu <chang.liu@snowflake.com>
2021-12-14 08:44:39 -08:00
Oleg Samarin
9adeff4a9a
Update documentation/sphinx/source/configuration.rst
Added a newline to doc

Co-authored-by: A.J. Beamon <ajbeamon@users.noreply.github.com>
2020-10-14 19:39:57 +03:00
Oleg Samarin
bfcf921c3e
Apply suggestions from code review
Missing some colons in doc links

Co-authored-by: A.J. Beamon <ajbeamon@users.noreply.github.com>
2020-10-14 19:16:30 +03:00
Oleg Samarin
d67fc569b1
Apply suggestions from code review
Spellcheck corrections in the doc

Co-authored-by: A.J. Beamon <ajbeamon@users.noreply.github.com>
2020-10-14 10:18:15 +03:00
Oleg Samarin
43f538ff8b Documented fdb processes restart behavior 2020-10-09 11:03:53 +03:00
Young Liu
3278e21b0b Change description of GRV proxy and Commit proxy in docs and add backward compatibility support for configuring proxies in fdbcli 2020-09-25 10:50:48 -07:00
Kyle Snavely
1f3bf85f89
Fix a small typo in the region configuration docs 2020-08-12 11:50:32 -06:00
Evan Tschannen
924d335aa7 Merge branch 'release-6.2'
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	flow/Knobs.cpp
#	flow/Knobs.h
2020-02-25 18:25:19 -08:00
A.J. Beamon
9c9e643334 Fix some various indentation issues that caused weird formatting in the documentation output. 2020-02-21 20:05:48 -08:00
Evan Tschannen
96258b9809 Merge branch 'release-6.2'
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbcli/fdbcli.actor.cpp
#	fdbclient/ManagementAPI.actor.cpp
#	fdbrpc/FlowTransport.actor.cpp
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/DataDistribution.actor.cpp
#	fdbserver/DataDistribution.actor.h
#	fdbserver/DataDistributionQueue.actor.cpp
#	fdbserver/KeyValueStoreMemory.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/QuietDatabase.actor.cpp
#	fdbserver/SkipList.cpp
#	fdbserver/StorageMetrics.actor.h
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/fdbserver.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	fdbserver/workloads/KVStoreTest.actor.cpp
#	flow/CMakeLists.txt
#	flow/Knobs.cpp
#	flow/Knobs.h
#	flow/genericactors.actor.cpp
#	flow/serialize.h
2020-02-21 19:09:16 -08:00
A.J. Beamon
c4a36b9731 Clarify the note about running double replication with replicated disks to mention risks to fault tolerance. 2020-02-21 14:03:37 -08:00
Alex Miller
813b13be76 A variety of minor, yet potentially contentious, documentation changes:
* Don't suggest Windows is more production tested than macOS
* Update multi-region deficencies, as spill-by-reference is the
  default in 6.2+
* Suggest that `double` replication can be reasonable for production
  deployments if the underlying disks are already replicated as well.
2020-01-21 19:22:17 -08:00
Evan Tschannen
688940b685 merge 6.2 into master 2019-10-21 11:43:46 -07:00
Evan Tschannen
35e816e9ad added the ability to configure satellite_logs by satellite location, this will overwrite the region configure if both are present 2019-10-14 18:30:15 -07:00
Meng Xu
d0147e5e5d Merge branch 'release-6.2' into mengxu/merge-release620-to-master-v3
Resolved Conflicts:
	documentation/sphinx/source/release-notes.rst
	fdbserver/DataDistribution.actor.cpp
	versions.target
2019-10-02 13:22:56 -07:00
A.J. Beamon
d7f5cf1c3a FoudnationDB -> FoundationDB
does not a -> does not have a
2019-09-23 09:10:36 -07:00
Evan Tschannen
24aad14f06 Merge branch 'release-6.2'
# Conflicts:
#	CMakeLists.txt
#	documentation/sphinx/source/release-notes.rst
#	versions.target
2019-08-30 17:23:58 -07:00
A.J. Beamon
0815b09629 Reorganize section based on review feedback 2019-08-16 16:05:20 -07:00
A.J. Beamon
a4c3a435e0 Add documentation for missing fdbmonitor [general] parameters. 2019-08-16 16:05:20 -07:00
lingbin
745e569723 Fix an error in configuration.rst 2019-08-15 18:09:09 +08:00
lingbin
c0e657ba7b Fix a typo in configuration.rst 2019-08-08 22:11:15 +08:00
A.J. Beamon
94be9560ea Add cache_memory parameter to fdbserver to control the size of the (4K) page cache. Change the default slighty from 2000 MiB to 2GiB. 2019-07-23 15:05:21 -07:00
A.J. Beamon
a0203457d9 Some rewording in the table describing different replication modes 2019-07-12 16:24:43 -07:00
Adam Feldman
21e574d33d
Fix minor typos in config docs
the each --> east, datacenter have --> datacenters has, mean signal --> signal
2019-05-31 20:00:44 -05:00
Evan Tschannen
4d6334eb90 removed a known limitation about force_recovery_with_data_loss 2019-04-02 15:23:55 -07:00
Adam Kocoloski
0a6d423569 Improve three_data_hall / three_dc descriptions
This patch includes descriptions of the transaction log configurations
for these redundancy modes, and corrects what I believe is an incorrect
statement about the minimum number of machines required to make
progress. It also clarifies that commits require synchronous
replication across datacenters.
2018-12-14 16:31:23 -05:00
Adam Kocoloski
e18713450f Remove outdated information on multi-dc config
The only published datacenter-aware mode is three_datacenter, which
replicates data 6x (not in triplicate) and does replicate each piece of
data to all three datacenters.
2018-12-14 16:04:44 -05:00
A.J. Beamon
975711c389 Merge branch 'release-6.0' of github.com:apple/foundationdb
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
2018-11-27 09:50:39 -08:00
Eric Ma
f3205d0eb6 fix a typo in the document about fstab 2018-11-21 15:03:18 +08:00
Evan Tschannen
4b5d0b4e2c Merge branch 'release-6.0'
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbclient/AsyncFileBlobStore.actor.cpp
#	fdbclient/AsyncFileBlobStore.actor.h
#	fdbclient/BlobStore.actor.cpp
#	fdbclient/BlobStore.h
#	fdbclient/HTTP.actor.cpp
#	fdbclient/ManagementAPI.actor.cpp
#	fdbclient/NativeAPI.actor.cpp
#	fdbrpc/LoadBalance.actor.h
#	fdbrpc/batcher.actor.h
#	fdbrpc/fdbrpc.vcxproj
#	fdbrpc/sim2.actor.cpp
#	fdbserver/DataDistribution.actor.cpp
#	fdbserver/DataDistributionTracker.actor.cpp
#	fdbserver/SimulatedCluster.actor.cpp
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/masterserver.actor.cpp
2018-11-10 13:04:24 -08:00
A.J. Beamon
d54af96ba4 Various fixes to our documentation, such as syntax problems, broken links, etc. 2018-11-01 14:19:37 -07:00
Rick Branson
8a334f4338
Fix docs for three_datacenter mode
According to fdbclient/ManagementAPI.actor.cpp, the three_datacenter mode has a redundancy/replication factor of 6, and distributes the replicas across 3 datacenters and 2 zones within each datacenter.
2018-10-12 16:57:42 -07:00
Paweł Zmarzły
9edd69ee09
Fix broken link in documentation
`https://apple.github.io/performance` -> `https://apple.github.io/foundationdb/performance`
2018-08-13 02:41:02 +02:00
Balachandar Namasivayam
7db928ccec Cluster file and its parent directory needs to be writable for operation of fdb cluster.
Document this requirement and also add relevant details to status output.
2018-06-11 16:47:24 -07:00
Bruce Mitchener
2f8a0240f1
Fix some typos. 2018-04-19 11:44:01 -07:00
Alex Miller
b86e70f77d Add documentation for the TLS Plugin. 2018-04-12 17:17:08 -07:00
bnamasivayam
6fbef3ab39
Change Capitalization at certain places. 2018-03-20 17:24:47 -07:00
Balachandar Namasivayam
15a151fbd0 Update configuration.rst on setting process class. 2018-03-19 14:36:17 -07:00
Balachandar Namasivayam
b51503d420 Update configuration.rst with locality info 2018-03-15 18:08:58 -07:00
Bhaskar Muppana
e6bc7a2815 Fixing status in documenation. 2018-03-15 14:22:19 -07:00
Bhaskar Muppana
02cd7865d8 Fixing timestamps. 2018-03-15 13:17:55 -07:00
John Brownlee
7d1984b4d4 Initial import of cleaned up documentation. 2018-03-13 13:09:35 -07:00