1620 Commits

Author SHA1 Message Date
A.J. Beamon
1519f24f77 Merge branch 'main' into feature-metacluster 2022-07-07 09:35:40 -07:00
A.J. Beamon
c4b0f6eaae
Add an internal C API to support connection to a cluster using a connection string (#7438)
* Add an internal C API to support memory connection records

* Track shared state in the client using a unique and immutable cluster ID from the cluster

* Add missing code to store the clusterId in the database state object

* Update some arguments to pass by const&
2022-07-07 10:12:49 +02:00
A.J. Beamon
c9b553663e Merge branch 'main' into feature-metacluster
# Conflicts:
#	bindings/java/src/main/com/apple/foundationdb/TenantManagement.java
#	fdbcli/TenantCommands.actor.cpp
#	fdbclient/NativeAPI.actor.cpp
#	fdbclient/TenantSpecialKeys.actor.cpp
#	fdbclient/include/fdbclient/KeyBackedTypes.h
#	fdbclient/include/fdbclient/RunTransaction.actor.h
#	fdbclient/include/fdbclient/SpecialKeySpace.actor.h
#	fdbserver/workloads/TenantManagementWorkload.actor.cpp
2022-07-06 15:44:21 -07:00
Jon Fu
df1f108b78 Merge branch 'main' of github.com:apple/foundationdb into jfu-tenant-rename 2022-07-06 14:10:22 -07:00
A.J. Beamon
2f67328a0c Update the tenant special keys submodule to support multiple sub-ranges. This will enable future work that allows configuring tenants at the same time as creating them. 2022-06-30 15:03:37 -07:00
A.J. Beamon
e1a93988ef Merge branch 'main' into feature-metacluster 2022-06-28 14:58:07 -07:00
Jon Fu
f431ac58a8 address code review comments 2022-06-28 11:35:55 -07:00
Jon Fu
ddfdbdcb09 initial commit introducing renameTenant function 2022-06-28 11:34:44 -07:00
A.J. Beamon
309f244f78
Merge pull request #7449 from sfc-gh-ajbeamon/get_tenant_json
Add support for getting tenant metadata as a JSON document
2022-06-27 14:21:06 -07:00
Jingyu Zhou
a7e71cbac2 Add 7.1.10, 7.1.11 release notes 2022-06-27 15:52:03 -04:00
A.J. Beamon
f990fba44d Add support for getting tenant metadata as a JSON document. 2022-06-27 12:34:40 -07:00
A.J. Beamon
9f3819752f Change the command to create a metacluster from using 'configure tenant_mode=management' to 'metacluster create <NAME>'. Distribute this name to all processes in a metacluster. Eliminate the tenant mode entirely from metacluster clusters, instead relying on a metacluster registration key. 2022-06-22 12:15:43 -07:00
Hao Fu
9cee4c94e7
Safely remove fdb_transaction_get_range_and_flat_map (#7314) 2022-06-13 19:05:00 -07:00
Zhanwei Wang
e632aef1c7
Make backup work with s3 compatible service (#6355)(#6382) (#7324)
1. Support virtual hosting endpoint.

2. On-premise s3 compatible storage service may use IP instead of s3 form domain name,
especially for development/test environment.

Instead of parsing service and region from domain name,

1). Hard code "s3" as service name in v4 signature
2). Add new parameter to allow pass region name from url

3. Fix creating bucket issue on aws, adding request body.
2022-06-13 13:33:05 -07:00
Jingyu Zhou
d0c5449d5c Add 7.1.8 and 7.1.9 release notes 2022-06-10 15:09:10 -07:00
A.J. Beamon
739fc9ce6b Merge branch 'main' into feature-metacluster 2022-06-09 12:39:34 -07:00
Jingyu Zhou
217ba24b6f Add rss_bytes to process memory and fix available_bytes calculation
Since memory is now limited with RSS size, add RSS size in status json for
reporting. Also change how available_bytes is calculated from:
  (available + virtual memory) * process_limit / machine_limit
to:
  (available memory) * process_limit / machine_limit
2022-06-07 16:44:14 -07:00
A.J. Beamon
2907aafa60 Merge branch 'main' into feature-metacluster 2022-06-02 12:18:42 -07:00
Josh Slocum
07adc873a6 Add documentation for aws sdk auth 2022-05-26 13:18:25 -05:00
Jingyu Zhou
47f2118cb0 Update 7.1.6 and 7.1.7 release notes. 2022-05-25 13:30:48 -07:00
A.J. Beamon
804bd8d3e2 Remove documentation of the tenant prefix configuration key. 2022-05-23 13:28:40 -07:00
A.J. Beamon
69261f9f10 Merge branch 'main' into feature-metacluster
# Conflicts:
#	fdbclient/MultiVersionTransaction.actor.cpp
#	fdbclient/MultiVersionTransaction.h
#	fdbserver/tester.actor.cpp
2022-05-19 09:11:30 -07:00
Sagar Vemuri
ebf11d5d48 Update schemas with the tenants information 2022-05-16 11:09:10 -07:00
Jingyu Zhou
e4ac7ab1d9 Update release notes 7.1.0 through 7.1.5 2022-05-12 22:27:19 -07:00
A.J. Beamon
85019612d4 Remove subordinate mode and instead use a key in the system key-space to track metacluster membership. Use this key to determine if a cluster is already part of a metacluster or can be configured away from required mode. Disallow configuring to or from a management cluster that has data. 2022-05-11 17:10:55 -07:00
A.J. Beamon
7e860dc92c Some initial metacluster implementation 2022-05-03 12:53:35 -07:00
greid
508ee73f86 Fix compile errors in Java tutorial code
Use CompletableFuture::join instead of CompletableFuture::get
when blocking on futures in java tutorial snippets. This avoids
the unreported checked exceptions which prevent the snippets from
compiling (and is in line with the full tutorial code).
2022-04-26 14:10:05 -07:00
A.J. Beamon
1352083d4c
Merge pull request #6884 from sfc-gh-clin/deprecate-speical-keys
Remove the client profiling special keys and update related documentations
2022-04-21 21:51:16 -07:00
Zhe Wang
6c9ff6ee5e
Add sharded rocksdb type (#6862)
* add-sharded-rocksdb-type

* address comments

Co-authored-by: Zhe Wang <zhewang@Zhes-MacBook-Pro.local>
2022-04-21 22:53:14 -04:00
Chaoguang Lin
4b1d22d684 Polish the documentation 2022-04-21 19:28:50 -07:00
Chaoguang Lin
879eb98dec Rename registerSpecialKeySpaceModule to registerSpecialKeysImpl 2022-04-21 12:54:34 -07:00
Chaoguang Lin
588041f977 Polish words according to comments 2022-04-21 12:40:32 -07:00
Chaoguang Lin
9f110b0f51 Update documentations and comments 2022-04-21 10:19:44 -07:00
Xiaoxi Wang
2fd640b0d0 fix doc compilation 2022-04-20 21:27:22 -07:00
Xiaoxi Wang
5d5dae9a0c update release note 2022-04-20 21:27:22 -07:00
Chaoguang Lin
6bfa4f6ac4 Fix typos; Polish documentations according to comments 2022-04-19 13:57:11 -07:00
Chaoguang Lin
36c876b769 Fix a typo; Fix a format error in special-keys.rst 2022-04-18 18:10:17 -07:00
Chaoguang Lin
4af36fa9ea Update documentations 2022-04-18 17:59:28 -07:00
Chaoguang Lin
c0264a8522 Remove the client profiling special keys and update related documentations 2022-04-18 17:54:50 -07:00
Ray Jenkins
865b5f1ff8 Substitute other with author. 2022-04-18 14:50:30 -05:00
Ray Jenkins
28ee6fd7b2 Fix typo, expose a function... 2022-04-18 14:45:03 -05:00
Aaron Molitor
63a2e317fb update version to 7.2.0 -- pr comment 2022-04-11 23:23:27 -05:00
Aaron Molitor
cbaef8f03b update version to 7.2.0 2022-04-11 23:23:27 -05:00
Tao Lin
73ed34d2fb Fixes #6793: Upgrade from 7.0.0 to 7.1.0 fails because of missing function fdb_transaction_get_mapped_range 2022-04-08 09:32:18 -07:00
Yi Wu
994b8c92f8
Add option to limit resident memory and remove default memory limit (#6719)
Changing `memory` option to limit resident memory instead of virtual memory, in config file and fdbserver/fdbbackup/fdbcli command-line argument. Since `rlimit` doesn't support limiting virtual memory, the current implementation have both of fdbmonitor and the fdbserver/fdbbackup process checking process RSS periodically and kill and restart the process if the limit is exceeded.

Adding a new `memory_vsize` option to limit virtual memory, if backward-compatible behavior is desired.

closes #6671, closes #6672
2022-04-06 20:06:24 -07:00
Ray Jenkins
0c56de19c8 Merge branch 'main' into opentracing-dep-710 2022-04-06 18:02:42 -05:00
Ray Jenkins
7e773fe13c OpenTracing deprecation notice. 2022-04-06 16:16:41 -05:00
Jon Fu
08838fada6 remove duplicate label of release notes 2022-04-06 16:52:59 -04:00
Jon Fu
e12d623e94 Add release notes for grv cache in 7.1 2022-04-06 16:26:28 -04:00
Steve Atherton
d9ca18effa Add release notes template for 7.1. 2022-04-06 12:18:10 -07:00