470 Commits

Author SHA1 Message Date
A.J. Beamon
99c9958db7 Some more trace event normalization 2018-06-08 13:57:00 -07:00
A.J. Beamon
c12b235080 Fix case in a few commented out trace events 2018-06-08 11:20:06 -07:00
A.J. Beamon
e5488419cc Attempt to normalize trace events:
* Detail names now all start with an uppercase character and contain no underscores. Ideally these should be head-first camel case, though that was harder to check.
* Type names have the same rules, except they allow one underscore (to support a usage pattern Context_Type). The first character after the underscore is also uppercase.
* Use seconds instead of milliseconds in details.

Added a check when events are logged in simulation that logs a message to stderr if the first two rules above aren't followed.

This probably doesn't address every instance of the above problems, but all of the events I was able to hit in simulation pass the check.
2018-06-08 11:11:08 -07:00
Evan Tschannen
d7d38c3544
Merge pull request #430 from ajbeamon/rename-logGroup-attribute
Rename trace file logGroup attribute to LogGroup
2018-06-08 10:30:45 -07:00
A.J. Beamon
216404de45 Merge branch 'release-5.2' of github.com:apple/foundationdb
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	versions.target
2018-06-06 15:25:37 -07:00
Evan Tschannen
e82985aea2 fix: continue setting beginVersion so that versions between 5.2.0 and 5.2.2 do not crash when decoding tasks created by 5.2.3 2018-06-06 13:34:22 -07:00
Evan Tschannen
4120062bb9 fix: backup initialized its begin version at 1 instead of the read version of the starting transaction
fix: erasing log ranges did not properly divide up work between transactions to prevent making transactions which were too large
2018-06-06 13:05:53 -07:00
A.J. Beamon
e4e06321c7 fix: Read-only transactions that get committed would fail if the readOnly option is set. They would also be counted in the transactionsCommitStarted metric. 2018-06-05 12:10:28 -07:00
Evan Tschannen
ce6a2f0563
Merge pull request #425 from bnamasivayam/leader-election-optimize
Optimize client and server connection times to cluster controller, es…
2018-06-01 18:35:27 -07:00
Balachandar Namasivayam
95f3668a3e Address review comments. 2018-06-01 18:33:29 -07:00
Balachandar Namasivayam
59bfa74197 Address review comments. Refactor getLeader function to mask the first 7 bits of changeID and return the masked LeaderInfo. 2018-06-01 18:23:24 -07:00
Balachandar Namasivayam
529d0497f1 Proxy going OOM when applying high volumes of writes to a proxy, particular in a sudden fashion before ratekeeper can control the workload.
Address this issue by proactively monitoring the memory used by commit batches and dropping requests if a certain memory limit is exceeded.
2018-06-01 15:21:40 -07:00
A.J. Beamon
3ea5fc72f0 Rename trace file logGroup attribute to LogGroup 2018-05-31 15:34:17 -07:00
Balachandar Namasivayam
070366ca70 Optimize client and server connection times to cluster controller, especially in multi DC configurations.
A majority(quorum) answer from co-ordinators was required to connect to cluster controller.
Now a cluster controller is optimistically selected to connect even if there is no quorum.
2018-05-30 16:48:04 -07:00
A.J. Beamon
d9c702a9e3 Merge release-5.1 into release-5.2 2018-05-30 09:09:55 -07:00
A.J. Beamon
026458baf3 Merge release-5.2 into master 2018-05-23 15:32:56 -07:00
Alec Grieser
65e2ab8cd0
pass in transformed keys to input validation with versionstamps
this fixes #387
2018-05-15 17:37:40 -07:00
Alec Grieser
6d132717f2
add versionstamp compatibility test to VersionStampWorkload
surfaces error found in #387
2018-05-15 17:09:24 -07:00
Evan Tschannen
20f61f5cf8 fix: increased the buggified restore batch size to prevent tests from taking too long 2018-05-11 13:26:32 -07:00
Evan Tschannen
91338fc984 Merge branch 'master' into feature-remote-logs 2018-05-10 15:33:45 -07:00
Evan Tschannen
520aaf731d merge release 5.2 into master 2018-05-10 14:33:08 -07:00
Evan Tschannen
714da951a6 refactored getKeyLocation code to remove duplication 2018-05-10 10:05:41 -07:00
Evan Tschannen
8f984cb2c9 Merge branch 'release-5.2'
# Conflicts:
#	fdbrpc/TLSConnection.h
2018-05-10 09:13:22 -07:00
Evan Tschannen
e860cc5994 Merge branch 'release-5.2' of github.com:apple/foundationdb into release-5.2 2018-05-09 17:22:19 -07:00
Evan Tschannen
98e07fd92e fix: clear the client's storage server interface cache on endpoint failure for all request types 2018-05-09 17:11:54 -07:00
Evan Tschannen
d3450ce5b0
Merge pull request #343 from bnamasivayam/tls-plugin
Tls plugin
2018-05-09 16:35:53 -07:00
Balachandar Namasivayam
479dbf4c04 Addressed review comments.
Remove redundant FDBLibTLS/ITLSPlugin.h.
2018-05-09 16:16:09 -07:00
Evan Tschannen
f6e55d0b74
Merge pull request #348 from etschannen/release-5.2
DR upgrade tests now test the durability of the data.
2018-05-09 15:40:03 -07:00
Evan Tschannen
8930c2e3db DR upgrade tests now test the durability of the data. 2018-05-09 15:11:05 -07:00
Alec Grieser
b7f0e358b3
Merge pull request #340 from ajbeamon/move-thread-shutdown-hook-to-iclientapi
Move addNetworkThreadCompletionHook to IClientApi.
2018-05-09 14:45:50 -07:00
Balachandar Namasivayam
7591931a09 Revert "Make tls_verify_peers as a comma separated string of constraints."
This reverts commit 2033847e4b6e04e999c72d538261fdf64302af27.
2018-05-09 14:40:36 -07:00
Balachandar Namasivayam
2033847e4b Make tls_verify_peers as a comma separated string of constraints. 2018-05-09 14:37:39 -07:00
A.J. Beamon
c5d0a04b9e Move external completion hook handling to DLApi. Use camel case for hookParameter. 2018-05-09 12:28:51 -07:00
Alec Grieser
f3093642b3
Merge pull request #242 from alecgrieser/32437306-better-versionstamped-value
Unify SET_VERSIONSTAMPED_KEY and SET_VERSIONSTAMPED_VALUE API
2018-05-09 09:04:07 -07:00
Alec Grieser
8de914a81f
use contents() instead of address of in withPrefix and withSuffix ; whitespace fixes 2018-05-09 09:01:22 -07:00
Balachandar Namasivayam
e8b7f4b190 Add password support for tls. 2018-05-08 20:46:31 -07:00
Balachandar Namasivayam
49af5d685b Restore previous behavior of not specifying peer_verify option means disable checking. 2018-05-08 18:54:44 -07:00
A.J. Beamon
01a3360982 Move addNetworkThreadCompletionHook to IClientApi. 2018-05-08 16:33:43 -07:00
Balachandar Namasivayam
d3b5cfb93c Support latest TLS plugin.
Add support for https in backup.
2018-05-08 16:28:13 -07:00
Evan Tschannen
9f0d244efe Merge branch 'master' into feature-remote-logs 2018-05-08 13:28:23 -07:00
Evan Tschannen
7acdc314e4 Merge branch 'release-5.2'
# Conflicts:
#	fdbrpc/TLSConnection.actor.cpp
2018-05-08 13:22:53 -07:00
Evan Tschannen
1f6c6a886b Merge branch 'release-5.1' into release-5.2 2018-05-08 13:08:11 -07:00
A.J. Beamon
ca720e1540
Merge pull request #297 from apple/release-5.2
Merge 5.2 to Master
2018-05-08 12:04:20 -07:00
Evan Tschannen
24a8c104b4 re-added dev_null option as deprecated to prevent breaking client code which may have called the option. 2018-05-08 11:59:31 -07:00
Alec Grieser
47c9e4f923
update bindings and bindingtester that uses versionstamps to use new protocol
issue #148
2018-05-08 08:57:09 -07:00
Alec Grieser
8987d21df3
use new semantics when writing position of vs key in native api 2018-05-08 08:57:09 -07:00
Alec Grieser
464e2cdbf0
change SetVersionstampedKey and SetVersionstampedValue behavior based on API version to make them consistent 2018-05-08 08:57:09 -07:00
Alec Grieser
6ee14bbb93
expose second versionstamp value type through vexillographer and add support in bindings and bindingtester 2018-05-08 08:57:09 -07:00
Alec Grieser
2167012d83
use littleEndian16/32 instead of rolling our own 2018-05-08 08:57:08 -07:00
Alec Grieser
14cca75429
server components of version of alternative versionstamp op that writes to an arbitrary place in the value 2018-05-08 08:57:08 -07:00