4432 Commits

Author SHA1 Message Date
Evan Tschannen
48b1b20f67 Fixed a crash related to destruction order in data distribution 2020-05-10 23:14:19 -07:00
Evan Tschannen
f17f00fdd5 Merge branch 'release-6.2'
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
2020-05-10 22:33:38 -07:00
Meng Xu
67ead730cc
Merge pull request #3122 from sfc-gh-anoyes/anoyes/fix-get-exception-contract
Allow error_code_special_keys_no_module_found
2020-05-10 18:15:11 -07:00
Evan Tschannen
d0b414ddf2
Merge pull request #3121 from etschannen/master
Added a large random delay on failure detection
2020-05-10 17:59:51 -07:00
Evan Tschannen
9d1df2aa58 fix: the first CPU estimate could be wrong enough to cause stalls on a newly recruited proxy 2020-05-10 17:50:09 -07:00
Evan Tschannen
3eaa9d6397 fix: do not report datacenter version difference before both datacenters report a correct version 2020-05-10 17:49:09 -07:00
Evan Tschannen
b1bd5ef83e
Merge pull request #3120 from satherton/feature-redwood
Redwood read concurrency limit, some knobs, and memory-only Pager mode.
2020-05-10 17:34:41 -07:00
Andrew Noyes
4dc458d93c Allow error_code_special_keys_no_module_found
When getting a special key and the relaxed option isn't set
2020-05-11 00:18:40 +00:00
Evan Tschannen
07111f0e41 add a large random delay on failure detection so that not all storage servers need to attempt to become the cluster controller 2020-05-10 17:09:33 -07:00
Steve Atherton
43f9e4dfad Implemented concurrent read limit in IKeyValueStore interface for Redwood. Added knobs for Redwood page size, concurrent read limit, and page fill factor. Changed commitSubtree() recursion back to use a vector and waitForAll() because it seems to be lower overhead than ActorCollection. 2020-05-10 16:13:22 -07:00
Evan Tschannen
2ecea80539 removed unneeded debugging 2020-05-10 14:26:40 -07:00
Evan Tschannen
048201717c Fixed a number of problems with monitorLeaderRemotely 2020-05-10 14:20:50 -07:00
Steve Atherton
ffbed1d84c Use actor collection for subtree recursions. 2020-05-10 11:44:07 -07:00
Steve Atherton
f306666e21 Added commonPrefixLength for StringRefs that takes a prefix skip length. 2020-05-10 04:24:11 -07:00
Steve Atherton
5bb5bd2fd5 Improvements to Redwood set benchmark to improve readability and limit commit sizes to a record count or byte limit. 2020-05-10 04:21:25 -07:00
Steve Atherton
2ed43ebdf7 Added a non-persistent, memory-only option to DWALPager. 2020-05-10 02:19:19 -07:00
Evan Tschannen
0957b33948
Merge pull request #3107 from etschannen/feature-fast-keyserver-decode
optimized decodeKeyServersValue on the proxy when loading all key ranges on startup
2020-05-09 18:05:29 -07:00
Evan Tschannen
6fca885b9d revert strage class monitor leader because of correctness issues 2020-05-09 18:03:59 -07:00
Evan Tschannen
f9518c3441
Merge pull request #3069 from alexmiller-apple/tls-connection-count
YOLO at reducing TLS connection count via doing monitorLeader on coordinators
2020-05-09 17:12:27 -07:00
Evan Tschannen
9d5e37f1a8 optimized decodeKeyServersValue on the proxy when loading all key ranges on startup 2020-05-09 16:54:35 -07:00
Evan Tschannen
ebf141c84b
Merge pull request #3103 from etschannen/feature-optimize-ss
Refactored some actors in the storage server to improve performance
2020-05-09 16:35:06 -07:00
Evan Tschannen
dbdf6ddbd7 removed an unnecessary try/catch 2020-05-09 16:00:36 -07:00
Andrew Noyes
8bd5dcaff8 Merge branch 'master' into atn34/special-key-versioning 2020-05-09 15:34:20 -07:00
Evan Tschannen
f298436db7 made the style consistent 2020-05-09 15:17:22 -07:00
Evan Tschannen
d497910fa2 fixed merge conflict 2020-05-09 13:34:51 -07:00
Evan Tschannen
69affebe40 merge master 2020-05-09 13:29:18 -07:00
Evan Tschannen
2dfae85dc7 the delay for reads is about 15% of the total cost of the read, so start multiple reads with the same delay 2020-05-09 13:26:38 -07:00
A.J. Beamon
02307ba7b6 Merge branch 'master' into transaction-tagging
# Conflicts:
#	fdbclient/DatabaseContext.h
2020-05-09 07:50:29 -07:00
Steve Atherton
e4006c4b63 Apply clang-format. 2020-05-09 02:21:26 -07:00
Evan Tschannen
a4fc593a3a refactored some actors in the storage server to improve performance 2020-05-08 21:08:52 -07:00
Evan Tschannen
cec63f2429
Merge pull request #3101 from satherton/feature-redwood
Redwood Update - Internal page incremental updates and efficient cleared/unchanged subtree skipping
2020-05-08 19:53:42 -07:00
Andrew Noyes
a53d05ea2d Fix bug and add test 2020-05-09 02:46:40 +00:00
Evan Tschannen
ee0be88b99 consistency check can use a UIDtoTag map at a different version from the keyservers which could result in missing entries 2020-05-08 17:45:06 -07:00
Evan Tschannen
f0f52fb2be Merge branch 'master' into feature-small-endpoint
# Conflicts:
#	fdbclient/StorageServerInterface.h
2020-05-08 16:37:35 -07:00
Evan Tschannen
8166e1af8b Storage server tags cannot change once used in the keyServer location map 2020-05-08 16:17:10 -07:00
Steve Atherton
163b291785 CommitSubtree() now skips recursing into adjacent subtrees that are uniformly cleared or unchanged very efficiently. This will be a huge reduction in CPU usage for random workloads. 2020-05-08 15:24:40 -07:00
Steve Atherton
1966dbb576 Checkpointing large refactor of how commitSubtree() works regarding internal pages such that now they can be incrementally modified and detecting changes involves far fewer comparison and staging of records. 2020-05-08 07:11:51 -07:00
Alex Miller
383099aef3 Bug fixes to get it actually doing the right thing:
* Intialize electionResult when constructing with NetworkAddress.
* Return after sending a reply.
* Reset the reply promise on each new request.
2020-05-08 01:00:18 -07:00
Andrew Noyes
d75a9d0062 Don't set SPECIAL_KEY_SPACE_RELAXED for test within one module 2020-05-08 05:37:37 +00:00
Andrew Noyes
1f40b552f6 Update existing usages of worker_interfaces to new format 2020-05-08 05:37:37 +00:00
Andrew Noyes
ce0e03a800 Add virtual destructor to SpecialKeyRangeBaseImpl 2020-05-08 05:37:37 +00:00
Andrew Noyes
c4288d698c Update tests to understand SPECIAL_KEY_SPACE_RELAXED 2020-05-08 05:37:37 +00:00
Meng Xu
a08bbcc539
Merge pull request #3046 from atn34/atn34/conflict-ranges
Add read/write conflict ranges to special key space
2020-05-07 22:36:18 -07:00
Jingyu Zhou
a833724322
Merge pull request #3078 from xumengpanda/mengxu/fr-circus-stall-PR
Performant restore: Various improvements based on circus test
2020-05-07 20:07:23 -07:00
Meng Xu
11958c4039
Merge pull request #3097 from senthil-ram/snapRestoreNoBoost
Snapshot feature not to rely on boost::process
2020-05-07 19:17:46 -07:00
Steve Atherton
62882f5552
Merge pull request #3088 from sears/lb_ub_perf_2
unrevert lb_ub_perf pull request
2020-05-07 18:23:17 -07:00
A.J. Beamon
fb3c705c6b Rename Type->TransactionType 2020-05-07 16:07:33 -07:00
Meng Xu
a93c23d239 Resovle review comments 2020-05-07 15:06:59 -07:00
A.J. Beamon
aed97a9f20 Merge branch 'master' into transaction-tagging 2020-05-07 14:52:22 -07:00
A.J. Beamon
92730b2f05 Merge branch 'master' into transaction-tagging
# Conflicts:
#	fdbclient/NativeAPI.actor.cpp
2020-05-07 14:50:25 -07:00