2452 Commits

Author SHA1 Message Date
A.J. Beamon
476641a087
Merge pull request #1929 from jzhou77/fix-warning
Fix compiler warnings
2019-08-01 11:15:41 -07:00
Jingyu Zhou
37450be706 Fix format usage for currentProtocolVersion
ProtocolVersion now is a class.
2019-08-01 10:19:46 -07:00
Evan Tschannen
653d9be6e2 we cannot pop old generations because it breaks forced recoveries 2019-07-31 18:27:36 -07:00
Evan Tschannen
1ea3ce8f9c txs pops also go to the old generations of tlogs to reduce the chance we have to restart txnStateStore recovery 2019-07-31 18:06:39 -07:00
Evan Tschannen
f33969c9d4
Merge pull request #1949 from atn34/at-what-cost3
Improve read performance part 1 of 2
2019-07-31 18:05:05 -07:00
Andrew Noyes
1bad0fd44e Make requestTime private 2019-07-31 17:59:35 -07:00
Evan Tschannen
ea1f6afa58
Merge pull request #1948 from etschannen/master
There were still use cases where this checks are necessary
2019-07-31 17:46:14 -07:00
Evan Tschannen
3774ff55b0 There were still use cases where this checks are necessary 2019-07-31 17:45:21 -07:00
Evan Tschannen
7d7aa27c2d
Merge pull request #1814 from dongxinEric/feature/1508/finer-grained-dd-controls
Added finer grained controls to DataDistribution in fdbcli.
2019-07-31 17:36:20 -07:00
Evan Tschannen
32d65754ad
Merge pull request #1943 from kaomakino/kaomakino/sqlite_btree_prefetch
Prefetch B-Tree cells in sqlite3BtreeMovetoUnpacked() to reduce cache misses
2019-07-31 17:24:10 -07:00
Evan Tschannen
a0b29ff82f updated knobs to allow more batch priority traffic 2019-07-31 17:19:41 -07:00
Evan Tschannen
854ee75664 we no longer need to special case for txs tag, because it will be initialized by createTagData 2019-07-31 17:13:15 -07:00
Jingyu Zhou
368def16ce Use friend struct for serializable_traits 2019-07-31 16:51:35 -07:00
Evan Tschannen
4308ff86f7 increased the MAX_TEAMS_PER_SERVER 2019-07-31 16:08:18 -07:00
Evan Tschannen
ff171e293e fix: always make sure to add txsTags to localTags for remote logs 2019-07-31 16:04:35 -07:00
Evan Tschannen
bba01c6531 fix: add subsetOfEmergencyTeam could add an unsorted team 2019-07-31 16:02:08 -07:00
Kao Makino
1a7eed0811 prefetch btree cells in sqlite3BtreeMovetoUnpacked 2019-07-31 22:39:08 +00:00
Xin Dong
b653ddb30d Final clean ups after rebasing master 2019-07-30 22:35:34 -07:00
Xin Dong
cda70700cc Address review comments. 50K correctness with no failures. 2019-07-30 22:24:30 -07:00
Xin Dong
5d20364423 Address review comments 2019-07-30 22:24:30 -07:00
Xin Dong
1922c39377 Resolve review comments. 100K run shows one suspecious ASSERT_WE_THINK failure which I think could be a race. 2019-07-30 22:24:30 -07:00
Xin Dong
c6e5472d8d Apply suggestions from code review
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-07-30 22:20:45 -07:00
Xin Dong
f5d6e3a5b3 - Addressed review commends
- Added test for the storage server failure disable switch
2019-07-30 22:20:45 -07:00
Xin Dong
ae11efcb0a Made following changes:
- Make sure the disabled data distribution won't be accidentally enabled by the 'maintenance' command
- Make sure the status json reflects the status of DD accordingly
- Make sure the CLI can play with the new DD states correctly, i.e. print out warns when necessary
2019-07-30 22:20:45 -07:00
Xin Dong
4ecfc9830f Added finer grained controls to DataDistribution in fdbcli. What's happening under the hood is:
- Use pre-existing 'healthZone' key and write a special value to it in order to disable DD for all storage server failures
- Use a new system key 'rebalanceDDIgnored' key to disable/enable DD for all rebalance reasons(MountainChopper and ValleyFiller)

Kicked off two 200K correctness and showed no related errors.
2019-07-30 22:17:21 -07:00
Evan Tschannen
dd4ab63d90 fixed another bad trace event name 2019-07-30 19:36:26 -07:00
Evan Tschannen
b8cd51c4d3 fixed invalid trace event name 2019-07-30 19:23:54 -07:00
Evan Tschannen
6dbaddd0a7 Added a knob to always use CAUSAL_READ_RISKY for GRV 2019-07-30 18:21:46 -07:00
Evan Tschannen
3b9e5aa651
Merge branch 'master' into fix-machine-id-parameter 2019-07-30 17:54:33 -07:00
Evan Tschannen
ea1858953b
Merge branch 'master' into merge-release-6.1-into-master 2019-07-30 17:40:15 -07:00
Evan Tschannen
a78a97f186
Merge pull request #1908 from etschannen/feature-better-dd
A few data distribution improvements
2019-07-30 17:34:50 -07:00
Evan Tschannen
69e7ed3e53
Merge pull request #1932 from etschannen/master
Bug fixes for rare bugs found by simulation
2019-07-30 17:18:30 -07:00
A.J. Beamon
15474feb81 Merge branch 'master' into fix-machine-id-parameter 2019-07-30 17:16:36 -07:00
A.J. Beamon
3070153313 Merge branch 'master' into fix-machine-id-parameter 2019-07-30 17:15:40 -07:00
A.J. Beamon
8a25337073
Merge pull request #1926 from ajbeamon/move-fdbserver-arguments
Move memory and locality arguments from --dev-help to --help.
2019-07-30 17:14:44 -07:00
sramamoorthy
a88aaa0f04 review comment 2019-07-30 17:04:51 -07:00
sramamoorthy
63941e0d96 disable DD with a in-memory flag and use in snapv2 2019-07-30 17:04:51 -07:00
Evan Tschannen
5dd9043fd3 addressed review comments 2019-07-30 17:04:41 -07:00
Evan Tschannen
481642fbd4 Merge branch 'master' into feature-better-dd 2019-07-30 16:56:27 -07:00
Evan Tschannen
9f11f2ec53 Merge branch 'master' of github.com:apple/foundationdb 2019-07-30 16:55:56 -07:00
Evan Tschannen
a3fe3d4324
Merge pull request #1923 from xumengpanda/mengxu/evan-dd-improvement-minor-improvement
DD:Change condition for lastBuildTeamsFailed
2019-07-30 16:54:42 -07:00
Evan Tschannen
2d7ec54d3e fix: some exclude workloads would cause both the primary and remote datacenter to be considered dead 2019-07-30 16:35:52 -07:00
Evan Tschannen
aaeeb605b2 Changes to degraded can cause master recoveries, which are not supposed to happen when speedUpSimulation is true 2019-07-30 16:33:40 -07:00
A.J. Beamon
b3f7875673
Merge pull request #1925 from ajbeamon/rename-fault-tolerance-status-fields
Rename max_machine_failures_without_losing_X to max_zone_failures_without_losing_X in status.
2019-07-30 16:25:48 -07:00
A.J. Beamon
b5d2234a13 Merge branch 'release-6.1' into merge-release-6.1-into-master
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbbackup/backup.actor.cpp
#	fdbserver/MoveKeys.actor.cpp
#	flow/FastAlloc.h
#	versions.target
2019-07-30 16:23:42 -07:00
A.J. Beamon
a731adeb8f --machine_id now sets locality_machineid 2019-07-30 16:11:09 -07:00
Evan Tschannen
06fc8cb904
Merge pull request #1919 from etschannen/feature-buffered-popped
Implement popped on bufferedCursor
2019-07-30 15:56:41 -07:00
A.J. Beamon
25f93f7f1b Revert change to machine_id documentation (to be fixed in separate PR). 2019-07-30 15:20:57 -07:00
A.J. Beamon
08cdd8e788 Merge branch 'master' into move-fdbserver-arguments 2019-07-30 15:13:44 -07:00
A.J. Beamon
59dd5916c5 Merge branch 'master' into rename-fault-tolerance-status-fields
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
2019-07-30 15:11:25 -07:00