417 Commits

Author SHA1 Message Date
Andrew Noyes
b0f61fb74f Resolve the simple-looking conflicts 2021-01-15 19:35:10 +00:00
Andrew Noyes
ff7d306b09 Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
Include conflict markers for now. Will resolve.
2021-01-15 18:04:09 +00:00
Russell Sears
4cb821cd63 Merge remote-tracking branch 'upstream/release-6.2' into merge-6.2-to-6.3 2020-12-09 15:47:44 -08:00
Andrew Noyes
cc669f399e Merge remote-tracking branch 'upstream/release-6.3' into anoyes/merge-release-6.3-master 2020-12-07 22:26:11 +00:00
A.J. Beamon
fa4d87f432
Merge pull request #4112 from sfc-gh-tclinkenbeard/6.3-fix-tlog-pop-slow-task
Yield while processing ignored pop requests on tlog
2020-12-04 09:20:36 -08:00
Andrew Noyes
877997632d Merge branch 'release-6.3' into anoyes/merge-release-6.3-master
Include conflict markers for review purposes
2020-12-04 01:38:07 +00:00
sfc-gh-tclinkenbeard
7e815ebb68 Added TLOG_POP_BATCH_SIZE knob 2020-12-03 11:56:55 -08:00
Jingyu Zhou
df5293e2be Add a knob PROXY_REJECT_BATCH_QUEUED_TOO_LONG
Disable the proxy rejection feature for backup workload, because of the
ApplyMutationsError.
2020-11-28 21:32:41 -08:00
Andrew Noyes
dc2bac5670 Resolve conflicts 2020-11-24 19:09:42 +00:00
Andrew Noyes
1f541f02be Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge
Merge, leaving conflict markers for now
2020-11-24 16:55:34 +00:00
Russell Sears
fc8b57189e
Merge pull request #3969 from Daniel-B-Smith/rocksdb-unsafe-fsync
RocksDB grab bag
2020-11-18 10:09:24 -08:00
David Youngworth
d64cf8b9e3 Merge branch 6.3 into master 2020-11-17 11:22:45 -08:00
David Youngworth
d0391db862 Merge branch 'release-6.2' into release-6.3 2020-11-16 10:15:23 -08:00
Xiaoge Su
3a6948c199 Report histogram periodically 2020-11-12 17:04:33 -08:00
Xiaoge Su
acbd4c1f39 Extract FETCH_KEYS_TOO_LONG_TIME_CRITERIA to Knob 2020-11-12 13:01:41 -08:00
Xiaoge Su
da31eb3d89 Periodically report the fetchKeys status 2020-11-09 15:24:05 -08:00
sfc-gh-tclinkenbeard
cf4c8e375f Merge remote-tracking branch 'origin/release-6.3' into merge 2020-10-29 22:15:41 -07:00
Steve Atherton
99c1880a83 Merge commit 'f9581de2005e6b085776e81b9fcaa16442b32589' into merge-6.2-to-6.3
# Conflicts:
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
2020-10-27 12:21:26 -07:00
Xin Dong
c037bfd001 Added detailed logging when there is no servers left in a server team, because that may indicate a data loss incident. 2020-10-26 16:44:07 -07:00
Daniel Smith
44dc1303bb Merge remote-tracking branch 'upstream/release-6.3' into rocksdb-unsafe-fsync 2020-10-26 19:24:33 +00:00
Meng Xu
b0d78ecf37
Merge pull request #3912 from dongxinEric/misc/log-detailed-teams-info-in-dd
Added a way to print detailed information about team collection for d…
2020-10-24 19:06:10 -07:00
Xin Dong
f757cae786 Address review comments 2020-10-23 14:01:53 -07:00
Vishesh Yadav
73e77f31eb
Merge pull request #3928 from yliucode/merge
Merge release-6.3 into master
2020-10-20 15:48:46 -07:00
Young Liu
8cc3e4d3c6 Merge release-6.3 into master 2020-10-19 22:51:56 -07:00
Xin Dong
410d418c3e Revert "Merge pull request #3770 from dongxinEric/feature/ss-commit-pipelining"
This reverts commit e258dffc65a2cf3e7768f2c9f833f9f553a52d74, reversing
changes made to 0e96233015c25608df620a8c1b81f9945bbd6a33.

SS commit seems to be causing write performance degredation.
2020-10-19 09:28:38 -07:00
Xin Dong
8d0aa02a63 Do not periodically print detailed DD teams info 2020-10-16 16:11:14 -07:00
Jingyu Zhou
8f17a1a5d6 Merge branch 'release-6.2' into release-6.3 2020-10-16 15:25:39 -07:00
Xin Dong
92e31dd338 Address review comments 2020-10-15 15:25:00 -07:00
Xin Dong
1d43729cc9 Added a way to print detailed information about team collection for debugging. 2020-10-15 10:01:56 -07:00
Daniel Smith
a99b68a7e3 Add knob for tuning number of RocksDB read threads 2020-10-14 22:07:46 +00:00
Evan Tschannen
1378ecba4d If a proxy is sufficiently far behind, reset network connections to attempt to fix the problem 2020-10-11 23:06:26 -07:00
Daniel Smith
6e287eb0d1 Merge remote-tracking branch 'upstream/release-6.3' into rocksdb-unsafe-fsync 2020-10-09 16:53:05 +00:00
Steve Atherton
e258dffc65
Merge pull request #3770 from dongxinEric/feature/ss-commit-pipelining
Pipeline the commit process in SS.
2020-10-07 20:34:57 -07:00
Xin Dong
b610f01c77 Fine-grained interleaving 2020-10-06 09:32:22 -07:00
Evan Tschannen
f546034366 do not prevent computePerOperation from being updated for small computeDurations. Added logging for the compute per operation. Protect against erroneously large compute estimates 2020-10-04 19:19:05 -07:00
sfc-gh-tclinkenbeard
f757beaac1 Remove deprecated UNFLUSHED_DATA_RATIO knob 2020-10-02 10:36:21 -07:00
Meng Xu
862336de8f Merge branch 'master' into mengxu/merge-to-master-PR 2020-09-24 17:06:00 -07:00
Meng Xu
a4aad591fd FR:Remove applyStagingKeysBatchLock flow lock 2020-09-23 08:47:37 -07:00
Meng Xu
002b1bec4c FastRestore:Control write traffic at each applier
Controller assigns each applier a write rate.
Applier keeps the write-rate worth of transactions outstanding to DB.

This is to avoid heavily overloading DB while still keep enough
traffic to DB to get a good write throughput.
2020-09-22 08:14:28 -07:00
sfc-gh-tclinkenbeard
0814841827 Replace NULL with nullptr in fdbserver 2020-09-20 11:31:49 -07:00
Evan Tschannen
12b07d024f
Merge pull request #3775 from sfc-gh-xwang/fdbtest
add knob MIN_TAG_WRITE_PAGES_RATE for write tag-throttling
2020-09-18 10:40:28 -07:00
Young Liu
cc5bc16bd8 Rename more places from proxy to commit proxy 2020-09-15 22:29:49 -07:00
XiaoxiWang
52bd86ad42 update knob 2020-09-11 20:50:19 +00:00
Young Liu
35bef73a1c Rename proxy to commit proxy 2020-09-10 17:44:15 -07:00
Young Liu
87693cae81 merge master branch and resolve conflicts 2020-09-02 13:44:33 -07:00
Evan Tschannen
12edadd059 Merge branch 'release-6.3'
# Conflicts:
#	CMakeLists.txt
#	fdbclient/Knobs.cpp
#	fdbclient/MasterProxyInterface.h
#	fdbrpc/simulator.h
#	fdbserver/MasterProxyServer.actor.cpp
#	tests/fast/CycleAndLock.txt
#	tests/fast/TxnStateStoreCycleTest.txt
#	tests/fast/VersionStamp.txt
#	tests/slow/ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
#	tests/slow/ParallelRestoreOldBackupCorrectnessCycle.txt
#	versions.target
2020-08-31 19:33:34 -07:00
Evan Tschannen
29eec30183 Merge branch 'release-6.2' into release-6.3
# Conflicts:
#	CMakeLists.txt
#	build/Dockerfile
#	build/Dockerfile.devel
#	documentation/sphinx/source/downloads.rst
#	fdbserver/Knobs.cpp
#	fdbserver/LogSystem.h
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WaitFailure.actor.cpp
#	fdbserver/fdbserver.vcxproj
#	fdbserver/fdbserver.vcxproj.filters
#	packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
Young Liu
e87327b33b Merge master branch and keep master proxy reporting txn cost estimation to ratekeeper 2020-08-29 12:47:35 -07:00
Meng Xu
996ba2374c FastREstore:Fix:Incorrect condition in printing out FastRestoreLoaderSendMutationToApplierDoneTooLate 2020-08-24 17:27:40 -07:00
Young Liu
63b3612ad5 Merge master branch and resolve conflicts 2020-08-24 16:42:31 -07:00