11362 Commits

Author SHA1 Message Date
Meng Xu
9b2f667bbe FastRestore:Fix uninitialized variable 2020-08-18 11:58:57 -07:00
Meng Xu
046260b9d7 FastRestore:Applier:Assert to ensure batchData will not be used after deleted 2020-08-17 22:42:41 -07:00
Meng Xu
4a0315483b FastRestore:Safeguard when request of earlier vb may be sent after the vb has finished 2020-08-17 22:20:54 -07:00
Meng Xu
7b7490efe7 FastRestore:Debug trace for seg fault 2020-08-17 20:34:33 -07:00
Meng Xu
01255b7ead FastRestoreLoader:Sched:Add trace field and misc code style improvement 2020-08-16 09:43:04 -07:00
Meng Xu
be75fd4894 Workaround flow limitation:state variable must be initialized at the beginning of actors 2020-08-16 08:45:13 -07:00
Meng Xu
c2dfc5a00a Fix compile error 2020-08-16 08:13:28 -07:00
Meng Xu
cb0e44ff42 FastRestoreLoader:Sched send mutations per loadingParam requests 2020-08-16 07:38:51 -07:00
Meng Xu
98167a6d20 FastRestoreLoader:Fix:sched may stuck due to race condition 2020-08-16 06:29:09 -07:00
Meng Xu
015397be74 FastRestore:LoaderScheduler:Control number of load request to release at once 2020-08-15 22:18:48 -07:00
Meng Xu
1e571a5a1a FastRestore:Loader:Kick off scheduler when loader starts to have new requests 2020-08-15 21:57:00 -07:00
Meng Xu
a035e7a872 FastRestore:LoaderScheduler:Add knobs 2020-08-15 21:44:51 -07:00
Meng Xu
7e302b5910 FastRestore:Loader:Add scheduler to dispatch requests based on resource utilization and request priority 2020-08-15 21:21:51 -07:00
Russell Sears
89d1df4a5c
Merge pull request #3645 from Daniel-B-Smith/rocks-opt-checkpoint
Add some RocksDB optimizations and configuration knobs
2020-08-14 14:25:52 -07:00
Daniel Smith
94571786bf Add RocksDB work 2020-08-14 17:16:20 +00:00
Xin Dong
ce05bb2a26
Merge pull request #3617 from xumengpanda/tmp/trace-PR
Resolve throttling events
2020-08-13 16:31:55 -07:00
A.J. Beamon
af0f3888b2
Merge pull request #3643 from Daniel-B-Smith/patch-1
Correct fix for debug ID logging
2020-08-13 11:18:50 -07:00
Daniel Smith
b2bba8ccbb
Correct fix for debug ID logging 2020-08-13 13:37:15 -04:00
Xin Dong
8bc57c16f0
Merge pull request #3637 from dongxinEric/misc/fix-spammy-readhot-logging
Increased some knobs to throttle the spammy read hot logging.
2020-08-12 16:46:32 -07:00
Xin Dong
e13e7c5725
Update fdbserver/workloads/ReadHotDetection.actor.cpp
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2020-08-12 15:48:01 -07:00
Xin Dong
ddec93c504
Update fdbclient/StorageServerInterface.h
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2020-08-12 15:47:32 -07:00
Xin Dong
b17667323e Resolve review comments 2020-08-12 15:15:25 -07:00
Meng Xu
f26f170f21
Merge pull request #3635 from Daniel-B-Smith/debug-logging-fix
Make logging of server trace ID consistent with other code
2020-08-12 15:06:26 -07:00
Xin Dong
3ac6996844 Increased some knobs to throttle the spammy read hot logging. Also added more details inside the read hot log to make it useful 2020-08-12 14:27:34 -07:00
Daniel Smith
cc1059be75 Make logging of server trace ID consistent with other code 2020-08-12 19:05:01 +00:00
Meng Xu
13ddf0618f
Merge pull request #3632 from xumengpanda/tmp/fix-6.3-fr-PR
Fast Restore: Fix an incorrect ASSERT
2020-08-12 12:02:53 -07:00
Meng Xu
0d0efcfce7 FR:Fix incorrect ASSERT:batchIndex starts at 1 instead of 0 2020-08-12 10:36:31 -07:00
Meng Xu
72cabfd253
Merge pull request #2596 from alexmiller-apple/docs/technical-overview
Convert "Architecture Overview" wiki page into documentation
2020-08-11 20:36:48 -07:00
A.J. Beamon
40cc7e2aad
Merge pull request #3619 from AlvinMooreSr/fix_javadoc
JavaDoc Fixes
2020-08-11 11:11:01 -07:00
Meng Xu
06dae74730 Revert change to ReadHotRangeLog event 2020-08-11 11:04:57 -07:00
Alvin Moore
1933826737 Fixed typos and removed extraneous space 2020-08-11 13:09:41 -04:00
Alvin Moore
ba9f203858 Fixed warnings for documentation greater than and less than characters which appear as errors within Java 1.8
Removed broken link
2020-08-11 03:26:56 -04:00
Meng Xu
97e49f2f70 Resolve throttling events 2020-08-10 22:01:12 -07:00
Meng Xu
c5c6906a3d
Merge pull request #3600 from xumengpanda/mengxu/fr-fix-large-pkg-PR
Fast Restore: Fix the sampling packet size at sampling phase
2020-08-10 13:53:24 -07:00
Meng Xu
7c05e9c1d3
Merge pull request #3610 from xis19/issue_3551
When a configuration K/V pair is modified, always output the K/V pair values
2020-08-10 13:52:44 -07:00
Xin Dong
d198c310f4
Merge pull request #3614 from dongxinEric/misc/avoid-extra-copy-for-getEstiamtedRangeSizeAPI-6.3
Avoid the extra copy in RYW APIs
2020-08-10 11:02:38 -07:00
Xin Dong
5456b01c3a Avoid the extra copy in RYW APIs 2020-08-10 09:34:21 -07:00
Xiaoge Su
8e50b51fbd If mutableConfiguration exists, skip checking rawConfiguration in DatabaseConfiguration 2020-08-09 22:12:42 -07:00
Xiaoge Su
ceeade7334 Address review comments, improve performance 2020-08-08 23:52:38 -07:00
Xiaoge Su
49968b8200 Cleanup DatabaseConfiguration::toJSON 2020-08-08 23:24:30 -07:00
Xiaoge Su
6b8843ad18 When a configuration K/V pair is modified, always output the K/V pair values
With this patch, if there is a configuration special key in the
database, even if the value is reverted to default/hidden, it will still
be forwarded when constructing a JSON string. This should address the
requirements described in https://github.com/apple/foundationdb/issues/3551.
2020-08-08 23:24:30 -07:00
Meng Xu
c89a62b935 FR:SampleBackup:Assert req.batchIndex < controller batch size 2020-08-07 16:52:07 -07:00
Meng Xu
c27542d4e9 FR:SampleBackup:Send reply when receive duplicate msg 2020-08-07 16:50:36 -07:00
Alvin Moore
4aab5735f2
Merge pull request #3611 from AlvinMooreSr/testharness_version
Version Support For Testharness
2020-08-07 15:39:35 -04:00
Alvin Moore
66a41089dc
Increment TestHarness version
Co-authored-by: Markus Pilman <markus.pilman@snowflake.com>
2020-08-07 14:28:27 -04:00
Alvin Moore
c82a81b124 Fixed whitespace 2020-08-07 13:50:49 -04:00
Alvin Moore
6ec05e1fd8 Removed unneeded include for TestHarness 2020-08-07 13:50:01 -04:00
Alvin Moore
12b51f7889 Added separate function to display version information for TestHarness 2020-08-07 12:44:21 -04:00
Alvin Moore
bc0ef5d0d7 Fixed the name of the TestHarness cmake file 2020-08-07 12:40:52 -04:00
Alvin Moore
d5b39f649c Updated cmake to work with TestHarness source file 2020-08-07 12:37:27 -04:00