apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-02 03:12:12 +08:00
Code Issues Packages Projects Releases Wiki Activity
11,360 Commits 35 Branches 318 Tags
Commit Graph

4900 Commits

Author SHA1 Message Date
Meng Xu
4a0315483b FastRestore:Safeguard when request of earlier vb may be sent after the vb has finished 2020-08-17 22:20:54 -07:00
Meng Xu
7b7490efe7 FastRestore:Debug trace for seg fault 2020-08-17 20:34:33 -07:00
Meng Xu
01255b7ead FastRestoreLoader:Sched:Add trace field and misc code style improvement 2020-08-16 09:43:04 -07:00
Meng Xu
be75fd4894 Workaround flow limitation:state variable must be initialized at the beginning of actors 2020-08-16 08:45:13 -07:00
Meng Xu
c2dfc5a00a Fix compile error 2020-08-16 08:13:28 -07:00
Meng Xu
cb0e44ff42 FastRestoreLoader:Sched send mutations per loadingParam requests 2020-08-16 07:38:51 -07:00
Meng Xu
98167a6d20 FastRestoreLoader:Fix:sched may stuck due to race condition 2020-08-16 06:29:09 -07:00
Meng Xu
015397be74 FastRestore:LoaderScheduler:Control number of load request to release at once 2020-08-15 22:18:48 -07:00
Meng Xu
1e571a5a1a FastRestore:Loader:Kick off scheduler when loader starts to have new requests 2020-08-15 21:57:00 -07:00
Meng Xu
a035e7a872 FastRestore:LoaderScheduler:Add knobs 2020-08-15 21:44:51 -07:00
Meng Xu
7e302b5910 FastRestore:Loader:Add scheduler to dispatch requests based on resource utilization and request priority 2020-08-15 21:21:51 -07:00
Daniel Smith
94571786bf Add RocksDB work 2020-08-14 17:16:20 +00:00
Xin Dong
ce05bb2a26
Merge pull request #3617 from xumengpanda/tmp/trace-PR 
Resolve throttling events
 2020-08-13 16:31:55 -07:00
Xin Dong
e13e7c5725
Update fdbserver/workloads/ReadHotDetection.actor.cpp 
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
 2020-08-12 15:48:01 -07:00
Xin Dong
b17667323e Resolve review comments 2020-08-12 15:15:25 -07:00
Xin Dong
3ac6996844 Increased some knobs to throttle the spammy read hot logging. Also added more details inside the read hot log to make it useful 2020-08-12 14:27:34 -07:00
Meng Xu
0d0efcfce7 FR:Fix incorrect ASSERT:batchIndex starts at 1 instead of 0 2020-08-12 10:36:31 -07:00
Meng Xu
06dae74730 Revert change to ReadHotRangeLog event 2020-08-11 11:04:57 -07:00
Meng Xu
97e49f2f70 Resolve throttling events 2020-08-10 22:01:12 -07:00
Meng Xu
c5c6906a3d
Merge pull request #3600 from xumengpanda/mengxu/fr-fix-large-pkg-PR 
Fast Restore: Fix the sampling packet size at sampling phase
 2020-08-10 13:53:24 -07:00
Meng Xu
c89a62b935 FR:SampleBackup:Assert req.batchIndex < controller batch size 2020-08-07 16:52:07 -07:00
Meng Xu
c27542d4e9 FR:SampleBackup:Send reply when receive duplicate msg 2020-08-07 16:50:36 -07:00
Meng Xu
fccebd9b80 FR:Use ByteSampleInfo to accurately sample backup 2020-08-06 20:45:46 -07:00
Meng Xu
87bde08695 FR:fix:sending samples may have broken promise error 
The error should not skip the ack reply from loader to controller, saying
the file has been loaded.
Otherwise, restore controller can get stuck at waiting for the ack reply.
 2020-08-06 10:41:18 -07:00
Evan Tschannen
ca5705b5ea
Merge pull request #3576 from Daniel-B-Smith/rocksdb-fixes 
RocksDB fixes
 2020-08-05 11:32:22 -07:00
Meng Xu
859c3145e2 FR:Fix samples not send reply and false positive failures 2020-08-05 11:32:04 -07:00
Meng Xu
309f383be3 FR:Report error if controller throws error 2020-08-04 23:08:41 -07:00
Meng Xu
879998d01b FR:fix compilation error 2020-08-04 23:04:38 -07:00
Meng Xu
7992cef025 FR:Fix sample network pkg can be too big 2020-08-04 22:35:21 -07:00
Meng Xu
e9adec421d FR:Add controller interface and send to roles 2020-08-03 15:06:15 -07:00
Meng Xu
f071d81ad0 Report warning on FastRestoreApplierClearRangeMutationsStart if delayTime is too large 2020-08-03 14:08:31 -07:00
Meng Xu
0c49646486 Fix:FastRestore:rangeVersion must be 0 when no range file is used 
otherwise, all mutations will be ignored by loaders as old mutations
 2020-07-31 23:23:17 -07:00
Meng Xu
27a3d37594 RestoreApplier:Change receivedBytes from double to long 2020-07-31 22:10:18 -07:00
Meng Xu
e22baa552b FastRestoreApplier:Init stats variables 2020-07-31 21:56:03 -07:00
Meng Xu
f36d5aa180 FR:Applier received bytes per batch 2020-07-31 17:48:55 -07:00
Meng Xu
fec3de9b7b Fix RestoreLoader loadedLogBytes counter 2020-07-31 16:00:15 -07:00
Meng Xu
47c35a7a69 FastRestore:Add stats to ApplierBatchData 2020-07-31 14:59:45 -07:00
Meng Xu
e4d2ab72fe DumpVersionBatch with log and file summary info 2020-07-31 14:21:33 -07:00
Meng Xu
2f5293fcc7 Introduce knob FASTRESTORE_USE_LOG_FILE and FASTRESTORE_USE_RANGE_FILE 2020-07-31 10:40:29 -07:00
Meng Xu
37c3bd8615 FastRestore:Ensure FASTRESTORE_NOT_WRITE_DB only work in non simulation mode 2020-07-30 20:27:54 -07:00
Meng Xu
8cace30bb2 FastRestore:change TXN_BATCH_MAX_BYTES default to 1KB from 1MB 2020-07-30 16:43:35 -07:00
Meng Xu
d16db8e733 FastRestore:Fix segmentation fault 2020-07-30 12:10:32 -07:00
Meng Xu
d71361245b FastRestore:Short cut DB for get and clearange 2020-07-30 11:17:05 -07:00
Meng Xu
ad915e462e Add knob FASTRESTORE_NOT_WRITE_DB to skip writting to DB 2020-07-30 10:17:17 -07:00
Daniel Smith
6efd5996c2 Calculate data stored by Rocks 2020-07-29 22:08:32 +00:00
Daniel Smith
fd973e5055 RocksDB fixes 2020-07-29 21:26:36 +00:00
Meng Xu
2b8aa296bb
Merge pull request #3482 from sfc-gh-tclinkenbeard/support-downgrades 
Support and test downgrades
 2020-07-28 17:00:54 -07:00
Andrew Noyes
d2cf700bd4 Fix compiler warnings 2020-07-28 18:30:26 +00:00
Markus Pilman
c6a2043d53
Merge pull request #3450 from sfc-gh-tclinkenbeard/6.3-use-vector-mutations 
Replace VersionUpdateRef with VerUpdateRef
 2020-07-27 15:21:47 -06:00
Evan Tschannen
c3348be3a0 changed knobs to improve master recovery speeds 2020-07-27 10:59:06 -07:00