119 Commits

Author SHA1 Message Date
neethuhaneesha
212deb05e9
Merge pull request #6501 from neethuhaneesha/rocksdb-CompBytesLimiter
Rocksdb knobs for compaction, storageserver canCommit() waiting if rocksdb overloaded
2022-03-07 14:59:34 -08:00
Yao Xiao
36edfb8820
Update error type for timeouts. (#6503) 2022-03-07 13:14:20 -08:00
Neethu Haneesha Bingi
8796a763a5 Rocksdb knobs for compaction, storageserver canCommit() waiting if rocksdb overloaded. 2022-03-04 12:41:17 -08:00
Neethu Haneesha Bingi
83e0368eaa RocksDB increasing background threads to speedup compaction. 2022-03-03 15:14:37 -08:00
Zhe Wang
f14e08a991 addRocksDBPerfContextMetrics 2022-02-23 22:29:07 -05:00
Aaron Molitor
96dd86ebf8 update RocskDB and Boost
add Finduring, and include into fdbserver
add BOOST asio/uring settings to fdbserver compile
move portable rocks, liburing up to be configurable at build time.
2022-02-09 10:48:18 -06:00
Yao Xiao
c605226a56
Add error handling in RocksDB KVS. (#6277) 2022-01-25 13:59:25 -08:00
Neethu Haneesha Bingi
162bce7a58 Rocksdb write rate limiter. 2022-01-18 13:23:00 -08:00
Neethu Haneesha Bingi
ef4038fe8d Rocksdb read range iterator pool to reuse iterators. 2022-01-18 02:05:21 -08:00
He Liu
1c2c2783ea Implement single deletion in RocksDB.
If the target deletion range contains a single key, convert it into a
single deletion, to avoid extra cost in RocksDB due to range deletion.
2022-01-04 09:59:40 -08:00
Neethu Haneesha Bingi
1f30368e71 KeyValueStoreRocksDB histograms to track latencies 2021-12-21 23:09:46 -08:00
Neethu Haneesha Bingi
d23b8645f8 Enabling rocksdb metrics logger in simulation. 2021-12-07 15:18:29 -08:00
Daniel Smith
9dccb0131e Clean up RocksDB error logging 2021-11-12 12:14:12 -05:00
Daniel Smith
394b9dc619 Code review changes 2021-11-10 11:53:27 -05:00
Daniel Smith
66520eb1c1 Utilize read types to do selective throttling 2021-11-10 11:51:04 -05:00
Daniel Smith
8822c589de Move table factory options to CFOptions 2021-11-09 17:29:06 -05:00
sfc-gh-tclinkenbeard
421dee532c Add const qualifiers in KeyValueStoreRocksDB.actor.cpp 2021-10-18 13:40:47 -07:00
Daniel Smith
9713a14ef1 Reverse order of read type and debug ID args 2021-10-18 12:23:09 -04:00
Daniel Smith
df53cc9580 Add an enum to IKeyValueStore to indicate the source/priority of the read 2021-10-15 14:35:59 -04:00
Neethu Haneesha Bingi
3c35bc69d7 Decoupling the rocksdb version check to multiple static asserts. 2021-09-17 08:53:23 -07:00
Neethu Haneesha Bingi
c0e6b09fe3 Enforcing 6.22.1 rocksdb version and enabling readRange deadline option. 2021-09-17 08:53:23 -07:00
Neethu Haneesha Bingi
627ef2e739 Enable rocksdb storage in simulation with some simulation fixes. 2021-09-10 11:11:29 -07:00
yao-xiao-github
f7842ff3db
Log SubCode and Severity for RocksDB erros (#5515) 2021-08-31 21:03:02 -07:00
Daniel Smith
b75fb0d105 Improve error to status conversion 2021-08-23 11:35:26 -04:00
Daniel Smith
473e2bbf5f Fix error handling of reads. 2021-08-23 11:35:26 -04:00
Neethu Haneesha Bingi
0fbfcc582e Increasing the read cancellation timeouts to 5 minutes in simulation. 2021-08-19 14:47:12 -07:00
Neethu Haneesha Bingi
6c97782378 Timedout reads cancellation check removed in simulation. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi
02b3ed3ff1 Adding deadline option to rocksdb calls. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi
fbb393f998 Added readrange timeoout check and rocksdb read deadline option. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi
24ac173c95 Adding ReadRangeAction timeout, returning error and using timer_monotonic changes. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi
01e85610ab Cancelling the timedout reads with rocksdb storage. 2021-08-19 14:11:28 -07:00
yao-xiao-github
b8e2575f92
Update log directory to server log directory. (#5396) 2021-08-18 13:07:56 -07:00
Daniel Smith
adc466acb6 Fix key name 2021-07-30 13:27:43 -04:00
Daniel Smith
a26dbba66f Add RocksDB metrics 2021-07-30 13:27:43 -04:00
Daniel Smith
0f99d449fc Revert "Merge pull request #5194 from apple/revert-5144-rocksdb-in-simulation"
This reverts commit 8ecff8c7304f71be30f3ed6f9b51263c7c2dcc4a, reversing
changes made to c8e18f99f080d0bfbbb18139517c38958f64bbf6.
2021-07-16 12:01:01 -04:00
Evan Tschannen
b7b845dab8
Revert "RocksDB in simulation" 2021-07-15 16:41:33 -07:00
Daniel Smith
ed35df9a00 Add comment explaining coro threads 2021-07-13 14:56:23 -04:00
Daniel Smith
0613ff892f Enable RocksDB in simulation 2021-07-13 12:25:11 -04:00
Daniel Smith
1feedb700b Don't log key not found as an error 2021-07-09 13:07:06 -04:00
Daniel Smith
efdda3cd0e Revert "Revert "Add support for running non-simulation tests on Joshua"" 2021-06-15 14:15:02 -04:00
Daniel Smith
549cf0512b
Revert "Add support for running non-simulation tests on Joshua" 2021-06-14 19:23:56 -04:00
Daniel Smith
8af0affeff Add support for running non-simulation tests on Joshua 2021-06-14 15:00:45 -04:00
Daniel Smith
25c3468a08 Estimate live SST file size and not live data size 2021-06-11 16:53:10 -04:00
sfc-gh-tclinkenbeard
5c2d7b6080 Create RangeResult type alias 2021-05-03 13:14:16 -07:00
FDB Formatster
df90cc89de apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-10 10:18:07 -08:00
Vishesh Yadav
2bb4f2e59f Merge branch 'release-6.3-pre-format' into master-format
This merges release-6.3 branch right before it was fully formatted.
There were quite a few conflicts that are resolved here. CoroFlow had
a check for OOM errors introduced in 6.3, but didn't seem applicable in
the new implmentation which seems to use boost.
2021-03-10 09:37:41 -08:00
Russell Sears
d2d6fcccfa
Merge pull request #4009 from Daniel-B-Smith/rocksdb-named-threads
Name the RocksDB background threads
2021-03-03 20:34:32 -08:00
Evan Tschannen
346a4e3ecd Merge branch 'release-6.3'
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
#	fdbrpc/LoadBalance.actor.h
#	fdbrpc/MultiInterface.h
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/masterserver.actor.cpp
2021-03-01 18:52:06 -08:00
Daniel Smith
179dea5a1b Name the RocksDB background threads 2021-03-01 20:35:55 +00:00
Daniel Smith
0e9e53a163 Make the RocksDB init method idempotent 2021-03-01 17:20:41 +00:00