17 Commits

Author SHA1 Message Date
He Liu
97cf3c99e7
Remove optimizeForSmallDB. (#7767)
Co-authored-by: He Liu <heliu@apple.com>
2022-08-03 13:51:57 -07:00
He Liu
35a4cb91d5
Disable ShardedRocksDB in simulation when shard_encode_location_metadata is disabled (#7726)
* Disabled tests for ShardedRocks.

Cleaned up ShardedRocks TraceEvent.

Added assertion in ShardManager::validate().

* Added test trace.

* Make sure TraceEvent contains `ShardedRocks`.

* Exclude ShardedRocksDB when SHARD_ENCODE_LOCATION_METADATA is disabled.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-28 13:54:29 -07:00
He Liu
edbc373815
Get ShardedRocks ready for simulation test. (#7679)
* Disabled tests for ShardedRocks.

Cleaned up ShardedRocks TraceEvent.

Added assertion in ShardManager::validate().

* Added test trace.

* Make sure TraceEvent contains `ShardedRocks`.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-26 21:49:33 -07:00
He Liu
7a8be255cd
Ss shard management (#7340)
* Storage server shard management with physical shards.

* Cleanup.

* Resolved comments.

* Added `UnlimintedCommitBytes`.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-22 09:30:44 -07:00
He Liu
257bab7311
Allow read range on null shard (#7654)
* Fixed ShardedRocks unit test.

* Removed `UNIT` from noSim/ShardedRocksDBTest.toml.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-21 13:59:49 -07:00
Yao Xiao
e367a5a160
Add KVS physical shard metrics. (#7581) 2022-07-13 01:31:05 -07:00
He Liu
aa43956fbd
Sharded RocksDB (#7540)
* Some fixes.

* Enabled ShardedRocksDB in IKeyValueStore.h

* Added unit test for ShardedRocks for \xff\xff key space read/write.

* Resolved comments.

* Return empty read results if the physical shards are not initialized.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-08 15:17:38 -07:00
Yao Xiao
f98d5ae9e9
[ShardedRocksDB] 5/N Generate and persist metadata for range mapping. (#7408) 2022-07-06 15:57:46 -07:00
Yao Xiao
cc93dfd289
Add getStorageBytes. (#7485) 2022-06-28 14:37:26 -07:00
He Liu
61d621a4c4
Fix read iterator pool race (#7455) 2022-06-27 14:51:26 -07:00
Yao Xiao
7da26db342
[ShardedRocksDB] 4/N Support removeRange. (#7345) 2022-06-14 13:52:03 -07:00
Yao Xiao
0bb02f6415
[Sharded RocksDB] 3/N Implement functions for range clear. (#7310) 2022-06-09 10:50:39 -07:00
Yao Xiao
5f1a061e3a
Disable rocksdb metrics. (#7327) 2022-06-06 14:27:41 -07:00
Yao Xiao
c75611bf94
[ShardedRocksDB] 2/N Support range read and integrate with read iterator pool. (#7266) 2022-06-02 11:03:49 -07:00
Yao Xiao
df3d34f8ac
[ShardedRocksDB] 1/N Implement functions for write and single shard read. (#7184) 2022-05-26 10:59:14 -07:00
Andrew Noyes
665e903999
Fix use of uninitialized memory (#7231)
We branch on the value of cf, so we need to initialize it.
2022-05-24 14:58:08 -07:00
Yao Xiao
6bf1e3921f
Add skeleton for sharded rocksdb KVS. (#7181) 2022-05-23 15:29:23 -07:00