62 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard
025085ccb5 Fix GlobalTagThrottler::addRequests 2022-08-02 13:47:04 -07:00
Trevor Clinkenbeard
88e54eec5c
Remove unnecessary trace event
Co-authored-by: Xiaoxi Wang <xiaoxi.wang@snowflake.com>
2022-07-27 00:41:40 -07:00
sfc-gh-tclinkenbeard
436aa832e2 Move enums into GlobalTagThrottlerTesting namespace 2022-07-26 10:15:52 -07:00
sfc-gh-tclinkenbeard
c8d2e51aab Change argument type in updateAndGetPerClientLimit 2022-07-26 09:35:07 -07:00
sfc-gh-tclinkenbeard
1864ba2b2a Move enums into GlobalTagThrottlerImpl class
This should fix compilation issues detected by CI
2022-07-26 09:30:25 -07:00
sfc-gh-tclinkenbeard
9b13ddc8e6 Addressed review comments 2022-07-26 09:22:43 -07:00
sfc-gh-tclinkenbeard
29416267fc Remove static keyword from GlobalTagThrottlerTesting actors 2022-07-20 12:52:14 -07:00
sfc-gh-tclinkenbeard
8a18fa23cf Reenable GlobalTagThrottler_GotClientRate trace events 2022-07-19 17:04:04 -07:00
sfc-gh-tclinkenbeard
f197314cb5 Add /GlobalTagThrottler/MultiTagActiveThrottling3 unit test 2022-07-19 17:04:04 -07:00
sfc-gh-tclinkenbeard
118eb4d93b Add /GlobalTagThrottler/MultiTagActiveThrottling2 unit test and fix bug uncovered in GlobalTagThrottlerImpl::getLimitingTps 2022-07-19 17:04:04 -07:00
sfc-gh-tclinkenbeard
b4e711f1c3 Make parameter more readable in GlobalTagThrottlerTesting::runClient 2022-07-19 17:04:04 -07:00
sfc-gh-tclinkenbeard
20ac60fb11 Set throttling ratio in GlobalTagThrottler::tryUpdateAutoThrottling 2022-07-19 17:04:04 -07:00
sfc-gh-tclinkenbeard
f41515e66b Implement GlobalTagThrottler::busy*TagCount methods 2022-07-19 17:04:01 -07:00
sfc-gh-tclinkenbeard
afba51b7f8 Add tracing to GlobalTagThrottler 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
fe05cc5c72 Update busy read tag reporting in status json 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
145d10e3a4 Compute cluster-wide average transaction cost for each tag only once in getClientRates 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
080518d014 Use getQuota method in GlobalTagThrottlerImpl::getDesiredTps 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
2306757e90 Fix GlobalTagThrottler::autoThrottleCount 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
4977805d8e Fix failing global tag throttling unit tests 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
c86ae6cee5 Fix /GlobalTagThrottler/Simple unit test 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
e128c517d3 New GlobalTagThrottler implementation tracking more per-storage
server metrics
2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
6a63db08c8 Added /GlobalTagThrottler/ReservedWriteQuota unit test 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
5b0eb135e0 Guarantee reserved quota in GlobalTagThrottler 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
8e08033974 Add /GlobalTagThrottler/MultiTagActiveThrottling unit test 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
bac583ef0c Add new active throttling unit test for global tag throttler 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
34a78a82f1 Add MockStorageServer class for global tag throttler testing 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
88ca6376ce Add LimitType and OpType enum classes for global tag throttler 2022-07-19 16:29:11 -07:00
sfc-gh-tclinkenbeard
fb6540ab43 Add throttling ratio to GlobalTagThrottler 2022-07-19 16:29:10 -07:00
sfc-gh-tclinkenbeard
ab2110142a Add /GlobalTagThrottler/RemoveQuota unit test 2022-07-19 16:29:10 -07:00
sfc-gh-tclinkenbeard
019900be67 Add GlobalTagThrottlerImpl::removeUnseenTags 2022-07-19 16:29:10 -07:00
sfc-gh-tclinkenbeard
3161bcfa52 Remove outdated TODO and FIXME comments from GlobalTagThrottlerImpl 2022-07-19 16:29:06 -07:00
Markus Pilman
1de37afd52
Make TEST macros C++ only (#7558)
* proof of concept

* use code-probe instead of test

* code probe working on gcc

* code probe implemented

* renamed TestProbe to CodeProbe

* fixed refactoring typo

* support filtered output

* print probes at end of simulation

* fix missed probes print

* fix deduplication

* Fix refactoring issues

* revert bad refactor

* make sure file paths are relative

* fix more wrong refactor changes
2022-07-19 13:15:51 -07:00
sfc-gh-tclinkenbeard
3e542b7ab1 Make GlobalTagThrottlerTesting::monitorClientRates less strict 2022-06-30 00:59:26 -07:00
sfc-gh-tclinkenbeard
fabc751b0d Add /GlobalTagThrottler/UpdateQuota unit test 2022-06-15 23:32:39 -07:00
sfc-gh-tclinkenbeard
1cfd019382 Add /GlobalTagThrottler/SkewedMultiClientActiveThrottling unit test 2022-06-15 23:06:01 -07:00
sfc-gh-tclinkenbeard
dd08c2b180 Add multiclient unit tests for GlobalTagThrottler 2022-06-15 22:57:15 -07:00
sfc-gh-tclinkenbeard
5c2bcb275a Add GlobalTagThrottlerTesting namespace 2022-06-15 19:59:18 -07:00
sfc-gh-tclinkenbeard
8dccf7c10c Added /GlobalTagThrottler/MultiTagThrottling unit test 2022-06-15 19:39:58 -07:00
sfc-gh-tclinkenbeard
d692516f64 Add /GlobalTagThrottler/WriteThrottling unit test 2022-06-15 19:28:25 -07:00
sfc-gh-tclinkenbeard
a423fc77db Use multiple storage servers for GlobalTagThrottler unit tests 2022-06-15 19:15:57 -07:00
sfc-gh-tclinkenbeard
bef2f5dfaf Recalculate rate in each iteration of testClient 2022-06-15 19:12:25 -07:00
sfc-gh-tclinkenbeard
9179382fc3 Add TestStorageServers class to mock storage servers for GlobalTagThrottler testing 2022-06-15 19:08:34 -07:00
sfc-gh-tclinkenbeard
f18dbedb68 Add /GlobalTagThrottler/ActiveThrottling unit test 2022-06-15 17:52:40 -07:00
sfc-gh-tclinkenbeard
da452afde4 Add testGetTPSLimit function for global tag throttler unit testing 2022-06-15 17:38:37 -07:00
sfc-gh-tclinkenbeard
0216740c0c Add /GlobalTagThrottler/Simple unit test 2022-06-15 17:21:54 -07:00
sfc-gh-tclinkenbeard
77e3d81f55 Track per-tag rates separately for each storage server in GlobalTagThrottler 2022-06-15 15:07:07 -07:00
sfc-gh-tclinkenbeard
b7fd69ed7f Add GLOBAL_TAG_THROTTLING_TRACE_INTERVAL knob 2022-06-13 16:09:21 -07:00
sfc-gh-tclinkenbeard
75c858eb2c Differentiate between different quotas in GlobalTagThrottling workload 2022-06-13 10:01:55 -07:00
sfc-gh-tclinkenbeard
d5e7981ca1 Add ClientTagThrottleLimits::NO_EXPIRATION static constant 2022-06-01 13:02:18 -07:00
sfc-gh-tclinkenbeard
67a90d73bd Add GlobalTagThrottlerImpl::tracer 2022-05-26 11:40:12 -07:00