21272 Commits

Author SHA1 Message Date
Zhe Wu
bd99f4fa3b Log tlog initialization 2022-07-21 13:54:44 -07:00
Andrew Noyes
45c8a4e09d
Build fixes/improvements for sanitizers (#7657)
* Don't build fdb c shim with ubsan

This avoids duplicate symbols when linking. It doesn't really make sense
to assemble files with -fsanitize=undefined anyway, since it won't
insert instrumentation.

* Consolidate boost_asan with boost_target
2022-07-21 12:43:38 -07:00
Trevor Clinkenbeard
9d63a859b0
Merge pull request #7443 from sfc-gh-xwang/readaware
[Read-aware DD] Use KeyRangeStorageMetrics instead of StorageMetrics
2022-07-21 12:37:51 -07:00
A.J. Beamon
410f27412b
Merge pull request #7620 from sfc-gh-ajbeamon/make-tuple
Add a Tuple::makeTuple function to easily construct a tuple
2022-07-20 17:09:10 -07:00
A.J. Beamon
190711ccd8
Merge pull request #7622 from sfc-gh-ajbeamon/eat-and-connection-string-changes
Add some helper functions to ClusterConnectionString and an improvement to StringRef.eat
2022-07-20 16:10:24 -07:00
Xiaoxi Wang
cd13356964 solve review comments 2022-07-20 16:09:38 -07:00
A.J. Beamon
fee131f24d
Merge pull request #7591 from sfc-gh-ajbeamon/key-backed-types-range-read-more
Add support for returning a more flag from key backed types' range reads
2022-07-20 15:57:50 -07:00
A.J. Beamon
51204163df Some minor changes from code review 2022-07-20 15:29:34 -07:00
A.J. Beamon
4d036ae339
Merge pull request #7626 from sfc-gh-ajbeamon/tenant-metadata-change
Some changes to the tenant metadata
2022-07-20 14:50:00 -07:00
Ata E Husain Bohra
9a3e88df46
Fix ASAN build (#7629)
* Fix ASAN build

Description
  -diff-2: Fix Mac build issues
  -diff-1: Address review comments

Patch addresses the issue where ASAN build failed after introducing
BlobGranule compression.

Testing

ASAN build
2022-07-20 14:14:46 -07:00
A.J. Beamon
37b7666262 Add a comment to name the fold expression syntax in makeTuple. This should make it easier to look up for those unfamiliar with the syntax. 2022-07-20 13:57:55 -07:00
Zhe Wu
aa2740e21e Increase AllTags field length in TLogReady 2022-07-20 13:17:21 -07:00
A.J. Beamon
f6a47a18e9 Use a constexpr check for deserialization (from code review) 2022-07-20 13:01:36 -07:00
Josh Slocum
c066597af1
Merge pull request #7644 from sfc-gh-jslocum/granule_merging_converge
Granule merging converge
2022-07-20 15:00:19 -05:00
Trevor Clinkenbeard
1020d5b1ad
Merge pull request #7641 from harikb/upstream-clean
Backups, Azure, Issue 7570: Check existance of container before creation attempt
2022-07-20 12:43:54 -07:00
Josh Slocum
2a0381f44d
Merge pull request #7603 from sfc-gh-ahusain/ahusain-fix-test
Fix snapshotFormatUnitTest infinite loop
2022-07-20 14:17:39 -05:00
Josh Slocum
8ccf18f35c cleanup 2022-07-20 12:52:21 -05:00
Josh Slocum
316b7a5344 Merge branch 'main' into granule_merging_converge 2022-07-20 12:13:48 -05:00
Josh Slocum
cc5ba89fcf
Merge pull request #7612 from sfc-gh-jslocum/granule_merging_batch
Granule merging batch
2022-07-20 11:59:55 -05:00
Jingyu Zhou
fc8cf679a0
Merge pull request #7638 from jzhou77/main
Fix ScopeEventFieldTypeMismatch error for TLogMetrics
2022-07-20 09:50:12 -07:00
Hari Bhaskaran
3aec508aec Issue 7570: Check existance of container before creation attempt 2022-07-20 09:40:49 -07:00
Josh Slocum
12ccd3b146 typo 2022-07-20 09:35:57 -05:00
Josh Slocum
44885aa719 cleanup 2022-07-20 07:46:57 -05:00
Josh Slocum
78b6a96006 Merge branch 'main' into granule_merging_batch 2022-07-20 07:42:26 -05:00
Josh Slocum
4000682578 moving comment 2022-07-20 07:35:30 -05:00
Jingyu Zhou
0f094d2aa1 Fix ScopeEventFieldTypeMismatch error for TLogMetrics
Backport changes made to TLogServer in #4616 back to old TLog implementations.
Old implementations were using SpecialCounter, which is string. The new type
is int64_t. Without the change, we can have many events like:

<Event Severity="30" Time="1658165532.958152" DateTime="2022-07-18T17:32:12Z" Type="ScopeEventFieldTypeMismatch" ID="0000000000000000" EventType="TraceEvent.TLogMetrics" FieldName="QueueDiskBytesUsed" OldType="Int64" NewType="String" ThreadID="2451559325190099131" Machine="10.242.248.26:4703" LogGroup="xxxx" Roles="TL" />
2022-07-19 22:27:29 -07:00
Jingyu Zhou
a7469b925b
Merge pull request #7630 from jzhou77/main
Add getMappedRange latency metrics
2022-07-19 22:13:50 -07:00
Jingyu Zhou
e8baba8009
Merge pull request #7575 from xis19/lb
Notes on Load Balancer
2022-07-19 17:50:25 -07:00
Josh Slocum
12b6f386cb Refactoring granule flush to retry properly on granule rollback 2022-07-19 19:49:20 -05:00
Josh Slocum
166de4b704 Fixing merge convergence bugs 2022-07-19 18:44:40 -05:00
Jingyu Zhou
72e72f6d87 Add getMappedRange latency metrics 2022-07-19 16:31:24 -07:00
Jingyu Zhou
bc62b538b1
Merge pull request #7627 from jzhou77/remove-metrics
Remove unused "readQueueSizeMetric"
2022-07-19 15:55:52 -07:00
Dan Lambright
7e296c2367
simple replication (#7625) 2022-07-19 18:30:34 -04:00
Jingyu Zhou
fde5aeeb62 Remove unused "readQueueSizeMetric" 2022-07-19 14:38:10 -07:00
A.J. Beamon
537ceff8ac Remove the ability to configure a tenant subspace. Rename the prefixes used for tenant metadata. 2022-07-19 14:32:05 -07:00
A.J. Beamon
190ad8c7e9 Convert existing tuple usages to use Tuple::makeTuple() 2022-07-19 13:45:59 -07:00
Xiaoxi Wang
7865ead54d Merge branch 'main' into readaware 2022-07-19 13:35:33 -07:00
Xiaoxi Wang
dea775ad0d
Merge pull request #7580 from sfc-gh-xwang/doc/readaware
update data distributor design doc
2022-07-19 13:29:12 -07:00
Markus Pilman
1de37afd52
Make TEST macros C++ only (#7558)
* proof of concept

* use code-probe instead of test

* code probe working on gcc

* code probe implemented

* renamed TestProbe to CodeProbe

* fixed refactoring typo

* support filtered output

* print probes at end of simulation

* fix missed probes print

* fix deduplication

* Fix refactoring issues

* revert bad refactor

* make sure file paths are relative

* fix more wrong refactor changes
2022-07-19 13:15:51 -07:00
Xiaoxi Wang
9dfd58978f
Apply suggestions from code review
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2022-07-19 12:03:49 -07:00
A.J. Beamon
7324f28441 Add the ability for StringRef.eat to return whether a separator was found. Add a serialize function and equality operators to ClusterConnectionString. Remove unused variable. 2022-07-19 11:55:58 -07:00
A.J. Beamon
1b81e72604 Add a Tuple::makeTuple function to easily construct a tuple. Update Tuple to allow all types to be passed via .append() so they can be used with makeTuple. 2022-07-19 11:50:58 -07:00
A.J. Beamon
0d20cd2068
Merge pull request #7618 from sfc-gh-ajbeamon/fix-compile-warnings
Fix a few compile warnings about unused variables
2022-07-19 11:10:42 -07:00
A.J. Beamon
c4cd72bea1 Fix a few compile warnings about unused variables 2022-07-19 10:01:41 -07:00
A.J. Beamon
0e03fbd9e7
Merge pull request #7605 from sfc-gh-ajbeamon/fix-trace-log-detail-formatting
Remove some instances of using printable or toString in a trace event detail
2022-07-19 08:24:58 -07:00
Dan Lambright
775ab3323e
update tag client cache on getKeyLocation (#7613) 2022-07-19 11:24:17 -04:00
Trevor Clinkenbeard
1eec6f993d
Merge pull request #7572 from sfc-gh-akejriwal/tenantquota
Introduce storage quotas per tenant
2022-07-18 20:00:22 -07:00
A.J. Beamon
e65ac1a0c1 Remove one more include and some extraneous return statements. Add a NullCodec that passes through the arguments unchanged. 2022-07-18 16:37:04 -07:00
A.J. Beamon
38855fd786 Remove some instances of using printable or toString in a trace event detail. 2022-07-18 16:24:33 -07:00
Ankita Kejriwal
2757262ec9
Simplify storageQuotaKey() function implementation
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
2022-07-18 15:56:11 -07:00