apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-02 19:25:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,524 Commits 35 Branches 318 Tags
Commit Graph

21524 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Josh Slocum
0b674bf0c4 Merge branch 'main' into cf_bw_operational_fixes 2022-07-20 08:03:59 -05:00
Josh Slocum
fd9201f60b Merge branch 'main' into cf_metadata_rewrite 2022-07-20 07:55:00 -05:00
Josh Slocum
44885aa719 cleanup 2022-07-20 07:46:57 -05:00
Josh Slocum
78b6a96006 Merge branch 'main' into granule_merging_batch 2022-07-20 07:42:26 -05:00
Josh Slocum
4000682578 moving comment 2022-07-20 07:35:30 -05:00
Junhyun Shim
0874e553cd Place generateRandomData() under {I|Deterministic}Random 2022-07-20 13:21:11 +02:00
Jingyu Zhou
0f094d2aa1 Fix ScopeEventFieldTypeMismatch error for TLogMetrics 
Backport changes made to TLogServer in #4616 back to old TLog implementations.
Old implementations were using SpecialCounter, which is string. The new type
is int64_t. Without the change, we can have many events like:

<Event Severity="30" Time="1658165532.958152" DateTime="2022-07-18T17:32:12Z" Type="ScopeEventFieldTypeMismatch" ID="0000000000000000" EventType="TraceEvent.TLogMetrics" FieldName="QueueDiskBytesUsed" OldType="Int64" NewType="String" ThreadID="2451559325190099131" Machine="10.242.248.26:4703" LogGroup="xxxx" Roles="TL" />
 2022-07-19 22:27:29 -07:00
Jingyu Zhou
a7469b925b
Merge pull request #7630 from jzhou77/main 
Add getMappedRange latency metrics
 2022-07-19 22:13:50 -07:00
Jingyu Zhou
e8baba8009
Merge pull request #7575 from xis19/lb 
Notes on Load Balancer
 2022-07-19 17:50:25 -07:00
Josh Slocum
12b6f386cb Refactoring granule flush to retry properly on granule rollback 2022-07-19 19:49:20 -05:00
Lukas Joswiak
c357a90b30 Ensure change coordinators request came from same generation proxy 
There was a rare but possible issue where a change coordinators request
could be in flight, but reading `\xff/coordinators` would return the old
set of coordinators, even though a previous attempt to write it returned
`commit_unknown_result`. This happened if there was an unrelated
recovery between setting `\xff/coordinators` and the updated
coordinators reaching each machine. The `commit_unknown_result` caused
by this recovery meant the change coordinators retry loop would read
`\xff/coordinators`, but since the request was ongoing it would read the
old set of coordinators. The fix is to have the cluster controller
ignore any change coordinators request from an old generation, meaning
when the retry loop reads the old coordiantors from `\xff/coordinators`,
it is guaranteed that the in progress change coordinators message will
be rejected when arriving at the cluster controller.
 2022-07-19 17:44:48 -07:00
Josh Slocum
166de4b704 Fixing merge convergence bugs 2022-07-19 18:44:40 -05:00
Jingyu Zhou
72e72f6d87 Add getMappedRange latency metrics 2022-07-19 16:31:24 -07:00
Jingyu Zhou
bc62b538b1
Merge pull request #7627 from jzhou77/remove-metrics 
Remove unused "readQueueSizeMetric"
 2022-07-19 15:55:52 -07:00
Dan Lambright
7e296c2367
simple replication (#7625) 2022-07-19 18:30:34 -04:00
Markus Pilman
3327ab395b Change test harness to include comments 2022-07-19 15:41:53 -06:00
Jingyu Zhou
fde5aeeb62 Remove unused "readQueueSizeMetric" 2022-07-19 14:38:10 -07:00
A.J. Beamon
537ceff8ac Remove the ability to configure a tenant subspace. Rename the prefixes used for tenant metadata. 2022-07-19 14:32:05 -07:00
Xiaoxi Wang
a5fba6031f resolve conflict upstream/main 2022-07-19 13:55:51 -07:00
Xiaoxi Wang
43099bda0d resolve conflict upstream/main 2022-07-19 13:48:39 -07:00
A.J. Beamon
190ad8c7e9 Convert existing tuple usages to use Tuple::makeTuple() 2022-07-19 13:45:59 -07:00
Xiaoxi Wang
7865ead54d Merge branch 'main' into readaware 2022-07-19 13:35:33 -07:00
Xiaoxi Wang
dea775ad0d
Merge pull request #7580 from sfc-gh-xwang/doc/readaware 
update data distributor design doc
 2022-07-19 13:29:12 -07:00
Markus Pilman
1de37afd52
Make TEST macros C++ only (#7558) 
* proof of concept

* use code-probe instead of test

* code probe working on gcc

* code probe implemented

* renamed TestProbe to CodeProbe

* fixed refactoring typo

* support filtered output

* print probes at end of simulation

* fix missed probes print

* fix deduplication

* Fix refactoring issues

* revert bad refactor

* make sure file paths are relative

* fix more wrong refactor changes
 2022-07-19 13:15:51 -07:00
Josh Slocum
19893b4b7a Persisting change feed metadata version to fix fetch/destroy race across restarts 2022-07-19 14:20:14 -05:00
Josh Slocum
b9317bebca Reducing ss injection rates 2022-07-19 14:10:47 -05:00
Josh Slocum
acc5aee89e Fixed change feed validation issue 2022-07-19 14:10:10 -05:00
Xiaoxi Wang
9dfd58978f
Apply suggestions from code review 
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
 2022-07-19 12:03:49 -07:00
Xiaoxi Wang
1c543e3b4a add unittest 2022-07-19 11:58:24 -07:00
A.J. Beamon
7324f28441 Add the ability for StringRef.eat to return whether a separator was found. Add a serialize function and equality operators to ClusterConnectionString. Remove unused variable. 2022-07-19 11:55:58 -07:00
A.J. Beamon
1b81e72604 Add a Tuple::makeTuple function to easily construct a tuple. Update Tuple to allow all types to be passed via .append() so they can be used with makeTuple. 2022-07-19 11:50:58 -07:00
A.J. Beamon
0d20cd2068
Merge pull request #7618 from sfc-gh-ajbeamon/fix-compile-warnings 
Fix a few compile warnings about unused variables
 2022-07-19 11:10:42 -07:00
A.J. Beamon
c4cd72bea1 Fix a few compile warnings about unused variables 2022-07-19 10:01:41 -07:00
Xiaoxi Wang
491938fdf5 Merge branch 'main' of https://github.com/apple/foundationdb into feature/dd-refactor-incremental 2022-07-19 09:51:44 -07:00
A.J. Beamon
0e03fbd9e7
Merge pull request #7605 from sfc-gh-ajbeamon/fix-trace-log-detail-formatting 
Remove some instances of using printable or toString in a trace event detail
 2022-07-19 08:24:58 -07:00
Dan Lambright
775ab3323e
update tag client cache on getKeyLocation (#7613) 2022-07-19 11:24:17 -04:00
Josh Slocum
78d4d85f3b Adding non-tss delay injection to SS as well 2022-07-19 09:59:14 -05:00
Josh Slocum
0d9bb9f4a5 Added targeted storage server restarts at critical metadata points 2022-07-19 08:33:43 -05:00
Josh Slocum
2573c0018c cleanup after passing tests 2022-07-19 08:00:25 -05:00
Josh Slocum
679bb05d34 change feed move/destroy race fixes 2022-07-19 07:19:45 -05:00
Trevor Clinkenbeard
1eec6f993d
Merge pull request #7572 from sfc-gh-akejriwal/tenantquota 
Introduce storage quotas per tenant
 2022-07-18 20:00:22 -07:00
Josh Slocum
0a4aef16d0 Several bugs with new change feed metadata 2022-07-18 19:32:48 -05:00
A.J. Beamon
e65ac1a0c1 Remove one more include and some extraneous return statements. Add a NullCodec that passes through the arguments unchanged. 2022-07-18 16:37:04 -07:00
A.J. Beamon
38855fd786 Remove some instances of using printable or toString in a trace event detail. 2022-07-18 16:24:33 -07:00
Ankita Kejriwal
2757262ec9
Simplify storageQuotaKey() function implementation 
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
 2022-07-18 15:56:11 -07:00
Josh Slocum
bfab550435 cleanup 2022-07-18 16:26:03 -05:00
Xiaoxi Wang
2909614b0c smaller function 2022-07-18 14:21:50 -07:00
Josh Slocum
340a01763b disabling merge convergence check for now 2022-07-18 16:09:14 -05:00
Renxuan Wang
570db7a7d2
Fix processDiskReadSeconds and processDiskWriteSeconds. (#7608) 2022-07-18 13:47:45 -07:00
Jingyu Zhou
d28fb2b809
Merge pull request #7607 from sfc-gh-jshim/dlopen-nodelete-for-sanitizer 
Apply RTLD_NODELETE for USE_SANITIZER builds
 2022-07-18 13:25:33 -07:00