apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-01 18:56:00 +08:00
Code Issues Packages Projects Releases Wiki Activity
23,705 Commits 35 Branches 318 Tags
Commit Graph

23705 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Steve Atherton
866ea3df1f Fix go usage in mock_kms cmake commands. 2022-11-07 15:16:23 -08:00
Xiaoxi Wang
9332a155d5
Merge pull request #8678 from sfc-gh-xwang/fix/dd/priority 
Add immediate priority and read_lock options to DD transactions
 2022-11-07 10:08:11 -08:00
He Liu
bffa838398
Checkpoint restore with shard (#8667) 
* Added SSPhysicalShard.

* Update physicalShards in StorageServer::addShard().

* Handle notAssigned shard.

* fetchKeys() are not stopped during TerminateStorageServer since
physicalShards are not cleared.

* Fixed addingSplitLeft unset shardId.

* Increased the timeout for Rocks reads in simulation.

* Cleanup.

* set SERVE_AUDIT_STORAGE_PARALLELISM to 1.

* Disabled ValidateStorage test.

* Resolved comments.

Co-authored-by: He Liu <heliu@apple.com>
 2022-11-07 10:02:35 -08:00
Jingyu Zhou
0adcd92d33
Merge pull request #8461 from hfu94/id 
Each getRange request in a txn has a distinct trace id
 2022-11-07 09:34:22 -08:00
Jingyu Zhou
a121205d22
Merge pull request #8504 from sfc-gh-anoyes/anoyes/go-hint 
Add a hint for the GO path
 2022-11-07 09:31:31 -08:00
Jingyu Zhou
8a8f0994b5
Merge pull request #8675 from sfc-gh-anoyes/anoyes/explain-4.3 
Explain where 4.3 comes from for PTree finger length explanation
 2022-11-07 09:27:21 -08:00
Jingyu Zhou
10e6de53b3
Merge pull request #8689 from sfc-gh-anoyes/anoyes/disallow-uniform-initialization-syntax 
Disallow uniform initialization syntax for state variables
 2022-11-07 09:18:28 -08:00
Jingyu Zhou
010dcb8f81
Merge pull request #8690 from LukasMoll/bindings-bindingtester-flake8 
/bindings/bindingtester/ Applied flake8
 2022-11-07 09:16:10 -08:00
Jingyu Zhou
79818c28dd
Merge pull request #8691 from LukasMoll/bindings-c-flake8 
/bindings/c/ Applied flake8
 2022-11-07 09:15:47 -08:00
Jingyu Zhou
8999c4af16
Merge pull request #8707 from sfc-gh-jslocum/fix_aws_sdk 
fixing build vs with that caused compiling aws sdk to not work properly
 2022-11-07 09:13:30 -08:00
Zhe Wu
56001de2d4 More nit changes around DD 2022-11-07 09:11:16 -08:00
Zhe Wu
3a02f919b9 Add some comments in DD and fix some nit 2022-11-07 09:11:16 -08:00
Christian Wende
4b66b0e4ef
Mako: Initialize Arguments::num_report_files to 0 (#8717) 2022-11-07 16:28:17 +01:00
Junhyun Shim
1ee1b6ce4d
Merge pull request #8631 from sfc-gh-vgasiunas/vgasiunas-fdbmonitor-in-python 
Avoid local cluster tests creating zombie fdbmonitor processes
 2022-11-07 14:47:36 +01:00
Vaidas Gasiunas
ce3038bfe5
Use a network option for retaining temporary client lib copies instead of a client knob (#8630) 2022-11-07 14:46:17 +01:00
Christian Wende
d3cf71ece0
Fix unintended behavior in Mako (#8635) 
* Fix errors statistic in sync mode

* Fix error statistics and restart behavior in async mode

* Fix #iterations stopping criterion

* Prevent edge cases with regards to target tps and iteration specification

* Fix mistake in async logic

* fix throttling and add one more case to validation

* small changes

* Mako: Remove unnecessary force_inline's and small change to header include statement

* Mako: Replace `auto err = fdb::Error{}`

* Mako: Move error statistics updates into future.hpp

* Mako: Async: Rename restartIteration -> onIterationEnd

* Mako: Move transaction creation in sync mode

* Mako: Clean up future.hpp by moving stats updates out of it
 2022-11-07 10:44:19 +01:00
Vaidas Gasiunas
286f9b729a Merge remote-tracking branch 'apple/main' into vgasiunas-fdbmonitor-in-python 2022-11-07 10:33:06 +01:00
Trevor Clinkenbeard
8ee0411637
Merge pull request #8664 from sfc-gh-tclinkenbeard/increase-suppression-interval 
Increase suppression interval for `GrvProxyTransactionTagThrottler_MultipleTags`
 2022-11-06 08:48:41 -08:00
sfc-gh-tclinkenbeard
dacb4e3fb3 Merge remote-tracking branch 'origin/main' into increase-suppression-interval 2022-11-06 07:35:55 -08:00
Zhe Wu
ae4d66c0d7 Update TLogServer in main 2022-11-04 15:05:37 -07:00
Zhe Wu
fc35ed9d0a Change ASSERT_WE_THINK to ASSERT when checking that peek reply start version must be greater than latest pop version 2022-11-04 15:05:37 -07:00
Zhe Wu
5296bb96a6 Apply clang format 2022-11-04 15:05:37 -07:00
Zhe Wu
32bc9b6ebb Fix a race condition between batched peek and pop, where the server removal pop may be lost 2022-11-04 15:05:37 -07:00
Jingyu Zhou
a5a5df715b
Merge pull request #8702 from sfc-gh-ajbeamon/fix-ub-in-keyafter 
Fix undefined behavior in keyAfter
 2022-11-04 14:16:04 -07:00
Lukas Molleman
c87b6ba48b revert sys.path placement 2022-11-04 21:32:21 +01:00
Lukas Molleman
87d28dd28c revert sys.path placement 2022-11-04 21:27:07 +01:00
Josh Slocum
21dba9ea99 fixing build vs with that caused compiling aws sdk to not work properly 2022-11-04 15:12:06 -05:00
A.J. Beamon
788d119e94
Merge pull request #8672 from sfc-gh-ajbeamon/fix-config-change-during-quiescent-check 
Fix: the simulator was making a configuration change during a quiescent database check
 2022-11-04 12:40:32 -07:00
A.J. Beamon
ec088c98c1 Merge branch 'main' into fix-ub-in-keyafter 2022-11-04 11:46:29 -07:00
Xiaoxi Wang
cc2225c18e fix update txn options 2022-11-04 11:34:09 -07:00
Josh Slocum
bed057e2d3
moving fdbblob in sim folder for simulations (#8701) 2022-11-04 13:26:44 -05:00
Yao Xiao
8de6793aa3
Add metrics for read range. (#8692) 2022-11-04 11:05:53 -07:00
Yao Xiao
0ca344a917
Add SS read range bytes metrics. (#8697) 2022-11-04 10:42:08 -07:00
Yao Xiao
a9e3a6f817
Add bounds to iterator. (#8685) 2022-11-04 10:41:46 -07:00
A.J. Beamon
248d4e95dd Don't copy an empty string in keyAfter and singleKeyRange 2022-11-04 10:02:35 -07:00
Lukas Joswiak
cf97541135 Fix exclude status of machines in status json 
Previously, `status json` would report a machine as excluded when any of
its processes were excluded. But a machine should only be reported as
excluded when all of its processes are excluded.

I tested this change by running a small, three process test cluster. I
excluded one machine, and verified `status json` reported the overall
machine as not excluded.
 2022-11-04 09:55:51 -07:00
A.J. Beamon
4e7d41026b Merge branch 'main' into fix-config-change-during-quiescent-check 2022-11-04 08:51:13 -07:00
Ata E Husain Bohra
d853304b18
Refactor CP::WriteMutation to optimize ACTOR alloc/dealloc (#8677) 
* Refactor CP::WriteMutation to optimize ACTOR alloc/dealloc

Description

WriteMutation routine is responsible for appending mutations to be persisted
in TLog, the operation isn't a 'blocking' operation, except for few cases
when Encryption is supported by the cluster such
as:
1. Fetch encryption keys to encrypt the mutation.
2. Split ClearRange mutation to respect Encryption domain boundaries.
3. Ensure sanity of already encrypted mutation - simulation limited check.

Patch optimizes the "fast" path by avoiding alloc/dealloc overhead
due to be ACTOR framework support, the penalty happens iff any of above
conditions are met.

Testing

devRunCorrectness - 100K
 2022-11-04 07:40:41 -07:00
Jingyu Zhou
c80ec6f6da
Merge pull request #8693 from sfc-gh-tclinkenbeard/disable-throughput-quota 
Disable throughput quota test
 2022-11-03 18:49:35 -07:00
Jingyu Zhou
ec471aa63c
Merge pull request #8684 from jzhou77/fix 
Fix ASan failure heap use after free in status json generation
 2022-11-03 18:48:26 -07:00
Josh Slocum
cff99a64f6
Blob Granule Attrition fixes (#8682) 
* Assert was incorrect in change feed destroy race with moved() clearing map

* fixing race between injected fault and granule revoke

* Handling race in sim2 blob worker attrition check
 2022-11-03 18:48:10 -05:00
Josh Slocum
8b9e9fd7d9
Parallelize bg purge (#8687) 
* parallelizing full granule purging

* Explicitly sorting full granule purges because they're not guaranteed to be queued in version order
 2022-11-03 18:47:54 -05:00
A.J. Beamon
61172037c9 Merge branch 'main' into fix-config-change-during-quiescent-check 2022-11-03 15:13:55 -07:00
Xiaoxi Wang
aded047db1 add priority and read_lock options 2022-11-03 15:08:12 -07:00
sfc-gh-tclinkenbeard
92e21de362 Disable ThroughputQuota.toml test 2022-11-03 15:07:02 -07:00
A.J. Beamon
3efbade1be
Merge pull request #8688 from sfc-gh-ajbeamon/fix-uninitialized-string 
Fix valgrind error in TransactionCost test
 2022-11-03 15:02:11 -07:00
Josh Slocum
647c6487b4
add client cache size blob metadata latency metrics (#8484) 2022-11-03 16:43:30 -05:00
Josh Slocum
d68cd3493e
making read caching configurable for blob store (#8607) 2022-11-03 16:42:46 -05:00
Josh Slocum
494dd1c5ed
switch bg file data chunks to be serialized with binary writer instead of object writer (#8535) 2022-11-03 16:42:36 -05:00
Lukas Molleman
2b8c1845a2 C:/Program Files/Git/bindings/c/ Applied flake8 2022-11-03 22:08:13 +01:00