apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-05-14 01:42:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
23,721 Commits 35 Branches 318 Tags
Commit Graph

23721 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Josh Slocum
baa35fbc8f
Blob single part upload (#8703) 
* Exposing writeEntireFile up through BackupContainerFileSystem, and using it in blob worker

* Adding blob worker latency metrics

* avoid writeEntireFile if object is too large

* gracefully falling back to multi-part upload if the file is too big
 2022-11-08 17:30:01 -06:00
Steve Atherton
ca1f3140c4
Merge pull request #8733 from sfc-gh-satherton/disable-sslock-temporarily 
Temporarily disable storage server read lock
 2022-11-08 12:51:41 -08:00
Nim Wijetunga
8bd5f362a5
Extend Transaction Window during Restore in Simulation (#8729) 
* fix bug

* fix formatting
 2022-11-08 11:53:36 -08:00
Yi Wu
705ad9cb91
EAR: fix Redwood encryption system key space prefix (#8698) 
We should encrypt the full `\xff` key space with system key, which is the database-wide system key space. "\xff\xff" is the subspace in it used by storage to store its durable state locally.
 2022-11-08 09:25:11 -08:00
Steve Atherton
b4a6ac398c Merge commit 'f503ac022a9822ef8801b0bf990278d2ce305e7d' into disable-sslock-temporarily 2022-11-07 23:33:36 -08:00
neethuhaneesha
ca33fe1f1e
Rocksdb stats level knob. (#8711) 2022-11-07 22:32:48 -08:00
Nim Wijetunga
70d30d93aa
Add CLI Argument to Override Snapshot Backup Encryption (#8661) 
* add cli option

* fix compile error

* address pr comments

* trigger build

* trigger build
 2022-11-07 20:39:18 -08:00
Xiaoxi Wang
d09c0c71c8
Merge pull request #8727 from sfc-gh-xwang/fix/main/ddpriority 
make trackExcludedServers PRIORITY_SYSTEM_IMMEDIATE
 2022-11-07 20:08:54 -08:00
Ankita Kejriwal
f503ac022a
Merge pull request #8706 from sfc-gh-tclinkenbeard/throughput-quota-cleanup 
Make `GlobalTagThrottler` minimum average transaction cost equal to one page
 2022-11-07 16:40:42 -08:00
Hui Liu
27d7753c2f
Merge pull request #8721 from sfc-gh-huliu/epoc 
Update BlobManager epoc after restore
 2022-11-07 16:16:28 -08:00
He Liu
d28187ca90
Do not set timeout for RocksDB reads in simulation. (#8716) 
* Do not set timeout for RocksDB reads in simulation.

* Cleanup.

* Ignore validateStorage test.
 2022-11-07 15:59:52 -08:00
Steve Atherton
f17c00c13f Disable taking the ss read lock due to a 5% read perf regression in 100% cached read, CPU-bound scenario. 2022-11-07 15:17:19 -08:00
Steve Atherton
866ea3df1f Fix go usage in mock_kms cmake commands. 2022-11-07 15:16:23 -08:00
Xiaoxi Wang
4971976a61 make trackExcludedServers PRIORITY_SYSTEM_IMMEDIATE 2022-11-07 14:38:04 -08:00
Hui Liu
13b68aa4d8 Update BlobManager epoc after restore 2022-11-07 13:43:38 -08:00
Xiaoxi Wang
9332a155d5
Merge pull request #8678 from sfc-gh-xwang/fix/dd/priority 
Add immediate priority and read_lock options to DD transactions
 2022-11-07 10:08:11 -08:00
He Liu
bffa838398
Checkpoint restore with shard (#8667) 
* Added SSPhysicalShard.

* Update physicalShards in StorageServer::addShard().

* Handle notAssigned shard.

* fetchKeys() are not stopped during TerminateStorageServer since
physicalShards are not cleared.

* Fixed addingSplitLeft unset shardId.

* Increased the timeout for Rocks reads in simulation.

* Cleanup.

* set SERVE_AUDIT_STORAGE_PARALLELISM to 1.

* Disabled ValidateStorage test.

* Resolved comments.

Co-authored-by: He Liu <heliu@apple.com>
 2022-11-07 10:02:35 -08:00
Jingyu Zhou
0adcd92d33
Merge pull request #8461 from hfu94/id 
Each getRange request in a txn has a distinct trace id
 2022-11-07 09:34:22 -08:00
Jingyu Zhou
a121205d22
Merge pull request #8504 from sfc-gh-anoyes/anoyes/go-hint 
Add a hint for the GO path
 2022-11-07 09:31:31 -08:00
Jingyu Zhou
8a8f0994b5
Merge pull request #8675 from sfc-gh-anoyes/anoyes/explain-4.3 
Explain where 4.3 comes from for PTree finger length explanation
 2022-11-07 09:27:21 -08:00
Jingyu Zhou
10e6de53b3
Merge pull request #8689 from sfc-gh-anoyes/anoyes/disallow-uniform-initialization-syntax 
Disallow uniform initialization syntax for state variables
 2022-11-07 09:18:28 -08:00
Jingyu Zhou
010dcb8f81
Merge pull request #8690 from LukasMoll/bindings-bindingtester-flake8 
/bindings/bindingtester/ Applied flake8
 2022-11-07 09:16:10 -08:00
Jingyu Zhou
79818c28dd
Merge pull request #8691 from LukasMoll/bindings-c-flake8 
/bindings/c/ Applied flake8
 2022-11-07 09:15:47 -08:00
Jingyu Zhou
8999c4af16
Merge pull request #8707 from sfc-gh-jslocum/fix_aws_sdk 
fixing build vs with that caused compiling aws sdk to not work properly
 2022-11-07 09:13:30 -08:00
Zhe Wu
56001de2d4 More nit changes around DD 2022-11-07 09:11:16 -08:00
Zhe Wu
3a02f919b9 Add some comments in DD and fix some nit 2022-11-07 09:11:16 -08:00
Christian Wende
4b66b0e4ef
Mako: Initialize Arguments::num_report_files to 0 (#8717) 2022-11-07 16:28:17 +01:00
Junhyun Shim
1ee1b6ce4d
Merge pull request #8631 from sfc-gh-vgasiunas/vgasiunas-fdbmonitor-in-python 
Avoid local cluster tests creating zombie fdbmonitor processes
 2022-11-07 14:47:36 +01:00
Vaidas Gasiunas
ce3038bfe5
Use a network option for retaining temporary client lib copies instead of a client knob (#8630) 2022-11-07 14:46:17 +01:00
Christian Wende
d3cf71ece0
Fix unintended behavior in Mako (#8635) 
* Fix errors statistic in sync mode

* Fix error statistics and restart behavior in async mode

* Fix #iterations stopping criterion

* Prevent edge cases with regards to target tps and iteration specification

* Fix mistake in async logic

* fix throttling and add one more case to validation

* small changes

* Mako: Remove unnecessary force_inline's and small change to header include statement

* Mako: Replace `auto err = fdb::Error{}`

* Mako: Move error statistics updates into future.hpp

* Mako: Async: Rename restartIteration -> onIterationEnd

* Mako: Move transaction creation in sync mode

* Mako: Clean up future.hpp by moving stats updates out of it
 2022-11-07 10:44:19 +01:00
Vaidas Gasiunas
286f9b729a Merge remote-tracking branch 'apple/main' into vgasiunas-fdbmonitor-in-python 2022-11-07 10:33:06 +01:00
Trevor Clinkenbeard
8ee0411637
Merge pull request #8664 from sfc-gh-tclinkenbeard/increase-suppression-interval 
Increase suppression interval for `GrvProxyTransactionTagThrottler_MultipleTags`
 2022-11-06 08:48:41 -08:00
sfc-gh-tclinkenbeard
dacb4e3fb3 Merge remote-tracking branch 'origin/main' into increase-suppression-interval 2022-11-06 07:35:55 -08:00
Zhe Wu
ae4d66c0d7 Update TLogServer in main 2022-11-04 15:05:37 -07:00
Zhe Wu
fc35ed9d0a Change ASSERT_WE_THINK to ASSERT when checking that peek reply start version must be greater than latest pop version 2022-11-04 15:05:37 -07:00
Zhe Wu
5296bb96a6 Apply clang format 2022-11-04 15:05:37 -07:00
Zhe Wu
32bc9b6ebb Fix a race condition between batched peek and pop, where the server removal pop may be lost 2022-11-04 15:05:37 -07:00
Jingyu Zhou
a5a5df715b
Merge pull request #8702 from sfc-gh-ajbeamon/fix-ub-in-keyafter 
Fix undefined behavior in keyAfter
 2022-11-04 14:16:04 -07:00
Lukas Molleman
c87b6ba48b revert sys.path placement 2022-11-04 21:32:21 +01:00
Lukas Molleman
87d28dd28c revert sys.path placement 2022-11-04 21:27:07 +01:00
Josh Slocum
21dba9ea99 fixing build vs with that caused compiling aws sdk to not work properly 2022-11-04 15:12:06 -05:00
sfc-gh-tclinkenbeard
37f36da9e4 Fix /GlobalTagThrottler/TagLimit unit test 2022-11-04 13:10:43 -07:00
A.J. Beamon
788d119e94
Merge pull request #8672 from sfc-gh-ajbeamon/fix-config-change-during-quiescent-check 
Fix: the simulator was making a configuration change during a quiescent database check
 2022-11-04 12:40:32 -07:00
A.J. Beamon
ec088c98c1 Merge branch 'main' into fix-ub-in-keyafter 2022-11-04 11:46:29 -07:00
Xiaoxi Wang
cc2225c18e fix update txn options 2022-11-04 11:34:09 -07:00
Josh Slocum
bed057e2d3
moving fdbblob in sim folder for simulations (#8701) 2022-11-04 13:26:44 -05:00
sfc-gh-tclinkenbeard
8285b297ef Set minimum average cost to 1 page in GlobalTagThrottler 2022-11-04 11:22:44 -07:00
Yao Xiao
8de6793aa3
Add metrics for read range. (#8692) 2022-11-04 11:05:53 -07:00
Yao Xiao
0ca344a917
Add SS read range bytes metrics. (#8697) 2022-11-04 10:42:08 -07:00
Yao Xiao
a9e3a6f817
Add bounds to iterator. (#8685) 2022-11-04 10:41:46 -07:00