apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-02 19:25:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
27,311 Commits 35 Branches 318 Tags
Commit Graph

3749 Commits

Author SHA1 Message Date
Zhe Wang
74990e44bd
Bulk Loading Framework (#11369) 2024-07-23 14:57:28 -07:00
Xiaoge Su
92ad7666c3 fixup! Reformat source 2024-07-23 09:52:49 -07:00
Xiaoge Su
9f15c57b26 Add peer address when TLS policy failed 
See #5854
 2024-07-23 09:52:49 -07:00
Xiaoge Su
e683076ff5 fixup! Reformat source 2024-07-23 09:52:49 -07:00
Xiaoge Su
bb29465713 fixup! Remove unused is_client flag 2024-07-23 09:52:49 -07:00
Xiaoge Su
390e88c0ae fixup! Address issues per comment 
Also try to introduce [[unlikely]] to ASSERT, this is related to issue #11422
 2024-07-23 09:52:49 -07:00
Xiaoge Su
4b70993d89 Better TraceEvent output for TLS failures 
This patch adds more output about TLS failures, e.g.

<Event Severity="20" Time="1716265824.713579" DateTime="2024-05-21T04:30:24Z" Type="TLSPolicyFailure" ID="0000000000000000" SuppressedEventCount="0" Reason="Rule.Cert.Issuer" Rule="Rule{ verify_cert=1, verify_time=1, Subject=[ ], Issuer=[ ], Root=[ ] }" ThreadID="7547317051334743152" LogGroup="default" />

The failure data will include the rule, the reason of failure and the
value of corresponding fields.
 2024-07-23 09:52:49 -07:00
Yao Xiao
c630fa2296
Fix wait (#11474) 2024-07-18 11:28:34 -07:00
Xiaoge Su
cf70d45e6d Add PeerAddress to all PeerAddr/Peer TraceEvent 
This is to address #4846
 2024-07-09 16:49:22 -07:00
Sreenath Bodagala
d7eb028b2a
Enable replica consistency check on data movement (#11415) 
* - Enable replica consistency check on data movement (and, randomly, on
all reads)

* - Address PR review comments
 2024-06-17 17:07:32 -04:00
Xiaoge Su
20fddc8eb4 fixup! Reformat source 2024-06-17 11:41:06 -07:00
Xiaoge Su
afc04366fb Rewrite BUGGIFY related code 
This is a rewrite of BUGGIFY function/macros. Seems the performance
improved a lot during the simulation, e.g.

fdbserver -r simulation -b on -f ../CycleTest.toml -s 99438

Without this patch:

Unseed: 54646
Elapsed: 494.091327 simsec, 14.586831 real seconds

With this patch:

Unseed: 54646
Elapsed: 494.091327 simsec, 12.580612 real seconds

I expected the improvement but did not expect a ~13% improvement.
 2024-06-17 11:41:06 -07:00
dependabot[bot]
a3c1f44c7f
Bump jinja2 from 3.1.3 to 3.1.4 in /flow/protocolversion 
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.1.3...3.1.4)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-06 21:00:43 +00:00
Sreenath Bodagala
df2b7b4fe8 - Address PR review comments 2024-05-01 19:41:00 +00:00
Sreenath Bodagala
d6f6b45125 - Handle errors thrown during replica consistency check 2024-04-30 21:37:50 +00:00
Sreenath Bodagala
bd68263558 - Disabe replica consistency check related knob 2024-04-22 21:53:28 +00:00
Sreenath Bodagala
a4430b9169
Compare storage replicas on reads (#11235) 
* - Compare storage replicas on reads (in "loadBalance()")

* - Do consistency check on reads in loadbalance

* - Do replica consistency check in the case where loadBalance issues
requests to multiple storage servers

* - Address a state variable related bug

* - Code formatting

* - API simplification

* - Simplify code

* - Code formatting

* - Address a review comment
 2024-04-11 16:08:54 -04:00
Zhe Wang
308ff77e91
Consistency Check Urgent (Cherrypick from Release-7.1) (#11217) 
* cherry-pick-distributed-consistency-checker

* code cleanup

* refactor code, decouple consistencyCheckerUrgent and consistency checker

* fix workload for consistencycheckurgent

* add new consistencycheckurgent role type

* fix CI

* address comments
 2024-02-28 14:22:47 -08:00
Hao Fu
8555ac9b71
Implement checksum via LRU-like approach to save space (#11194) 2024-02-21 12:24:51 +08:00
Johannes M. Scheuermann
0370cc08e1 Add knob to allow fdbserver to abort under abnormal behaviour 2024-02-14 10:15:14 +01:00
Johannes Scheuermann
88905b1f16 Update link to abort function 2024-02-14 10:15:08 +01:00
Johannes M. Scheuermann
0f8a9cde4e Abort process when abnormal shutdown is initiated to allow coredumps to be generated 2024-02-14 10:15:01 +01:00
Boris Korzun
f7a443aea4 Add libfmt 10+ support (#11140) 2024-02-13 23:09:58 +03:00
He Liu
9d8d52cbb7
Added checksum in MutationRef (#11181) 
* Append checksum to param2.

* Pass sim tests w/o validating checksums.

* Code cleanup.

* Renew checksum.

* Remove checksum for all private mutations.

* Added checksum validation at SS.

* Fixed VERSION_TIMESTAMP.

* Disable Mutation Checksum by default.

* Cleanup.

* cleanup.
 2024-02-09 13:36:41 -08:00
Dimitris Apostolou
a88114c222
Fix typos 2024-02-07 01:16:00 +02:00
Johannes M. Scheuermann
b2b3a8e791 Fix complie issue for ALLOC_INSTRUMENTATION 2024-02-01 14:48:04 +01:00
dependabot[bot]
d08d0fc549
Bump jinja2 from 3.1.2 to 3.1.3 in /flow/protocolversion 
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.2 to 3.1.3.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.1.2...3.1.3)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-30 17:03:41 +00:00
mavenraven
2bfff79fd3 Adds support for running protocol_version.py in an virtual env, similar to Sphinx. 2024-01-27 17:19:33 -05:00
Yao Xiao
2329e8327a
Add log cleaner for rocksdb logs. (#11134) 
Co-authored-by: yaoxiao-github <yaoxiao@Yaos-MacBook-Pro-14.local>
 2024-01-17 14:51:15 -08:00
Markus Pilman
a2bb520847 Fix cancellation bug in Choose class 2023-12-08 17:46:21 +01:00
Markus Pilman
fd4a300d4c Address review comments and fix serious bug 2023-11-17 11:08:34 +01:00
Markus Pilman
afce7b35bf add concatenateStrings and remove onWorkerThread from mock network 2023-11-14 10:57:38 +01:00
Markus Pilman
f85ed2ac14 Removed ranges stuff to support old compilers. Added new _swiftEnqueue to test network impl 2023-11-14 10:22:13 +01:00
Markus Pilman
e07b3e35ca Added C++ Coroutine support to Flow 2023-11-14 10:10:11 +01:00
Dan Lambright
015167c17e
Throttle commits against hot shards (#10970) 
* throttle hot shards

* expire throttled shards over time

* add backoff

* Parallelize messaging from RK to CP

* Obtain shards from a single SS

* handle expired transactions

* bump transaction_throttled_hot_shard

* Change SevError to SevWarn for CannotMonitorHotShardForSS

* Add log per request
 2023-10-31 12:01:34 -04:00
Boris Korzun
122852b42f flow: add FreeBSD support 2023-10-05 18:11:37 +03:00
Jingyu Zhou
35ab0b3e10
Merge pull request #10523 from xis19/actor 
Store the call stack of ACTORs
 2023-09-26 21:05:54 -07:00
Xiaoge Su
ba264a26cc Add a function to dump the actor call backtrace to stdout 2023-09-26 18:03:05 -07:00
Jingyu Zhou
40e219641b
Merge pull request #10686 from hyp/eng/ProtocolVersion 
[swift] make sure flow_swift depends on ProtocolVersion
 2023-09-25 11:22:44 -07:00
Xiaoge Su
b5e40c5598 fixup! Update per review 2023-09-21 14:55:56 -07:00
Andrew Noyes
c09a06fff8
Implement Event using std::latch (#10705) 2023-09-21 14:01:54 -07:00
Xiaoge Su
37d03bfc13 fixup! Fix the OPEN_FOR_IDE build 2023-09-20 14:12:23 -07:00
Xiaoge Su
91ec1fdf10 Provide actor call backtrace 
See design/AcAC.md
 2023-09-19 20:58:33 -07:00
Adonis Ling
46c837830d
Fix missing jemalloc header errors (#10849) 2023-08-31 13:34:06 -05:00
Egor Zhdan
3428d4678c
[swift] Remove deprecated Swift attr spelling: import_as_ref (#10825) 
This spelling is deprecated and will be removed in the future version of Swift:
```
__attribute__((swift_attr("import_as_ref")))
```

The new correct spelling is:
```
__attribute__((swift_attr("import_reference")))
```
 2023-08-31 13:23:23 -05:00
Yi Wu
8d7f2e84ed
Merge pull request #10831 from sfc-gh-yiwu/ear_timeout 
EaR: Handle KMS timeout in storage server and commit proxy
 2023-08-28 20:59:22 -07:00
Zhe Wang
432c077b51
fix dd issue when dd skip audit (#10844) 2023-08-28 16:39:45 -07:00
Yi Wu
3287098b4a EaR: Handle KMS timeout in storage server and commit proxy 2023-08-28 16:17:43 -07:00
Jingyu Zhou
b5f5c8e469 Fix picking of IPv4 addresses 2023-08-24 12:18:55 -07:00
Jingyu Zhou
7e54174725 Add a knob RESOLVE_PREFER_IPV4_ADDR to prefer IPv4 addresses 
The default is to prefer IPv6 addresses.
 2023-08-23 14:54:07 -07:00