20247 Commits

Author SHA1 Message Date
Markus Pilman
f38b2e8209
Revert "Update 'salt' details for EncryptHeader AuthToken details (#6881)" (#6902)
This reverts commit a38318a6acc1ef71ebcc5ea4af6bb2ea0edf0887.
2022-04-21 09:04:40 -07:00
Josh Slocum
d26db64f08 only adding bg_url knob to local cluster config if blob granules enabled 2022-04-21 10:47:36 -05:00
LukasMol
b7e9cab0a7 made python files inside TestRunner more pythonic 2022-04-21 16:24:51 +02:00
Markus Pilman
bbb1392aad Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-21 08:24:18 -06:00
Junhyun Shim
aefe20e362
Merge pull request #6915 from sfc-gh-vgasiunas/vgasiunas-upgrade-tests-log-dump
Upgrade Tests: Dump entire log in case of errors
2022-04-21 16:02:00 +02:00
Junhyun Shim
c27635f607 Apply changes made to mako.c in main branch 2022-04-21 13:53:28 +02:00
Vaidas Gasiunas
abbc047e5f Upgrade Tests: Dump entire log in case of errors 2022-04-21 10:12:25 +02:00
Junhyun Shim
7304c337f8 Aggressive inlining 2022-04-21 08:32:12 +02:00
Xiaoxi Wang
2fd640b0d0 fix doc compilation 2022-04-20 21:27:22 -07:00
Xiaoxi Wang
5d5dae9a0c update release note 2022-04-20 21:27:22 -07:00
Markus Pilman
85757eb47c
Update flow/Trace.cpp 2022-04-20 15:30:42 -06:00
Ivan Goncharov
a2a7b959a5 Update bindings/c/CMakeLists.txt
Co-authored-by: Andrew Noyes <andrew.noyes@snowflake.com>
2022-04-20 15:56:18 -05:00
imorph
7a46d8b9cd Add new c libs to client package
Fixes: #6822
2022-04-20 15:56:18 -05:00
Renxuan Wang
e40cc8722c
A few hostname improvements. (#6825)
* Add tryResolveHostnames() in connection string.

* Add missing hostname to related interfaces.

* Do not pass RequestStream into *GetReplyFromHostname() functions.

Because we are using new RequestStream for each request anyways. Also, the passed in pointer could be nullptr, which results in seg faults.

* Add dynamic hostname resolve and reconnect intervals.

* Address comments.
2022-04-20 13:42:46 -07:00
Josh Slocum
3c036300cc Addressing review comments 2022-04-20 14:34:19 -05:00
Markus Pilman
3335b2686e
Merge branch 'main' into features/validate-trace-events-in-simulation 2022-04-20 12:03:33 -06:00
Markus Pilman
f7a8ebf818
Update flow/Trace.cpp
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-04-20 11:55:01 -06:00
Junhyun Shim
3f9f781226 Fix typo 2022-04-20 19:41:07 +02:00
Binglin Chang
408c0cf1c9
Fix compile errors on ubuntu 20.04 (#4931) 2022-04-20 10:00:46 -07:00
Bharadwaj V.R
8a0ce5bfc7 Rename isInvalidMagic and fix formatting 2022-04-20 09:17:28 -07:00
Bharadwaj V.R
96ab7c0254
Update fdbserver/Status.actor.cpp
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
2022-04-20 08:52:14 -07:00
Bharadwaj V.R
a2449041ea Fix formatting of ProtocolVersion.h 2022-04-20 08:45:53 -07:00
Bharadwaj V.R
4d6f4ecd9c
Merge branch 'main' into dbcorever 2022-04-20 08:23:34 -07:00
Josh Slocum
40052c1394 Added Blob Granule API Tester 2022-04-20 10:15:43 -05:00
Josh Slocum
8fa25aa013 Adding blob granule client test target and local cluster setup 2022-04-20 10:15:43 -05:00
Junhyun Shim
b7e493f030 Simplify string generation 2022-04-20 16:27:21 +02:00
Ray Jenkins
5df3bac110
Migrate to OpenTelemetry tracing. (#6855) 2022-04-20 09:26:37 -05:00
Bharadwaj V.R
a711c55061
Merge branch 'apple:main' into dbcorever 2022-04-20 06:16:27 -07:00
Bharadwaj V.R
89af5561f1
Merge branch 'apple:main' into block-down 2022-04-20 06:13:01 -07:00
Junhyun Shim
d202d482d9 Preserve key string generation behavior of mako.c 2022-04-20 14:16:06 +02:00
Junhyun Shim
50dcde0ca5 fmt::format for key string generation is slow 2022-04-20 10:27:57 +02:00
Markus Pilman
d4ee7be1d7 Reduce excessive tracing and fail after 1M traces 2022-04-19 21:11:51 -06:00
Junhyun Shim
278009e1c8 Let OP_TRANSACTION to measure one iteration of '-x' 2022-04-20 04:45:29 +02:00
Evan Tschannen
442d2b34c7
fix: pops which were ignored during a snapshot would not be replayed on the proper tlogs within a shared tlog (#6892) 2022-04-19 16:57:41 -07:00
Chaoguang Lin
6bfa4f6ac4 Fix typos; Polish documentations according to comments 2022-04-19 13:57:11 -07:00
Andrew Noyes
297d831192
Put guard pages next to fast alloc memory (#6885)
* Put guard pages next to fast alloc memory

I verified that we can now detect #6753 without creating tons of
threads.

* Use pageSize instead of 4096

* Don't include mmapInternal for windows
2022-04-19 11:22:35 -07:00
Bharadwaj V.R
51ef860612
Merge branch 'apple:main' into block-down 2022-04-19 10:16:56 -07:00
Vaidas Gasiunas
eedac50bb5
Merge pull request #6888 from sfc-gh-vgasiunas/vgasiunas-upgrade-test-72
Regression tests for upgrades to 7.2
2022-04-19 17:42:01 +02:00
Junhyun Shim
0cf1349c37 Optimizations and restructuring 2022-04-19 16:34:11 +02:00
Vaidas Gasiunas
3372b3a6eb Upgrade Tests: Check logs for warnings and dump them 2022-04-19 13:37:21 +02:00
Vaidas Gasiunas
79b2ebeb4b Upgrade Tests: Test upgrade from 7.0 to 7.2 2022-04-19 11:53:33 +02:00
Vaidas Gasiunas
43b3ac23f8
Merge pull request #6876 from sfc-gh-ljoswiak/fixes/upgrade-tests-arm-support
Disable end-to-end upgrade tests for non-x86_64 platforms
2022-04-19 10:55:35 +02:00
Ata E Husain Bohra
a38318a6ac
Update 'salt' details for EncryptHeader AuthToken details (#6881)
* Update 'salt' details for EncryptHeader AuthToken details

Description

Major changes:
1. Add 'salt' to BlobCipherEncryptHeader::cipherHeaderDetails.
2. During decryption it is possible that BlobKeyCacheId doesn't
    contain required baseCipherDetails. Add API to KeyCache to
    allowing re-populating of CipherDetails with a given 'salt'
3. Update BaseCipherKeyIdCache indexing using {BaseCipherKeyId, salt}
    tuple. FDB processes leverage BlobCipherKeyCache to implement
    in-memory caching of cipherKeys, given EncryptKeyProxy supplies
    BaseCipher details, each encryption participant service would
    generate its derived key by using different 'salt'. Further,
    it is possible to cache multiple {baseCipherKeyId, salt} tuples;
    for instance: CP encrypted mutations being deciphered by
    StorageServer etc.

Testing

1. Update EncyrptionOps simulation test to simulate KeyCache miss
2. Update BlobCipher unit tests to validate above mentioned changes
2022-04-18 22:01:56 -07:00
Jingyu Zhou
8003f4207f
Merge pull request #6843 from sbodagala/main
Do not invoke version vector related code when the feature is disabled
2022-04-18 21:35:23 -07:00
Xiaoxi Wang
7c643369c3 Merge branch 'main' of https://github.com/apple/foundationdb 2022-04-18 21:24:19 -07:00
Chaoguang Lin
36c876b769 Fix a typo; Fix a format error in special-keys.rst 2022-04-18 18:10:17 -07:00
Chaoguang Lin
4af36fa9ea Update documentations 2022-04-18 17:59:28 -07:00
Chaoguang Lin
c0264a8522 Remove the client profiling special keys and update related documentations 2022-04-18 17:54:50 -07:00
Ray Jenkins
d45d6f9f1f
Merge pull request #6882 from sfc-gh-rjenkins/typo-client-testing
Fix typo, expose a function...
2022-04-18 16:43:42 -05:00
Sreenath Bodagala
abd3d5a3d7 Merge remote-tracking branch 'apple-upstream/main' 2022-04-18 20:55:16 +00:00