17999 Commits

Author SHA1 Message Date
Daniel Smith
66520eb1c1 Utilize read types to do selective throttling 2021-11-10 11:51:04 -05:00
Steve Atherton
470896bdc4
Redwood inline same-size value updates (#5925)
* Refactored mutation application in leaf nodes to do fewer comparisons and do in place value updates if the new value is the same size as the old value.

* Renamed updatingInPlace to updatingDeltaTree for clarity.  Inlined switchToLinearMerge() since it is only used in one place.
2021-11-10 08:22:57 -08:00
Daniel Smith
ec99d1d888
Merge pull request #5946 from Daniel-B-Smith/cfoptions
Move table factory options to CFOptions
2021-11-10 11:20:41 -05:00
Markus Pilman
a246c1555d
Merge pull request #5931 from sfc-gh-mpilman/features/all-unit-tests-in-ci
Make sure unit tests are run often enough
2021-11-10 08:41:04 -07:00
Josh Slocum
2e5699c6d3 bump protocol version on master to 7.1 2021-11-10 09:38:51 -06:00
Vaidas Gasiunas
d6a5cc8460 MVC2.0: Rollback static initialization of the local client API instance 2021-11-10 15:55:33 +01:00
Tao Lin
3ddd63a940
Merge pull request #5945 from nblintao/index-prefetch-demo 2021-11-09 22:14:00 -08:00
Daniel Smith
8822c589de Move table factory options to CFOptions 2021-11-09 17:29:06 -05:00
Tao Lin
4b2757bf99 Fix memory bug in IndexPrefetchDemo 2021-11-09 13:52:28 -08:00
Tao Lin
fdb3b72e35 Introduce GetRangeAndFlatMap to push computations down to FDB
Re-introduce #5609
2021-11-09 13:52:28 -08:00
Pierre Zemb
ca6cce1988
Fix typo in fdb.options (#5938) 2021-11-09 13:05:12 -08:00
Lukas Joswiak
15e0d5b29f Add explicit transaction options when reading cluster ID 2021-11-09 12:29:49 -08:00
Lukas Joswiak
74cf64fe0f Sync cluster ID through ServerDBInfo 2021-11-09 12:29:48 -08:00
Lukas Joswiak
4640045243 Fix rare simulation failures
When partitions appear before a cluster has fully recovered, it was
possible to have different tlogs persist different cluster IDs because
they were involved in different partitions. This would affect recovery
when a quorum was eventually reached. The solution to this is to avoid
persisting the cluster ID before a cluster has fully recovered, to make
sure all nodes agree on the cluster ID.
2021-11-09 12:29:48 -08:00
Lukas Joswiak
1fa726ca73 Fix compilation issue 2021-11-09 12:29:48 -08:00
Lukas Joswiak
3988b11fd6 Cleanup 2021-11-09 12:29:48 -08:00
Lukas Joswiak
aa3383f0e3 Exclude when joining new cluster 2021-11-09 12:29:48 -08:00
Lukas Joswiak
3e2c65bb11 Allow tlog to join another cluster but retain its data 2021-11-09 12:29:48 -08:00
Lukas Joswiak
30867750b5 Add protection against storage and tlog data deletion when joining a new cluster 2021-11-09 12:29:47 -08:00
negoyal
8fac798ece Fix a memory bug. 2021-11-09 10:32:17 -08:00
Jon Fu
2887e1c30a set flag to true when doing first registration 2021-11-09 12:44:07 -05:00
QA Hoang
6cf0f8121d remove mako temp shared memory file 2021-11-08 17:54:32 -08:00
Ata E Husain Bohra
5e4f25f96d Improve tester actor logging to track workload run & check status
Patch improves logging in "tester.actor" to assist better tracking
of workload run & check status
2021-11-08 16:18:17 -08:00
Markus Pilman
0779512c3b added file to run perf unit tests 2021-11-08 15:54:18 -07:00
Markus Pilman
d6fad2e489 readded old tlog tests 2021-11-08 15:52:08 -07:00
Markus Pilman
648b9c97ab fixed stupid mistake 2021-11-08 15:47:32 -07:00
Markus Pilman
7df059570a Make sure unit tests are run often enough 2021-11-08 15:43:32 -07:00
Steve Atherton
d97d968176
Added KeyBackedObjectMap and KeyBackedObjectProperty classes for storing serializable objects in FDB (#5896)
* Cleaned up some lambda capture workaround since x=y captures weren't available when these classes were originally written.

* Added KeyBackedObjectMap and KeyBackObjectProperty, which work like KeyBackedMap and KeyBackedProperty but use ObjectWriter/Reader for Value serialization so that the type can evolve over time.

* Disabled unit tests which shouldn't run as part of random selection.
2021-11-08 13:04:53 -08:00
Andrew Noyes
b7e393587c Fix a heap use after free
If we accept arena arguments by value, then the lifetime of any memory
allocated by that arena ends when the function returns. Given that we
seem to be appending to VectorRef's passed by pointer this is unlikely
to be what we want.
2021-11-08 12:51:32 -08:00
Jon Fu
00f4bd8536 Check ccInterface against serverDbInfo's cc and make broadcast unconditional for first registration 2021-11-08 12:43:02 -05:00
Vaidas Gasiunas
9408c11c3d MVC2.0: Remove client library status "available" 2021-11-08 18:10:36 +01:00
Vaidas Gasiunas
418cc4dc50 MVC2.0: Notifying clients about deleting or disabling client libraries that have upload or active status;
Declare library status access and change transactions as lock aware
2021-11-08 18:01:58 +01:00
Vaidas Gasiunas
31386c0f03 MVC2.0: Fix refactoring to remove dependency of MVC on Native API 2021-11-08 17:25:43 +01:00
Yao Xiao
86ea63d1da
Add libsanitizer to fdb image. (#5918) 2021-11-04 23:21:54 -07:00
Jon Fu
396cd58b21 cancel ss core and ss actor collection after termination and before context switch 2021-11-04 16:05:23 -04:00
sfc-gh-tclinkenbeard
30cef51746 Improve tracing in ddSnapCreateCore 2021-11-04 12:59:50 -07:00
sfc-gh-tclinkenbeard
e4ca7e9511 Fix comment for RequestStream::tryGetReply 2021-11-04 12:59:50 -07:00
sfc-gh-tclinkenbeard
e08de9e304 Update transaction-tagging.rst documentation 2021-11-04 12:57:50 -07:00
Renxuan Wang
85dff214a4 Address comments. 2021-11-04 11:42:28 -07:00
Renxuan Wang
f15ceb5489 Add Hostname struct, and fromHostname in NetworkAddress struct. 2021-11-04 11:42:28 -07:00
Markus Pilman
67a976b9cd
Merge pull request #5912 from apple/revert-5609-index-prefetch-demo
Revert "Introduce GetRangeAndFlatMap to push computations down to FDB"
2021-11-04 10:31:37 -06:00
Tao Lin
586cc3b102
Revert "Introduce GetRangeAndFlatMap to push computations down to FDB" 2021-11-04 08:46:56 -07:00
Tao Lin
679023ac51
Merge pull request #5609 from nblintao/index-prefetch-demo 2021-11-03 23:07:34 -07:00
Jon Fu
4e8625ccc0 retain old behaviour along with explicit request 2021-11-03 17:23:07 -04:00
Steve Atherton
b1cd4aa96a
Merge pull request #5905 from sfc-gh-satherton/use-xxhash-redwood-flowtransport
Use XXHash in Redwood
2021-11-03 13:54:27 -07:00
Tao Lin
6c98e35893 Rename Hop to FlatMap 2021-11-03 13:32:01 -07:00
Tao Lin
0853661d13 Introduce getRangeAndHop to push computations down to FDB 2021-11-03 13:21:16 -07:00
Jon Fu
59f0a2c3e5 Change dbinfo broadcast to be explicitly requested by the worker registration message 2021-11-03 15:51:21 -04:00
Markus Pilman
ed0558bad9
Merge pull request #5906 from sfc-gh-satherton/xxhash-flowtransport
Change FlowTransport to use 64 bit XXHash instead of CRC32
2021-11-03 12:54:42 -06:00
Steve Atherton
dc3f46c2ae Change asserts to throw internal_error as these function calls should never be compiled out. 2021-11-03 11:00:12 -07:00