4240 Commits

Author SHA1 Message Date
Evan Tschannen
11d5cae515 do not buggify peek cursor expire time too low because it could cause the log routers to fail to make progress 2021-11-23 15:00:34 -08:00
Andrew Noyes
c6472790e3 Don't require fdb_transaction_get_range_and_flat_map in older clients 2021-11-22 10:49:26 -08:00
Trevor Clinkenbeard
3d0ed2083c
Merge pull request #6000 from sfc-gh-tclinkenbeard/setup-flow-knobs
Setup global flow knobs in `setupNetwork`
2021-11-18 19:30:26 -08:00
Trevor Clinkenbeard
8bbde5185c
Merge pull request #5884 from sfc-gh-tclinkenbeard/add-format-warning
Enable clang -Wformat warning
2021-11-18 19:30:11 -08:00
Renxuan Wang
22e34bd6b9 Replace <boost/bind.hpp> with <boost/bind/bind.hpp>.
This eliminates many useless warnings when compiling.
`#pragma message: The practice of declaring the Bind placeholders (_1, _2, ...) in the global namespace is deprecated. Please use <boost/bind/bind.hpp> + using namespace boost::placeholders, or define BOOST_BIND_GLOBAL_PLACEHOLDERS to retain the current behavior.`
2021-11-18 14:00:13 -08:00
sfc-gh-tclinkenbeard
0532fbfb8b Merge remote-tracking branch 'origin/master' into setup-flow-knobs 2021-11-18 12:09:15 -08:00
sfc-gh-tclinkenbeard
2613ec7561 Expand use of fmt to get rid of %ld usage 2021-11-17 17:03:32 -08:00
sfc-gh-tclinkenbeard
766a05d33c Merge remote-tracking branch 'origin/master' into add-format-warning 2021-11-17 12:14:01 -08:00
Steve Atherton
035e0d6e52
Merge branch 'master' into bit-flipping-workload 2021-11-16 14:42:22 -08:00
sfc-gh-tclinkenbeard
e04526b345 Allow knobs to be set via network options before network is setup 2021-11-16 13:47:37 -08:00
sfc-gh-tclinkenbeard
8ae49c18eb Add assertion to IKnobCollection::setGlobalKnobCollection 2021-11-16 10:41:46 -08:00
Steve Atherton
c53f5aa110 Renamed redwood to redwood-1-experimental and file extension to .redwood-v1. 2021-11-16 02:15:22 -08:00
sfc-gh-tclinkenbeard
deb0eb85e8 Initialize global flow knobs in setupNetwork 2021-11-16 00:41:34 -08:00
Evan Tschannen
964d0209ca
Merge pull request #5637 from sfc-gh-ljoswiak/features/data-loss-prevention
Data loss protection when joining new cluster
2021-11-15 15:26:32 -08:00
Evan Tschannen
a546fb63ea
Merge pull request #5985 from sfc-gh-etschannen/feature-changefeed-empty-versions
Added a whenAtLeast function to change feeds to efficiently learn about empty versions
2021-11-15 10:51:28 -08:00
Markus Pilman
daf6dc22d4
Merge pull request #5959 from mpilman/features/apple-silicon-3
FDB compiles on Apple Sillicon
2021-11-15 11:21:28 -07:00
Vaidas Gasiunas
d7b5f9438a
Merge pull request #5972 from sfc-gh-ajbeamon/fix-client-threads-per-version-option-issues
Fix issues with setting CLIENT_THREADS_PER_VERSION option
2021-11-15 19:04:54 +01:00
Evan Tschannen
94a51e57a5 Merge branch 'master' into feature-changefeed-empty-versions
# Conflicts:
#	fdbclient/StorageServerInterface.h
2021-11-14 19:13:05 -08:00
Evan Tschannen
6909754b21 changefeeds now have a whenAtLeast function for efficiently learning when the version has updated but no mutations have been committed 2021-11-14 19:08:46 -08:00
Tao Lin
9422b8e5f2 Restricted getRangeAndFlatMap to snapshot 2021-11-12 15:12:37 -08:00
Steve Atherton
508429f30d
Redwood chunked file growth and low priority IO starvation prevention (#5936)
* Redwood files now growth in large page chunks controlled by a knob to reduce truncate() calls for expansion.   PriorityMultiLock has limit on consecutive same-priority lock release.  Increased Redwood max priority level to 3 for more separation at higher BTree levels.

* Simulation fix, don't mark certain IO timeout errors as injected unless the simulated process has been set to have an unreliable disk.

* Pager writes now truncate gradually upward, one chunk at a time, in response to writes, which wait on only the necessary truncate operations.   Increased buggified chunk size because truncate can be very slow in simulation.

* In simulation, ioTimeoutError() and ioDegradedOrTimeoutError() will wait until at least the target timeout interval past the point when simulation is sped up.

* PriorityMultiLock::toString() prints more info and is now public.

* Added queued time to PriorityMultiLock.

* Bug fix to handle when speedUpSimulation changes later than the configured time.

* Refactored mutation application in leaf nodes to do fewer comparisons and do in place value updates if the new value is the same size as the old value.

* Renamed updatingInPlace to updatingDeltaTree for clarity.  Inlined switchToLinearMerge() since it is only used in one place.

* Updated extendToCover to be more clear by passing in the old extension future as a parameter.  Fixed initialization warning.
2021-11-12 13:47:07 -08:00
sfc-gh-tclinkenbeard
62efeb6812 Merge remote-tracking branch 'origin/master' into add-format-warning 2021-11-12 11:50:36 -08:00
A.J. Beamon
d129b726e1 Don't use assertion for bad option usage; don't disable local client until setup network is called. 2021-11-12 10:12:49 -08:00
He Liu
9f4a63dacf Adjusted endpoints order to be compatible. 2021-11-11 17:45:08 -08:00
He Liu
984bc0fbea Added Endpoints. 2021-11-11 16:56:04 -08:00
Tao Lin
6dcc7f8ef0
Merge pull request #5955 from nblintao/change-getKeyValuesAndFlatMap-endpoint-order 2021-11-11 09:07:16 -08:00
Josh Slocum
329091e14f Merge branch 'master' into bg_bindings 2021-11-11 10:13:37 -06:00
Josh Slocum
77fa1e701a cleanup 2021-11-11 09:43:23 -06:00
Josh Slocum
b8ac4213a1 Switched BG APIs to transaction instead of database 2021-11-11 08:59:06 -06:00
Markus Pilman
0dfb72176e
Merge pull request #5857 from sfc-gh-vgasiunas/notify-client-lib-changes
A mechanism to notify MVC about relevant client library status changes on the cluster
2021-11-11 07:43:20 -07:00
Markus Pilman
5af465aa29 FDB compiles on Apple Sillicon 2021-11-10 20:05:38 -07:00
Tao Lin
95aa3f9e00 Change SSI endpoints order to be consistent with 7.0 2021-11-10 14:22:06 -08:00
Lukas Joswiak
1da288822f Remove distributed trace database option 2021-11-10 13:33:49 -08:00
Lukas Joswiak
8bc0c3e8a2 Convert distributed trace sampling rate to a database option 2021-11-10 13:33:49 -08:00
Lukas Joswiak
c93052121f Fix issue where transaction spans would not be recorded 2021-11-10 13:33:49 -08:00
Vaidas Gasiunas
51b8ccf7d3 Merge remote-tracking branch 'apple/master' into notify-client-lib-changes 2021-11-10 18:40:34 +01:00
Daniel Smith
394b9dc619 Code review changes 2021-11-10 11:53:27 -05:00
Daniel Smith
f6342b0a8d Update defaults 2021-11-10 11:51:05 -05:00
Daniel Smith
66520eb1c1 Utilize read types to do selective throttling 2021-11-10 11:51:04 -05:00
Vaidas Gasiunas
d6a5cc8460 MVC2.0: Rollback static initialization of the local client API instance 2021-11-10 15:55:33 +01:00
Tao Lin
fdb3b72e35 Introduce GetRangeAndFlatMap to push computations down to FDB
Re-introduce #5609
2021-11-09 13:52:28 -08:00
Pierre Zemb
ca6cce1988
Fix typo in fdb.options (#5938) 2021-11-09 13:05:12 -08:00
Lukas Joswiak
30867750b5 Add protection against storage and tlog data deletion when joining a new cluster 2021-11-09 12:29:47 -08:00
Steve Atherton
d97d968176
Added KeyBackedObjectMap and KeyBackedObjectProperty classes for storing serializable objects in FDB (#5896)
* Cleaned up some lambda capture workaround since x=y captures weren't available when these classes were originally written.

* Added KeyBackedObjectMap and KeyBackObjectProperty, which work like KeyBackedMap and KeyBackedProperty but use ObjectWriter/Reader for Value serialization so that the type can evolve over time.

* Disabled unit tests which shouldn't run as part of random selection.
2021-11-08 13:04:53 -08:00
Vaidas Gasiunas
9408c11c3d MVC2.0: Remove client library status "available" 2021-11-08 18:10:36 +01:00
Vaidas Gasiunas
418cc4dc50 MVC2.0: Notifying clients about deleting or disabling client libraries that have upload or active status;
Declare library status access and change transactions as lock aware
2021-11-08 18:01:58 +01:00
Vaidas Gasiunas
31386c0f03 MVC2.0: Fix refactoring to remove dependency of MVC on Native API 2021-11-08 17:25:43 +01:00
Renxuan Wang
85dff214a4 Address comments. 2021-11-04 11:42:28 -07:00
Renxuan Wang
f15ceb5489 Add Hostname struct, and fromHostname in NetworkAddress struct. 2021-11-04 11:42:28 -07:00
Tao Lin
586cc3b102
Revert "Introduce GetRangeAndFlatMap to push computations down to FDB" 2021-11-04 08:46:56 -07:00