3694 Commits

Author SHA1 Message Date
Kevin King
4059b1f570 [fdbbackup] make hmac_sha1 static 2021-05-10 08:42:37 -07:00
Kevin King
e3114a4656 [fdbbackup] make credentials optional
when blob storage is configured on a private network (such as an AWS
VPC), there isn't a need to specify http auth
2021-05-10 08:42:27 -07:00
Lukas Joswiak
3f6ef14384 Fix OOM 2021-05-07 16:28:39 -07:00
Lukas Joswiak
71ba6f4501 Switch std::function to AsyncTrigger 2021-05-07 16:05:03 -07:00
Lukas Joswiak
0fc1552683 Fix global config updates not triggering on fdbserver processes 2021-05-06 15:46:34 -07:00
Chaoguang Lin
7da5004690 Merge branch 'master' of github.com:apple/foundationdb into refactor-fdbcli 2021-05-06 15:44:26 -07:00
Sreenath Bodagala
336a9bff66 Provide "time since last full recovery" in fdbcli status
Changes:

Schemas.cpp: Extend the JSON schema to include a new field that reports
the number of seconds since last full recovery.

Status.actor.cpp: Extend recoveryStateStatusFetcher() to populate the
new field that has been added to Schemas.cpp.

mr-status-json-schemas.rst.inc: Update the schema to reflect the change
made in Schemas.cpp.
2021-05-05 19:43:44 +00:00
Andrew Noyes
ed464d3514 Deduplicate 2021-05-05 16:30:59 +00:00
Andrew Noyes
946e3f989f Use a deterministic iteration order for committing in the special key space 2021-05-05 16:30:59 +00:00
A.J. Beamon
1537019237
Merge pull request #4729 from sfc-gh-etschannen/feature-bypass-unreadable
Added a new option to bypass unreadable protection in read your writes for calls to get
2021-05-04 11:35:44 -07:00
Evan Tschannen
f5f9de48e7
Update fdbclient/vexillographer/fdb.options
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2021-05-04 09:31:24 -07:00
Evan Tschannen
3175e82393 updated documentation 2021-05-04 09:26:09 -07:00
Lukas Joswiak
e7d7b39f12
Merge pull request #4744 from sfc-gh-tclinkenbeard/add-rangeresult-type-alias
Create RangeResult type alias
2021-05-03 16:29:33 -07:00
sfc-gh-tclinkenbeard
56e719533e Move all Standalone<*Ref> type alias definitions to the same location 2021-05-03 15:47:55 -07:00
Jingyu Zhou
d49e0091ce
Merge pull request #4727 from sfc-gh-etschannen/fix-rewrite-bme
Simulation could still stall writes for 10 seconds even when speedUpSimulation was on
2021-05-03 13:37:04 -07:00
sfc-gh-tclinkenbeard
5c2d7b6080 Create RangeResult type alias 2021-05-03 13:14:16 -07:00
sfc-gh-ngoyal
63d82b9b63
Merge pull request #4616 from sfc-gh-satherton/redwood-improvements
Redwood page splitting/building refactor
2021-05-03 13:07:41 -07:00
Lukas Joswiak
f275fd3c32 Fix gcc compilation 2021-05-02 17:27:18 -07:00
Lukas Joswiak
8dcd779fc4
Merge branch 'master' into features/actor-lineage 2021-05-02 14:11:42 -07:00
Lukas Joswiak
c016e154a7 Remove global config fdbserver fix
This is causing problems with the 5.2.0 restarting test. Removing this
line disables fdbserver processes from receiving global config updates,
instead requiring a restart to see them.
2021-05-02 11:03:07 -07:00
Lukas Joswiak
637699be32 Fix issue with fdbserver not receiving global config change
notifications
2021-05-01 21:41:10 -07:00
Lukas Joswiak
cf4218dfd1 Fixes simulation failures
Fixes the following issues:

1. Use the right index when initializing the WriteOnlySet's vector of
   atomics. Also switch to std::atomic_init to initialize each atomic in
   the vector (cannot default construct the atomics in the vector
   because std::atomic does not have a copy constructor).
2. Add failure check for when items cannot be inserted into the
   WriteOnlySet due to capacity constraints. This situation occurs when
   `copy` is not called on the WriteOnlySet, such as when sampling is
   disabled. The `copy` function is what clears the WriteOnlySet.
3. Remove a global config feature I added to update the ClientDBInfo
   object used by the global config listener function. This needs more
   investigation, but the effect of this change could be that global
   config changes are not correctly recognized on fdbserver processes.
4. Add various ASSERTs to verify data in WriteOnlySet.
2021-05-01 15:26:28 -07:00
A.J. Beamon
e6300905d6
Merge pull request #4733 from sfc-gh-ajbeamon/fix-mvc-thread-future-cancellation
Fix: explicitly cancel MVC thread futures for version monitors
2021-04-30 16:05:17 -07:00
sbodagala
f7e28c50d4
Merge pull request #4735 from sbodagala/master
Expose CommitBatchingWindowSize metric to fdbcli status
2021-04-30 15:52:29 -04:00
sfc-gh-tclinkenbeard
c7d5bbd2e0 Make ThreadSafeTransaction implementation less verbose 2021-04-30 12:05:58 -07:00
A.J. Beamon
ab3f96f16d Fix: simulation doesn't have a protocol version monitor and can't cancel it. 2021-04-30 11:56:35 -07:00
sfc-gh-tclinkenbeard
ec58f0f0cf Improve const-correctness of ISingleThreadTransaction 2021-04-30 11:32:53 -07:00
A.J. Beamon
eaf1e0f64e Be more defensive with cancellation by not capturing the this pointer in lambdas, instead capturing a full Reference. 2021-04-30 11:11:02 -07:00
A.J. Beamon
cb3d2bfec7 Add cancellation of the protocol monitor when the database is destroyed. Avoid using any state when cancelled. Fix race between setting up the protocol version monitor and destroying the database. 2021-04-30 10:35:44 -07:00
Renxuan Wang
652c5c4e84
Merge pull request #4668 from RenxuanW/worker
Improve logging on worker joining cluster
2021-04-30 10:24:02 -07:00
sfc-gh-tclinkenbeard
d20c3f7897 Mark methods as invalid in SimpleConfigTransaction.h 2021-04-30 09:55:38 -07:00
sfc-gh-tclinkenbeard
91f6f82cd8 Implement SimpleConfigTransaction::getCommittedVersion 2021-04-30 09:43:18 -07:00
sfc-gh-tclinkenbeard
a3891a9246 Make SimpleConfigTransaction an implementation of ISingleThreadTransaction 2021-04-30 09:34:36 -07:00
sfc-gh-tclinkenbeard
0d9eaa5d6d Add ISingleThreadTransaction.h 2021-04-29 22:31:16 -07:00
A.J. Beamon
f61f13a0ba Explicitly cancel thread futures for the protocol version monitors in MVC 2021-04-29 22:02:38 -07:00
Steve Atherton
fbd59d310a
Merge pull request #4725 from RenxuanW/firstConsistentVersion-fix
Fix the logic of getting firstConsistentVersion.
2021-04-29 18:04:57 -07:00
RenxuanW
5e045bd21c Move the read of logsOnly and inconsistentSnapshotOnly to a loop where other RestoreConfig vars are fetched. 2021-04-29 17:00:34 -07:00
sfc-gh-tclinkenbeard
4d3a7ceb44 Added simple DynamicKnobsWorkload 2021-04-29 16:32:30 -07:00
Sreenath Bodagala
f151df3203 Expose CommitBatchingWindowSize metric to fdbcli status
Changes:

Schemas.cpp:
- Extend JSON schema to include aggregated information about
CommitBatchingWindowSize samples.

Status.actor.cpp:
- Extend getStorageServersAndMetrics() to gather metrics about
CommitBatchingWindowSize.
- Extend CommitProxy AddRole() to populate the status-JSON object
with the metrics about CommitBatchingWindowSize.
2021-04-29 22:11:09 +00:00
RenxuanW
44197644be Reset transaction after a commit and before start a read. 2021-04-29 12:19:58 -07:00
Chaoguang Lin
283b774c2f Merge branch 'master' of github.com:apple/foundationdb into refactor-fdbcli 2021-04-29 12:04:54 -07:00
Evan Tschannen
709df795c0 Added a new option to bypass unreadable protection in read your writes for calls to get 2021-04-28 16:22:34 -07:00
Lukas Joswiak
539a419f29
Merge pull request #19 from sfc-gh-mpilman/features/actor-lineage-fluentd
fix special keyspace register
2021-04-28 15:43:51 -07:00
Lukas Joswiak
045d20ab7a Check validity of ActorLineage 2021-04-28 15:40:13 -07:00
Markus Pilman
f513543305 fix special keyspace register 2021-04-28 16:35:09 -06:00
Markus Pilman
b256c6822d add default constructor to Sample 2021-04-28 15:44:06 -06:00
Andrew Noyes
904a39e473
Merge pull request #4667 from sfc-gh-ajbeamon/feature-mvc-monitor-protocol-version
Use fewer connections in the multi-version client
2021-04-28 14:13:17 -07:00
Markus Pilman
32ee206675 delete copy constructor of Sample 2021-04-28 14:11:09 -06:00
Markus Pilman
d946e90d75 Use new Sample interface 2021-04-28 14:10:45 -06:00
Evan Tschannen
65fcf4014e Fix: simulation could still stall writes for 10 seconds even when speedUpSimulation was on
Fix: disable connection failures in simulation when there are too many generations outstanding
2021-04-28 12:41:48 -07:00