apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-01 10:45:56 +08:00
Code Issues Packages Projects Releases Wiki Activity
13,860 Commits 35 Branches 318 Tags
Commit Graph

84 Commits

Author SHA1 Message Date
Evan Tschannen
6496a6d9c8 fix: start move keys will only move destination servers to become source servers if less than destination servers are healthy and the total number of sources is less than 2x the number of destinations 2018-08-31 12:43:14 -07:00
Alex Miller
fb31a6999f Rewrite all files to have #include actorcompiler.h as the last include. 2018-08-14 15:50:26 -07:00
Alex Miller
535b5701e5 Rewrite all Void _ = wait(...) -> wait(...). 
This takes advantage of the new actorcompiler functionality to avoid
having duplicate definitions of `Void _` when trying to feed the
un-actorompiled source through clang.
 2018-08-14 15:50:26 -07:00
A.J. Beamon
3535ddad80
Merge pull request #674 from alexmiller-apple/glibcxx-debug-fixes 
Fix bugs uncovered by -D_GLIBCXX_DEBUG
 2018-08-09 08:18:51 -07:00
Alex Miller
1a7cda4149 Stop performing self-moves. (e.g. a = std::move(a)) 
self-moves are frowned upon in C++, and in our code this generally happens from
calls to swap as part of trying to implement a "unordered erase" function via
swap-to-the-end-and-pop_back.  For convenience, a swapAndPop() function is now
offered that performs this, while disallowing self-moves.
 2018-08-01 18:09:54 -07:00
Evan Tschannen
1c29275672 call all methods which could disable a trace event before it is initialized. In practice this means calling .error first, then .suppressFor, then all your details. 2018-08-01 14:30:57 -07:00
Evan Tschannen
1ccfb3a0f4 fix: log_anti_quorum was always 0 in simulation 
removed durableStorageQuorum, because it is no longer a useful configuration parameter
 2018-06-18 10:24:57 -07:00
Evan Tschannen
372ed67497 Merge branch 'master' into feature-remote-logs 
# Conflicts:
#	fdbserver/DataDistribution.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
 2018-06-11 11:34:10 -07:00
Evan Tschannen
b9826dc1cb fix: do not automatically reduce redundancy we move keys if the database does not have remote replicas. This is to prevent problems when dropping remote replicas from a configuration. 2018-06-08 16:17:27 -07:00
A.J. Beamon
e5488419cc Attempt to normalize trace events: 
* Detail names now all start with an uppercase character and contain no underscores. Ideally these should be head-first camel case, though that was harder to check.
* Type names have the same rules, except they allow one underscore (to support a usage pattern Context_Type). The first character after the underscore is also uppercase.
* Use seconds instead of milliseconds in details.

Added a check when events are logged in simulation that logs a message to stderr if the first two rules above aren't followed.

This probably doesn't address every instance of the above problems, but all of the events I was able to hit in simulation pass the check.
 2018-06-08 11:11:08 -07:00
Evan Tschannen
b423d73b42 fix: do not finish a shard relocation until all of the storage servers have made the current recovery version durable. This is to prevent dropping a needed storage server as a source for a shard after dropping a remote configuration 2018-06-07 12:29:25 -07:00
Evan Tschannen
10d25927cd Merge branch 'master' into feature-remote-logs 
# Conflicts:
#	fdbserver/DataDistribution.actor.cpp
 2018-04-30 22:15:39 -07:00
Evan Tschannen
19762b847d Merge branch 'release-5.2' 
# Conflicts:
#	fdbserver/DatabaseConfiguration.cpp
#	fdbserver/SimulatedCluster.actor.cpp
 2018-04-10 17:02:43 -07:00
Evan Tschannen
b46c32535c surpassed spammy trace events 2018-04-10 15:52:32 -07:00
Evan Tschannen
579ba58930 pop old tags only looks are recovered tags, and checks if they are still being used 2018-03-30 19:08:01 -07:00
Evan Tschannen
8352b93f48 fix: do not reuse tags that are still in historyTags, pop historyTags past epochEnd to allow tlogs to finish recovery 
fix: peekLocal did not properly respect end
fix: the storage server added to the end of the history vector instead of the beginning
 2018-03-30 17:39:45 -07:00
Evan Tschannen
9c8cb445d6 optimized the tlog to use a vector for tags instead of a map 2018-03-17 10:36:19 -07:00
Evan Tschannen
37a6a81634 Merge commit '7f6fc3e039c911cd84b8540f7f799fc38a1c1822' into feature-remote-logs 
# Conflicts:
#	fdbserver/workloads/RestartRecovery.actor.cpp
 2018-02-23 12:33:28 -08:00
Evan Tschannen
2aa273df96 addStorageServer was advancing tags too much because of read errors 2018-02-21 17:05:39 -08:00
Alec Grieser
0bae9880f1 remove trailing whitespace from our copyright headers ; fixed formatting of python setup.py 2018-02-21 10:25:11 -08:00
Evan Tschannen
110309272c fix: do not count a server as read-write unless it has a recent version, because it could have been readable a long time ago 2018-02-14 15:09:19 -08:00
Evan Tschannen
63a9f2aed6 fix: history tags were being incorrectly popped 
fix: history tags were not cleared when a storage server was removed
 2018-02-03 12:20:18 -08:00
Evan Tschannen
ebd94bb654 removed a separately configurable storage team size for the remote data center, because it did not make sense 
fix: the master did not monitor for the failure of remote logs
stop merge attempts when a data center is failed
fixed a variety of other problems with data distribution when a data center is failed
 2018-02-02 11:46:04 -08:00
Evan Tschannen
5ac4f73978 Merge branch 'release-5.1' into feature-remote-logs 
# Conflicts:
#	fdbclient/NativeAPI.actor.cpp
#	fdbrpc/Locality.h
#	fdbrpc/simulator.h
#	fdbserver/ApplyMetadataMutation.h
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/LogSystemPeekCursor.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/SimulatedCluster.actor.cpp
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WorkerInterface.h
#	fdbserver/masterserver.actor.cpp
#	flow/Net2.actor.cpp
#	tests/fast/SidebandWithStatus.txt
#	tests/rare/LargeApiCorrectnessStatus.txt
#	tests/slow/DDBalanceAndRemoveStatus.txt
 2018-01-05 11:33:42 -08:00
Evan Tschannen
1dc9eceb6d optimize GetKeyLocationRequests on the proxy so they only require a single map lookup, instead of doing 3 + (3* [number of ranges]) lookups 2017-12-15 20:13:44 -08:00
Evan Tschannen
15962cf079 Merge branch 'master' into feature-remote-logs 
# Conflicts:
#	fdbrpc/Locality.cpp
#	fdbrpc/Locality.h
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/ClusterRecruitmentInterface.h
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WorkerInterface.h
#	fdbserver/fdbserver.vcxproj.filters
#	fdbserver/masterserver.actor.cpp
#	fdbserver/worker.actor.cpp
#	flow/error_definitions.h
 2017-10-05 17:09:44 -07:00
A.J. Beamon
5063793f36 Revert line ending change 2017-10-04 11:19:19 -07:00
Evan Tschannen
3a2ddcc84a Add destinations that are read-write to the source list, so that cancelled data movement can contribute to copying the data for the next movement. 2017-10-03 17:39:08 -07:00
Evan Tschannen
5f4b997400 emergency teams are bad for performance, because we will route client read requests to servers that do not have the data, therefore getting many wrong shard server errors. emergency teams only protect us from data loss in very rare scenarios, we may want to add them in again in the future, but make sure load balance knows which storage servers used to be destinations so they can only route to them as a last resort. 2017-09-28 13:20:01 -07:00
Evan Tschannen
76e7988663 Merge branch 'master' into feature-remote-logs 
# Conflicts:
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/DataDistribution.actor.cpp
#	fdbserver/OldTLogServer.actor.cpp
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/WorkerInterface.h
#	flow/Net2.actor.cpp
 2017-09-11 15:15:56 -07:00
Evan Tschannen
c22708b6d6 added tag localities 
fix: remote logs need to stop the master when they are stopped
 2017-08-03 16:16:36 -07:00
Yichi Chiang
53e1ae9f60 shard system keyspace 2017-07-26 13:47:31 -07:00
Evan Tschannen
0906250e78 merged everything from feature-remote-logs besides the tlog and tagpartitionedlogsystem 
re-included tags in messages to the tlog
previously never committed the LogRouter
 2017-06-29 15:50:19 -07:00
FDB Dev Team
a674cb4ef4 Initial repository commit 2017-05-25 13:48:44 -07:00