apple/foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2025-06-02 11:15:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,108 Commits 35 Branches 318 Tags
Commit Graph

6108 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
sramamoorthy
869f77aef1 Few cosmetic edits and fixes 2019-07-24 15:36:28 -07:00
sramamoorthy
30a90e546d make snap v2 the default version 2019-07-24 15:36:28 -07:00
sramamoorthy
ddd4523816 bug fix in timeout & header file re-arrange in DD 2019-07-24 15:36:28 -07:00
sramamoorthy
c18558cf55 enable DD mode in restore based on test spec 2019-07-24 15:36:28 -07:00
sramamoorthy
0598779a40 snap create timeout for client call 2019-07-24 15:36:28 -07:00
sramamoorthy
31c010b393 few minor fixes 2019-07-24 15:36:28 -07:00
sramamoorthy
24cbe313a1 Snap*Restart in ver 2 and buggify off in restore 2019-07-24 15:36:28 -07:00
sramamoorthy
ec9af66fc5 timeout snapshotdatabase call 2019-07-24 15:36:28 -07:00
sramamoorthy
33c2801944 adjut versions to handle KCV > recoveryVersion 2019-07-24 15:36:28 -07:00
sramamoorthy
62c14dae72 disable dd during snap and enable in restore 2019-07-24 15:36:28 -07:00
sramamoorthy
c73bdfad9f do not pop txsTag 2019-07-24 15:36:28 -07:00
sramamoorthy
a335ed2011 includeCancelled for tLogSnapCreate 2019-07-24 15:36:28 -07:00
sramamoorthy
080b3da322 includeCancelled for workerSnapCreate 2019-07-24 15:36:28 -07:00
sramamoorthy
61cd690add enable/disable pop req with UID mis-match to fail 2019-07-24 15:36:28 -07:00
sramamoorthy
d90b678f6f storage worker to throw in case of failures 2019-07-24 15:36:28 -07:00
sramamoorthy
95d6807740 tryGetReply instead of getReply for ddSnapReq 2019-07-24 15:36:28 -07:00
sramamoorthy
806a0822f1 timeoutError that takes Future<Error<T>> as input 2019-07-24 15:36:28 -07:00
sramamoorthy
7ec8fe6e74 snap v2: implement get only local storage workers 2019-07-24 15:36:28 -07:00
sramamoorthy
671c98fa3d snap v2: test files changes 2019-07-24 15:36:28 -07:00
sramamoorthy
a954cf4e06 snap v2: restore related changes for the simulator 2019-07-24 15:36:28 -07:00
sramamoorthy
7e04e3c8be snap v2: knobs for max snap create timeout 2019-07-24 15:36:28 -07:00
sramamoorthy
8f1f0c0435 snap v2: worker and other helper related changes 2019-07-24 15:36:28 -07:00
sramamoorthy
f4e257e464 snap v2: TLog related changes 2019-07-24 15:36:28 -07:00
sramamoorthy
ba6bccce73 snap v2: DD changes - snapshot orchestration logic 2019-07-24 15:36:28 -07:00
sramamoorthy
d0793f5ca2 snap v2: master proxy related changes 2019-07-24 15:36:28 -07:00
sramamoorthy
209448807d snap v2: fdbclient related changes 2019-07-24 15:36:28 -07:00
Evan Tschannen
83f4b8ebb1
Merge pull request #1866 from senthil-ram/setDDBugFix 
setDDMode should set moveKeysLockWriteKey
 2019-07-24 15:35:18 -07:00
mpilman
a6c670dd19 Added release notes for my merged PRs 2019-07-23 15:32:55 -07:00
Andrew Noyes
8cfc6fd828 Add release notes for already-merged PRs 2019-07-23 15:31:44 -07:00
Andrew Noyes
3d2f35eec6 Fix a cmake typo 
This allows a few more files to get type checked during an OPEN_FOR_IDE
build
 2019-07-23 15:12:47 -07:00
Vishesh Yadav
c4d1e16ab5
Merge pull request #1873 from atn34/uninitialized-memory 
Fix uninitialized memory
 2019-07-23 10:36:01 -07:00
Jingyu Zhou
b10591ce7a
Merge pull request #1877 from tclinken/release-notes-6.2-tclinken 
Added release notes for changes in 6.2
 2019-07-23 10:13:35 -07:00
Jingyu Zhou
16840453d6
Merge pull request #1876 from xumengpanda/mengxu/6.2-release-meng-PR 
Add release notes for DD related changes in 6.2
 2019-07-23 10:11:11 -07:00
A.J. Beamon
6e078a41a7
Merge pull request #1828 from mpilman/features/lexicographical-ordered-traces 
Make trace files lexicographically ordered
 2019-07-23 08:31:59 -07:00
A.J. Beamon
e98cee016d Fix unsafe usage of now() function from multiple threads in trace logging. 2019-07-22 22:31:38 -07:00
Andrew Noyes
5cef65b6c4
Update flow/FileTraceLogWriter.cpp 
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
 2019-07-22 16:38:18 -07:00
Meng Xu
f003613847 Add release notes for Meng Xu changes in 6.2 2019-07-22 16:34:49 -07:00
mpilman
de4fe4d640 Remove dead code and revert back to base 10 
there can be at most 2^32 files with a distinct index. Therefore
`log10(index) < 10` - this means base 10 is good enough.
 2019-07-22 16:20:03 -07:00
Trevor Clinkenbeard
e3a564e1a7 Added release notes for Trevor Clinkenbeard changes in 6.2 2019-07-22 14:23:46 -07:00
mpilman
aa93f8411a Merge branch 'features/lexicographical-ordered-traces' of github.com:mpilman/foundationdb into features/lexicographical-ordered-traces 2019-07-22 14:22:51 -07:00
Markus Pilman
a57cd7e688
Update documentation/sphinx/source/release-notes.rst 
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
 2019-07-22 14:20:33 -07:00
mpilman
001bfaf80c made trace index unsigned 2019-07-22 14:20:09 -07:00
Markus Pilman
a48bdc0095
Update flow/FileTraceLogWriter.cpp 
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
 2019-07-22 14:16:34 -07:00
Andrew Noyes
1968db17e3 Initialize in default constructor for GetReadVersionReply 
==10473== Uninitialised byte(s) found during client check request
==10473==    at 0x1BA9ACE: sendPacket(TransportData*, ISerializeSource const&, Endpoint const&, bool, bool) (FlowTransport.actor.cpp:1252)
==10473==    by 0x877C05: (anonymous namespace)::NetworkSenderActorState<GetReadVersionReply, (anonymous namespace)::NetworkSenderActor<GetReadVersionReply> >::a_body1cont2(GetReadVersionReply const&, int) [clone .isra.0] (networksender.actor
.h:40)
==10473==    by 0x877CC6: a_body1when1 (networksender.actor.g.h:147)
==10473==    by 0x877CC6: a_callback_fire (networksender.actor.g.h:161)
==10473==    by 0x877CC6: ActorCallback<(anonymous namespace)::NetworkSenderActor<GetReadVersionReply>, 0, GetReadVersionReply>::fire(GetReadVersionReply const&) (flow.h:894)
==10473==    by 0xC343A7: send<GetReadVersionReply&> (flow.h:343)
==10473==    by 0xC343A7: send<GetReadVersionReply&> (fdbrpc.h:124)
==10473==    by 0xC343A7: (anonymous namespace)::ForwardProxyActorState<(anonymous namespace)::ForwardProxyActor>::a_body1loopBody1when2(ReplyPromise<GetReadVersionReply> const&, int) (MasterProxyServer.actor.cpp:1814)
==10473==    by 0xC33C10: (anonymous namespace)::ForwardProxyActorState<(anonymous namespace)::ForwardProxyActor>::a_body1loopBody1(int) (MasterProxyServer.actor.g.cpp:8167)
==10473==    by 0xC35434: a_body1loopHead1 (MasterProxyServer.actor.g.cpp:8152)
==10473==    by 0xC35434: a_body1loopBody1cont2 (MasterProxyServer.actor.g.cpp:8327)
==10473==    by 0xC35434: a_body1loopBody1cont1when1 (MasterProxyServer.actor.g.cpp:8333)
==10473==    by 0xC35434: a_body1loopBody1cont1when1 (MasterProxyServer.actor.g.cpp:8331)
==10473==    by 0xC35434: a_callback_fire (MasterProxyServer.actor.g.cpp:8347)
==10473==    by 0xC35434: ActorCallback<(anonymous namespace)::ForwardProxyActor, 3, Void>::fire(Void const&) (flow.h:894)
==10473==    by 0x7E7BE7: SAV<Void>::finishSendAndDelPromiseRef() (flow.h:375)
==10473==    by 0x8319FD: a_body1when1 (genericactors.actor.g.h:10892)
==10473==    by 0x8319FD: a_callback_fire (genericactors.actor.g.h:10920)
==10473==    by 0x8319FD: ActorCallback<(anonymous namespace)::ChooseActorActor<Void>, 0, Void>::fire(Void const&) (flow.h:894)
==10473==    by 0x891917: void SAV<Void>::send<Void>(Void&&) (flow.h:343)
==10473==    by 0x1C47ADC: send<Void> (flow.h:674)
==10473==    by 0x1C47ADC: execTask (sim2.actor.cpp:1632)
==10473==    by 0x1C47ADC: Sim2::RunLoopActorState<Sim2::RunLoopActor>::a_body1loopBody1cont1(Void const&, int) (sim2.actor.cpp:975)
==10473==    by 0x1C47FF2: a_body1loopBody1when1 (sim2.actor.g.cpp:5092)
==10473==    by 0x1C47FF2: Sim2::RunLoopActorState<Sim2::RunLoopActor>::a_body1loopBody1(int) (sim2.actor.g.cpp:5037)
==10473==    by 0x1C47A6C: a_body1loopHead1 (sim2.actor.g.cpp:5020)
==10473==    by 0x1C47A6C: Sim2::RunLoopActorState<Sim2::RunLoopActor>::a_body1loopBody1cont1(Void const&, int) (sim2.actor.g.cpp:5086)
==10473==  Address 0x12db1ba1 is 2,977 bytes inside a recently re-allocated block of size 4,096 alloc'd
==10473==    at 0x1CC5D7F: FastAllocator<4096>::allocate() (FastAlloc.cpp:290)
==10473==    by 0x1CFAA68: operator new (FastAlloc.h:193)
==10473==    by 0x1CFAA68: PacketWriter::nextBuffer() (Net2Packet.cpp:59)
==10473==    by 0x1CFABD6: PacketWriter::writeAhead(int, SplitBuffer*) (Net2Packet.cpp:81)
==10473==    by 0x1BA97EB: sendPacket(TransportData*, ISerializeSource const&, Endpoint const&, bool, bool) (FlowTransport.actor.cpp:1199)
==10473==    by 0x7DEAD1: a_body1cont2 (networksender.actor.h:40)
==10473==    by 0x7DEAD1: a_body1when1 (networksender.actor.g.h:147)
==10473==    by 0x7DEAD1: a_callback_fire (networksender.actor.g.h:161)
==10473==    by 0x7DEAD1: ActorCallback<(anonymous namespace)::NetworkSenderActor<GetValueReply>, 0, GetValueReply>::fire(GetValueReply const&) (flow.h:894)
==10473==    by 0xF22767: send<GetValueReply&> (flow.h:343)
==10473==    by 0xF22767: send<GetValueReply&> (fdbrpc.h:124)
==10473==    by 0xF22767: (anonymous namespace)::GetValueQActorState<(anonymous namespace)::GetValueQActor>::a_body1cont5(int) [clone .isra.0] (storageserver.actor.cpp:890)
==10473==    by 0xF2305C: (anonymous namespace)::GetValueQActorState<(anonymous namespace)::GetValueQActor>::a_body1cont3(int) [clone .isra.0] (storageserver.actor.g.cpp:1592)
==10473==    by 0xF23447: a_body1cont2when1 (storageserver.actor.g.cpp:1627)
==10473==    by 0xF23447: (anonymous namespace)::GetValueQActorState<(anonymous namespace)::GetValueQActor>::a_body1cont2(Void const&, int) [clone .isra.0] (storageserver.actor.g.cpp:1512)
==10473==    by 0xF23507: a_body1when1 (storageserver.actor.g.cpp:1523)
==10473==    by 0xF23507: a_callback_fire (storageserver.actor.g.cpp:1537)
==10473==    by 0xF23507: ActorCallback<(anonymous namespace)::GetValueQActor, 0, Void>::fire(Void const&) (flow.h:894)
==10473==    by 0x891917: void SAV<Void>::send<Void>(Void&&) (flow.h:343)
==10473==    by 0x1C47ADC: send<Void> (flow.h:674)
==10473==    by 0x1C47ADC: execTask (sim2.actor.cpp:1632)
==10473==    by 0x1C47ADC: Sim2::RunLoopActorState<Sim2::RunLoopActor>::a_body1loopBody1cont1(Void const&, int) (sim2.actor.cpp:975)
==10473==    by 0x1C47FF2: a_body1loopBody1when1 (sim2.actor.g.cpp:5092)
==10473==    by 0x1C47FF2: Sim2::RunLoopActorState<Sim2::RunLoopActor>::a_body1loopBody1(int) (sim2.actor.g.cpp:5037)
==10473==  Uninitialised value was created by a stack allocation
==10473==    at 0xC342D0: (anonymous namespace)::ForwardProxyActorState<(anonymous namespace)::ForwardProxyActor>::a_body1loopBody1when2(ReplyPromise<GetReadVersionReply> const&, int) (MasterProxyServer.actor.g.cpp:8213)
 2019-07-22 13:54:52 -07:00
Vishesh Yadav
2f9f3c184f
Merge pull request #1870 from alexmiller-apple/txnStateStore-workload 
Add ability to bulk load data into TxnStateStore
 2019-07-22 13:20:39 -07:00
A.J. Beamon
e29a6ea280
Merge pull request #1871 from bnamasivayam/tr-priority-add-client-log 
Track the priority of sampled Transaction as part of GetReadVersion e…
 2019-07-22 13:04:52 -07:00
Balachandar Namasivayam
df652155fc Addressed review comments 2019-07-22 12:17:05 -07:00
mpilman
c26c68d6d2 Address review comments 2019-07-22 11:45:05 -07:00
mpilman
a66dc937fc Make trace files lexicographically ordered 
This resolves #1825

The basic idea is that we prefix every sequence number with its with,
separated by a dot. That way the filename length isn't increased
drastically (unlike using a fixed whidth number with 0-padding)
and the file names will be lexicographically ordered.
 2019-07-22 10:10:47 -07:00
Alex Miller
4ac1a0f557 Add ability to bulk load data into TxnStateStore 
* Changes BulkLoad workload to support a specific volume of data to load
* Changes BulkLoad and Cycle to correctly handle \xff in keyPrefix
* Adds BulkLoad to TxnStateStoreCycleTest
 2019-07-19 18:01:24 -07:00