vitalif
/
etcd
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
16,428 Commits
21 Branches
406 Tags
79 MiB
Commit Graph

989 Commits (b7f0f52a16dbf83f18ca1d803f7892d750366a94)

Author SHA1 Message Date
Xiang Li 5fdc124578 etcd: clean up snap 2014-09-03 09:20:10 -07:00
Yicheng Qin a28dc4559b raft/etcd: recover node 2014-09-03 09:20:10 -07:00
Xiang Li 63489b9ef5 etcd: snap and wal init 2014-09-03 09:20:10 -07:00
Xiang Li a5df254e53 raft: add clusterId to snapshot 2014-09-03 09:20:08 -07:00
Yicheng Qin 9203f68894 server: add /v2/stats/self 2014-09-03 09:20:07 -07:00
Blake Mizerany c19932c9ba raft: prune unnecessary logging - fixes #15 2014-09-03 09:20:04 -07:00
Xiang Li 8e06333d45 raft: make State a protobuf type 2014-09-03 09:20:03 -07:00
Xiang Li d6c3ebb1a0 raft: make Info a protobuf type 2014-09-03 09:20:03 -07:00
Yicheng Qin 431ff3cce1 raft: minor change on code 2014-09-03 09:20:02 -07:00
Yicheng Qin 15029381e1 raft: fix promotable 2014-09-03 09:20:02 -07:00
Yicheng Qin 01c40fcf50 raft: not recover from outdated snapshot 2014-09-03 09:20:02 -07:00
Yicheng Qin ba63cf666d raft: add recover 2014-09-03 09:20:02 -07:00
Xiang Li 6030261363 etcd/raft: add snap 2014-09-03 09:20:02 -07:00
Xiang Li 38ec659cd6 raft: make Entry a protobuf type 2014-09-03 09:20:01 -07:00
Xiang Li 611d564865 raft: remove unused prevTerm field 2014-09-03 09:20:01 -07:00
Xiang Li 54b4f52e48 raft: add index to entry 2014-09-03 09:20:01 -07:00
Yicheng Qin 88e5bce63d wip: wal glue 2014-09-03 09:19:59 -07:00
Xiang Li b383cd5acf raft: refactor recover 2014-09-03 09:19:59 -07:00
Yicheng Qin 2bd74bc328 raft: add Load 2014-09-03 09:19:59 -07:00
Yicheng Qin e850c644da raft: return offset for unstableEnts 2014-09-03 09:19:58 -07:00
Xiang Li 311db876b0 raft: add unstableState 2014-09-03 09:19:58 -07:00
Xiang Li 609e13a240 raft: add node.Unstable 
Be able to return all unstable log entries. Application must store unstable
log entries before send out any messages after calling step.
 2014-09-03 09:19:58 -07:00
Xiang Li 1288e1f39d raft: log->raftlog 2014-09-03 09:19:58 -07:00
Xiang Li c7d1beaaa5 raft: add first level logging 
We log the message to step and the state of the statemachine before and after
stepping the message.
 2014-09-03 09:19:58 -07:00
Xiang Li 2665cc1cc8 raft: heartbeat should not contain entries 2014-09-03 09:19:57 -07:00
Xiang Li 13ec81c87f raft: fix panic in putVarint; varint can take up to 10 bytes for a 64bit integer. 2014-09-03 09:19:56 -07:00
Xiang Li 060de128a7 raft: add clusterId 2014-09-03 09:19:56 -07:00
Yicheng Qin 9793c518ab raft: forbid to use none as id 2014-09-03 09:19:56 -07:00
Yicheng Qin 79689872af raft: use From field to distinguish local message 2014-09-03 09:19:56 -07:00
Xiang Li bea28933d3 raft: init lead to none 2014-09-03 09:19:52 -07:00
Xiang Li 2e86cf2dc8 raft: add more randomness 2014-09-03 09:19:50 -07:00
Xiang Li 9c8aff66a1 raft: randomize election timeout 2014-09-03 09:19:50 -07:00
Xiang Li 3921295b21 raft: update lead to none when receives vaild msgVote 2014-09-03 09:19:50 -07:00
Yicheng Qin 5fc5681cb4 server: make removal go through run loop 
It should not send to raft endpoint directly.
 2014-09-03 09:19:50 -07:00
Yicheng Qin f1853b4364 raft: add msgDenial to deny removed nodes 2014-09-03 09:19:49 -07:00
Yicheng Qin 690edb2c56 raft: update lead for follower sm when receiving msgApp 
Or follower may take `none` as its leader forever if it just launched
a failed election whose term is the same as the current leader.
 2014-09-03 09:19:49 -07:00
Xiang Li 447d7dc51b raft: fix log append; add tests 2014-09-03 09:19:49 -07:00
Xiang Li 2ff3ce74c5 raft: add sm.Index 2014-09-03 09:05:14 -07:00
Xiang Li 0886e0ddf4 raft: change term to atomicInt 2014-09-03 09:05:14 -07:00
Xiang Li 30f4d9faea raft: change index and term to int64 2014-09-03 09:05:14 -07:00
Xiang Li e11c7f35b4 raft: add atomicInt 2014-09-03 09:05:14 -07:00
Xiang Li 3f435571d3 raft: atomic load id 2014-09-03 09:05:14 -07:00
Xiang Li c3f8eabac3 etcd: separate raft and client port 2014-09-03 09:05:13 -07:00
Xiang Li fc35324ba7 etcd: pass v2 kv api tests 2014-09-03 09:05:13 -07:00
Xiang Li 2af0ad505a raft: make id int64 2014-09-03 09:05:12 -07:00
Xiang Li 5651272ec8 raft: handle snapshot message 2014-09-03 09:05:12 -07:00
Xiang Li 2a11c1487c raft: sm.compact and sm.restore 2014-09-03 09:05:12 -07:00
Yicheng Qin 62a90e77b3 raft: send Normal with nil Data when leader is elected out 2014-09-03 09:05:12 -07:00
Xiang Li 064004b899 raft: add log compact 2014-09-03 09:05:12 -07:00
Xiang Li 6a232dfc13 raft: add offset for log 2014-09-03 09:05:12 -07:00
Xiang Li 7be945f59b etcd: glue 2014-09-03 09:05:12 -07:00
Yicheng Qin 8eac28350d raft: avoid unexpected self-bootstrap state machine 2014-09-03 09:05:12 -07:00
Yicheng Qin c86f484712 raft: make judge clear 2014-09-03 09:05:12 -07:00
Yicheng Qin 7dc02b947d raft: refine TestVote 2014-09-03 09:05:12 -07:00
Yicheng Qin 095251f1fa raft: Network supports discontinuous ids 2014-09-03 09:05:12 -07:00
Xiang Li 62bdcf6f49 raft: range over sm.ins 2014-09-03 09:05:12 -07:00
Xiang Li e9cb510ef5 raft: node.Add needs the pubAddr field 2014-09-03 09:05:12 -07:00
Blake Mizerany 5778c49689 raft: set term in reset 2014-09-03 09:05:11 -07:00
Blake Mizerany 67808f8db1 raft: remove vestigial canStep 2014-09-03 09:05:11 -07:00
Blake Mizerany 6044b1a0d7 raft: break Step into pieces 2014-09-03 09:05:11 -07:00
Xiang Li f387e3e27d raft: add Entry.isConfig 2014-09-03 09:05:11 -07:00
Xiang Li 3817661f82 raft: rename ConfigAdd/ConfigRemove -> AddNode/RemoveNode 2014-09-03 09:05:11 -07:00
Xiang Li 9f315ffe10 raft: make entry type public 2014-09-03 09:05:11 -07:00
Xiang Li 584186c7ff add HasLeader function 2014-09-03 09:05:11 -07:00
Blake Mizerany dd94d5d4e8 raft: move tick comments into cases 2014-09-03 09:05:11 -07:00
Blake Mizerany 15a8b46359 raft: add/remove -> addNode/removeNode 2014-09-03 09:05:11 -07:00
Blake Mizerany e5b9e22518 raft: Step returns ok 2014-09-03 09:05:11 -07:00
Blake Mizerany a10461f60d raft: Add/Remove -> add/remove 2014-09-03 09:05:11 -07:00
Blake Mizerany 8344303b1a raft: addr -> id 2014-09-03 09:05:11 -07:00
Blake Mizerany cb2095cddc raft: fix typo 2014-09-03 09:05:10 -07:00
Xiang Li cc3a8e26c8 raft: add leader change test for configuration 2014-09-03 09:05:10 -07:00
Blake Mizerany 3a85d97fd9 raft: group Node fields 2014-09-03 09:05:10 -07:00
Xiang Li 6e95448ad7 raft: correct comment for n.Next 2014-09-03 09:05:10 -07:00
Xiang Li 7e27d588ff raft: return all the appliable entries 2014-09-03 09:05:10 -07:00
Blake Mizerany f8a3ac9338 raft: make Msgs one line 2014-09-03 09:05:10 -07:00
Blake Mizerany d12b2c39dd raft: blake is OCD 2014-09-03 09:05:10 -07:00
Blake Mizerany 78bbb37018 raft: Config -> config 2014-09-03 09:05:10 -07:00
Blake Mizerany fb1ca245a7 raft: remove unused ClusterId 2014-09-03 09:05:10 -07:00
Blake Mizerany 8c12d6d00f raft: refactor Node.Add/Remove 2014-09-03 09:05:10 -07:00
Blake Mizerany 96059a496a raft: replace Node.id 2014-09-03 09:05:10 -07:00
Blake Mizerany abd2448931 raft: addr -> id 2014-09-03 09:05:10 -07:00
Blake Mizerany c24b6b4150 raft: init stateMachine in New 2014-09-03 09:05:10 -07:00
Blake Mizerany 7cdd148e24 raft: StartCluster -> Dictate 2014-09-03 09:05:09 -07:00
Xiang Li 1a75beb57c raft: add confAdd and confRemove entry type 2014-09-03 09:05:09 -07:00
Yicheng Qin b5f887f5d2 raft: add cluster test 2014-09-03 09:05:09 -07:00
Yicheng Qin 5cad4e595c raft: add create cluster of itself 2014-09-03 09:05:09 -07:00
Yicheng Qin 193756fa38 raft: add remove node 2014-09-03 09:05:09 -07:00
Xiang Li 961518c893 raft: execute log entries in node.step 2014-09-03 09:05:09 -07:00
Xiang Li 989f41477d raft: rename peer -> peers 2014-09-03 09:05:09 -07:00
Xiang Li 8ce6b94e05 raft: add and remove 2014-09-03 09:05:09 -07:00
Xiang Li d293c4915c raft: fix pendingConf 2014-09-03 09:05:09 -07:00
Xiang Li c03fbf68d6 raft: add conf safety 
To make configuration change safe without adding configuration protocol:

1. We only allow to add/remove one node at a time.

2. We only allow one uncommitted configuration entry in the log.

These two rules can make sure there is no disjoint quorums in both current cluster and the
future(after applied any number of committed entries or uncommitted entries in log) clusters.

We add a type field in Entry structure for two reasons:

1. Statemachine needs to know if there is a pending configuration change.

2. Configuration entry should be executed by raft package rather application who is using raft.
 2014-09-03 09:05:09 -07:00
Xiang Li 853a458a0d raft: change ins from array to map 2014-09-03 09:05:09 -07:00
Yicheng Qin f9c299da8b raft: return after handling msgBeat 
It makes the workflow more clear.
 2014-09-03 09:05:09 -07:00
Xiang Li c7e358922b raft: add elaspe reset test 2014-09-03 09:05:09 -07:00
Xiang Li 5d710c0f7a raft: add recvMsgBeat test 2014-09-03 09:05:08 -07:00
Xiang Li 12572e5412 raft: add state transition test 2014-09-03 09:05:08 -07:00
Xiang Li 920b80c41f raft: add single node commit test 2014-09-03 09:05:08 -07:00
Xiang Li 8111d4fbb8 raft: introduce network.cut 2014-09-03 09:05:08 -07:00
Xiang Li a6a63d116f raft: add a test for commit rule 2014-09-03 09:05:08 -07:00
Xiang Li 28f87c2a43 raft: use sm.maybeCommit; should not call log.maybeCommit directly 2014-09-03 09:05:08 -07:00
Yicheng Qin 4d22ff90d5 raft: refactor network simulator 
Signed-off-by: Blake Mizerany <blake.mizerany@gmail.com>
 2014-09-03 09:05:08 -07:00
Yicheng Qin a9c81088f8 raft: add new diff 
Signed-off-by: Blake Mizerany <blake.mizerany@gmail.com>
 2014-09-03 09:05:08 -07:00
Xiang Li c32d34166e raft: leader updates its own match; tries to commit after a prop 2014-09-03 09:05:08 -07:00
Xiang Li 6fa74b0e33 raft: do bcast when receiving msgBeat 2014-09-03 09:05:08 -07:00
Xiang Li 09d1575eeb raft: node.tick 2014-09-03 09:05:08 -07:00
Xiang Li eff3aadba1 raft: add full stop to every function comment 2014-09-03 09:05:08 -07:00
Xiang Li 167ef7e8b0 raft: test leader replies to appResp 2014-09-03 09:05:08 -07:00
Xiang Li 9bb7265d64 raft: leader only sends append to the unsynced peer when get a bad appResp 2014-09-03 09:05:07 -07:00
Xiang Li 88674a623a raft: use if statement to handle voteResp 2014-09-03 09:05:07 -07:00
Xiang Li b3de2b3450 raft: testVote - breaks state machine init to multiple lines 2014-09-03 09:05:07 -07:00
Xiang Li 59a720d8be raft: vote test for candidate and leader 2014-09-03 09:05:07 -07:00
Xiang Li 828a8cf326 raft: leader denies vote with the same term 2014-09-03 09:05:07 -07:00
Xiang Li 93b08502e4 raft: check voteFor 2014-09-03 09:05:07 -07:00
Yicheng Qin c1c45575be raft: ins: []*index -> []index 
It could make raft faster, use less storage.
 2014-09-03 09:05:07 -07:00
Xiang Li 1170c21f89 raft: add a single candidate test 2014-09-03 09:05:07 -07:00
Xiang Li 2066ff5acb raft: candidate should become leader directly if it is a one node cluster 2014-09-03 09:05:07 -07:00
Xiang Li 0cdd1b58a4 raft: rename log.commit to log.committed 2014-09-03 09:05:07 -07:00
Xiang Li 9cd3b2153f raft: comment log.nextEnts 2014-09-03 09:05:07 -07:00
Xiang Li a06729a96a raft: use log.lastIndex() 2014-09-03 09:05:07 -07:00
Xiang Li 888ddacd3c raft: remove the init cap of log entries 2014-09-03 09:05:06 -07:00
Xiang Li 2ef9498d6f raft: remove TLA comment 2014-09-03 09:05:06 -07:00
Xiang Li 1f0e13e956 raft: remove sm.voteWorthy 2014-09-03 09:05:06 -07:00
Xiang Li bee9d8bea5 raft: add log.maybeAppend 2014-09-03 09:05:06 -07:00
Xiang Li b70be19653 raft: add log.maybeCommit 2014-09-03 09:05:06 -07:00
Xiang Li 092461d7c8 raft: rename log.len to log.lastIndex 2014-09-03 09:05:06 -07:00
Xiang Li 8f3d109c18 raft: rename log.isOk to log.matchTerm 2014-09-03 09:05:06 -07:00
Xiang Li 4c609ec59c raft: new log struct 2014-09-03 09:05:06 -07:00
Xiang Li cb7b75c15f raft: remove unused function maybeAppend 
Signed-off-by: Blake Mizerany <blake.mizerany@gmail.com>
 2014-09-03 09:05:06 -07:00
Xiang Li 74737b76cc raft: leader commit and test 
Signed-off-by: Blake Mizerany <blake.mizerany@gmail.com>
 2014-09-03 09:05:06 -07:00
Xiang Li c223eca938 raft: clean stateMachine 2014-09-03 09:05:06 -07:00
Xiang Li 5b052e1e10 raft: prop msg type should be MsgProp 2014-09-03 09:05:06 -07:00
Xiang Li ab79550693 raft: use becomeFollower in cadidate state 2014-09-03 09:05:06 -07:00
Xiang Li 73e3394d2d raft: reverse sort to figure out the ci 2014-09-03 09:05:05 -07:00
Blake Mizerany 8ddcd9799d raft: go fmt 2014-09-03 09:05:05 -07:00
Blake Mizerany 6e0a668455 raft: add Node.Next 2014-09-03 09:05:05 -07:00
Blake Mizerany 9545662c6b raft: return *Node 2014-09-03 09:05:05 -07:00
Blake Mizerany 50e0db4038 raft: attempt first version of Interface 2014-09-03 09:05:05 -07:00
Blake Mizerany 8d7be33dd8 raft: move to raft pkg 2014-09-03 09:05:05 -07:00