08b34a3f5b
pkg/metrics: self-manage global expvar map
...
This helps the embedded tests.
2015-01-26 16:20:09 -08:00
f8ce5996b0
Treat URLs have same IP address as same
...
- To solve validation error problem using URLs in hostname #2123
2015-01-27 04:36:41 +09:00
9c7f66c5d9
Merge pull request #2119 from sorah/peer-ca-on-fetching-members
...
etcdserver: User peerTLSInfo to get cluster member
2015-01-26 10:50:44 -08:00
033e7d1db9
etcdserver: User peerTLSInfo to get cluster member
2015-01-27 03:43:21 +09:00
f1ed69e883
*: switch to line comments for copyright
...
Build tags are not compatible with block comments.
Also adds copyright header to a few places it was missing.
2015-01-26 09:53:30 -08:00
a77bf97c14
etcdhttp: add internalVersion
2015-01-22 15:42:16 -08:00
59214978a2
raft: Add applied index as an argument to newRaft and RestartNode.
2015-01-22 11:38:05 -05:00
99821579bf
metrics: add /rafthttp/stream metrics
2015-01-21 13:24:21 -08:00
0eaaad0e48
raft: add Status interface
...
Status returns the current status of raft state machine.
2015-01-16 14:02:04 -08:00
a97f331a0e
etcdhttp: add health endpoint
2015-01-16 10:52:02 -08:00
973f79e1c9
etcdserver: separate out raft related stuff
2015-01-15 15:15:13 -08:00
1a6161d08a
Merge pull request #2104 from xiang90/timeout
...
etcdserver: make heartbeat/election configurable
2015-01-15 13:52:20 -08:00
276a4abac0
etcdserver: make heartbeat/election configurable
2015-01-15 11:11:33 -08:00
190fd446f9
pkg/types: add URLs tests
2015-01-15 10:24:23 -08:00
89d95539cf
Merge pull request #2083 from yichengq/293
...
*: move etcdserver/idutil -> pkg/idutil
2015-01-13 13:04:50 -08:00
07a69430c1
*: move etcdserver/idutil -> pkg/idutil
2015-01-13 11:54:51 -08:00
dc6aef0d02
etcdhttp: add NewPeerHandler test
2015-01-12 15:56:29 -08:00
270e67db84
wal: not export unnecessary public functions
2015-01-09 14:55:10 -08:00
bca1e5aea6
Merge pull request #2057 from yichengq/282
...
fix context time-out failure on travis
2015-01-07 13:41:26 -08:00
930156c18a
integration: adjust election ticks using env var
2015-01-07 11:18:29 -08:00
6b237416e1
Merge pull request #2044 from yichengq/278
...
wal: record mark when snapshotting
2015-01-07 08:26:33 -08:00
6460e49a33
wal: save empty snapshot when create
...
So caller can open at empty snapshot to read all entries.
2015-01-06 19:48:21 -08:00
84f62f21ee
wal: record and check snapshot
2015-01-06 16:27:40 -08:00
1ebad5e42c
etcdhttp: support member/leader endpoint
2015-01-06 08:52:33 -08:00
6b8667152b
Merge pull request #2035 from xiang90/errorc
...
etcdserver: collect error from errorc
2015-01-05 11:29:01 -08:00
cb5bff5b05
Merge pull request #2034 from yichengq/276
...
etcdhttp: reset serve and watch timeout
2015-01-05 08:33:25 -08:00
15be030aaa
etcdserver: collect error from errorc
2015-01-02 20:13:46 -08:00
4dd00be365
etcdhttp: reset serve and watch timeout
2015-01-02 16:39:13 -08:00
2a83e350b1
Merge pull request #1992 from xiang90/rm_leader
...
*: support removing the leader from a 2 members cluster
2015-01-02 14:15:12 -08:00
6e727625b9
etcdserver: continue to apply after self-removed
2015-01-02 14:10:07 -08:00
51ffc88096
etcdsever: remove mult_server_test
2015-01-02 13:49:58 -08:00
41f6137261
etcdserver: use the actual store implementation when we need the actual implementation
2015-01-02 12:22:01 -08:00
27d47977d9
etcdserver: move recorder to testutil
2015-01-02 11:21:23 -08:00
ac6cd03365
etcdserver: refactor server_test.go
2015-01-02 10:56:09 -08:00
04003a01ba
Merge pull request #2013 from xiang90/tr
...
rafthttp cleanup
2014-12-31 08:35:20 -08:00
803c38f448
etcdserver: move error to errors.go
...
Both server.go and cluster.go are using defined ErrX. Move error
to errors.go
2014-12-30 15:02:07 -08:00
c3d2f5eea0
pbutil: add getbool to pbutil
2014-12-30 14:51:26 -08:00
241a474935
etcdserver: refactor server tests
...
1. remove redundant fake struct
2. use fake node for better testing
3. code clean
2014-12-30 13:49:55 -08:00
a92bd1d165
etcdserver: add multi_server_test.go
2014-12-30 00:10:18 -08:00
f79b9042ab
etcdserver: fix streaming handler
2014-12-29 22:12:58 -08:00
3748088b96
etcdserver: print out log of normal tests
2014-12-29 14:38:00 -08:00
6ccaadc95d
Merge pull request #1952 from yichengq/262
...
etcdserver: add id generator
2014-12-29 13:59:06 -08:00
05c921229e
etcdserver: add id generator
2014-12-29 13:03:04 -08:00
c712dd682a
rafthttp: make Transport private
2014-12-29 12:20:52 -08:00
a14d13f724
rafthttp: make fields in Transport private
2014-12-29 12:08:13 -08:00
7c8b9c0203
Merge pull request #2011 from xiang90/timeutil
...
etcdserver: move getExpr to timeutil
2014-12-29 12:03:25 -08:00
152676f43a
*: support removing the leader from a 2 members cluster
2014-12-29 11:34:33 -08:00
5bb8eeb5cf
rafthttp: transport cleanup
2014-12-29 11:21:40 -08:00
cea29fe158
etcdserver: move getExpr to timeutil
2014-12-29 11:15:02 -08:00
08f839e32c
rafthttp: set the API boundary of the package
2014-12-28 15:50:27 -08:00
1535596252
etcdserver: remove unnecessary indirection
2014-12-26 11:03:13 -08:00
3dcd66459d
etcdserver: remove unused containsUint64()
2014-12-26 10:56:56 -08:00
69444b6bba
etcdserver: cleanup server.go
2014-12-25 21:37:20 -08:00
78b51d3f2f
etcdserver: cleanup cluster.go
2014-12-25 20:56:30 -08:00
6dc3af5da4
etcdserver: cluster clean up
2014-12-25 20:36:48 -08:00
7a5bf53222
etcdserver: move member sort interface to member.go
2014-12-25 20:18:55 -08:00
ef0a66bb0a
etcdserver: kill a todo in test
2014-12-25 18:14:05 -08:00
f43bc809b9
etcdserver: cleanup wal upgrade
2014-12-24 22:02:46 -08:00
b9d228b0fa
etcdserver: remove example.go
2014-12-24 21:41:31 -08:00
4e6cbc937e
*: change remaining 0.5 references -> 2.0
2014-12-18 16:14:42 -08:00
c27c288bef
etcdserver: update stats when become leader
2014-12-15 17:02:48 -08:00
04522baeee
etcdserver: fix leader stats
2014-12-15 16:50:03 -08:00
53bf7e4b5e
wal: rename openAtIndex -> open; OpenAtIndexUntilUsing -> openNotInUse
2014-12-14 19:33:06 -08:00
ea94d19147
*: lock the in using files; do not purge locked the wal files
2014-12-14 19:27:22 -08:00
dcf34c0ab4
Merge pull request #1938 from yichengq/262
...
etcdserver: protect the sender map in SendHub
2014-12-15 10:41:52 +08:00
ceb077424d
etcdserver: protect the sender map in SendHub
2014-12-15 10:37:41 +08:00
d86603840d
rafthttp: better logging
2014-12-14 09:50:59 -08:00
4724cbbe2c
etcdserver: one line
2014-12-11 22:17:36 -08:00
935f7128a9
etcdserver: move stats inferface to stats pkg
2014-12-11 22:14:05 -08:00
5f16fab541
Merge pull request #1915 from barakmich/1834
...
Return Unknown instead of NotExist
2014-12-11 13:49:26 -05:00
cf7690cb51
detect more cases of empty directories and actual errors
2014-12-11 13:37:32 -05:00
c26542b7f2
Merge pull request #1913 from xiang90/lazy_snap_dir
...
etcdserver: create snap dir until start the node
2014-12-11 09:39:51 -08:00
836ccabad2
etcdserver: create snap dir until start the node
2014-12-11 09:25:18 -08:00
4777cba995
Merge pull request #1898 from robszumski/improve-logging
...
Improve logging for etcdserver and rafthttp
2014-12-10 10:46:47 -08:00
a852936a59
etcdserver: removed an unhelpful test failure message
...
this commit changes instances of "blah" in a test to more
descriptive messages
2014-12-09 21:45:50 -08:00
13f3158728
etcdserver: improve discovery ignore warning
2014-12-09 15:57:25 -08:00
e4c0f5c1a8
Merge pull request #1895 from xiang90/snap_nodes
...
etcd: update conf when apply the confChange entry
2014-12-09 11:45:01 -08:00
a5efbf826d
raft: drop nodes in softState
2014-12-09 11:43:52 -08:00
29d7a2a558
etcd: update conf when apply the confChange entry
2014-12-08 23:37:07 -08:00
4804c45e14
raft: set raft.Commit too when setting raftLog.committed
2014-12-08 22:35:55 -08:00
9c8f5c9535
Merge pull request #1891 from yichengq/257
...
etcdserver: init state before run loop correctly
2014-12-08 16:38:33 -08:00
13814c9d7d
etcdserver: init state before run loop correctly
2014-12-08 16:13:16 -08:00
7e06d85651
etcdserver: apply entries when it is not empty
...
Or it updates appliedi wrongly.
2014-12-08 15:56:38 -08:00
71f3b80fbe
etcdserver: check recovery error when new server
2014-12-08 14:55:23 -08:00
8c338ffcc7
etcdserver: correct the log about recovering from snapshot
2014-12-08 14:51:42 -08:00
771ff4589d
etcdserver: not add self into sendhub when new server
2014-12-05 00:18:40 -08:00
1d1c2ff834
Merge pull request #1841 from yichengq/246
...
etcdserver: close storage when stop
2014-12-04 15:36:24 -08:00
a7bc03b42b
etcdserver: close storage when stop
2014-12-04 15:16:22 -08:00
88e2fab572
Merge pull request #1859 from xiang90/pause_test
...
*: add pauseMember test
2014-12-04 15:11:59 -08:00
3de2ab2c04
*: typofixes
...
https://github.com/vlajos/misspell_fixer
2014-12-04 22:51:19 +00:00
151f043414
*: add pauseMember test
2014-12-04 14:22:43 -08:00
fa292391d8
etcdserver: close idle connections when stop sendhub
2014-12-02 00:08:47 -08:00
7beac083ff
Merge pull request #1810 from xiang90/purge
...
*: support purging old wal/snap files
2014-12-01 12:05:05 -08:00
d3db010190
*: support purging old wal/snap files
2014-12-01 11:50:17 -08:00
bc5acd3c42
etcdserver: log snapshot event
2014-11-30 12:10:20 -08:00
e23f9e76d1
raft: do not applysnapshot in raft
2014-11-26 10:59:13 -08:00
9df0e7715d
raft: do not panic on out of date compaction
2014-11-25 15:14:39 -08:00
01cbcce8ba
etcdserver: do not applySnapshot twice
2014-11-25 14:53:49 -08:00
74d8c7f457
etcdserver: cleanup main loop
2014-11-25 14:38:18 -08:00
7e6e305c4f
Merge branch 'log_interface'
...
Conflicts:
raft/raft.go
2014-11-25 14:22:11 -08:00
a13d5a70ff
etcdserver: save snapshot before entries
2014-11-25 12:39:15 -08:00
c67b937d62
etcdserver: truncate WAL from correct index when forcing new cluster
...
When loading from a backup with a snapshot and WAL, the length of WAL entries
can be lower than the current index integer value, causing a panic when
slicing off uncommitted entries. This looks for WAL entries higher than
the current index before slicing.
2014-11-25 16:46:56 +00:00
54e1237271
etcdserver: panic when snapshot on raft storage
...
Snapshot on raft storage should always succeed. If there is an error, it must
be internal fault and needs stack info to debug.
2014-11-24 21:22:49 -08:00
1b038da18a
etcdserver: init snapi when init appliedi
2014-11-24 21:19:30 -08:00
bd9e93eeea
etcdserver: remove finished TODO for raftStorage.Compact
2014-11-24 21:10:53 -08:00
185d37c333
etcdserver: not load dummy entry from the wal
2014-11-24 20:51:04 -08:00
d69e4dbe6d
etcdserver: initial index to 1
2014-11-24 14:57:08 -08:00
453133977d
etcdserver: save snapshot only if the index is greater than previous snap index
2014-11-24 14:47:59 -08:00
4b7af29c37
etcdserver: fix TriggerSnap test.
...
Sleep for millisecond to allow the server to apply the first nop and
first put separately.
2014-11-24 14:47:49 -08:00
08f156a1de
etcdserver: remove extra empty line in snapshot func
2014-11-24 10:27:18 -08:00
0d680d0e6b
Merge remote-tracking branch 'coreos/master' into merge
...
* coreos/master:
rafthttp: fix import
raft: should not decrease match and next when handling out of order msgAppResp
Fix migration to allow snapshots to have the right IDs
add snapshotted integration test
fix test import loop
fix import loop, add set to types, and fix comments
etcdserver: autodetect v0.4 WALs and upgrade them to v0.5 automatically
wal: add a bench for write entry
rafthttp: add streaming server and client
dep: use vendored imports in codegangsta/cli
dep: bump golang.org/x/net/context
Conflicts:
etcdserver/server.go
etcdserver/server_test.go
migrate/snapshot.go
2014-11-21 15:40:11 -05:00
30690d15d9
Re-enable a few tests I had missed.
...
Fix integration test for the change to log entry zero.
Increase test timeouts since integration tests often take
longer than 10s for me.
2014-11-21 15:27:17 -05:00
c0fb1c8a00
Merge pull request #1755 from bcwaldon/golang.org-deps
...
Switch to golang.org/x/net/context
2014-11-20 16:26:14 -08:00
59a0c64e9f
fix import loop, add set to types, and fix comments
2014-11-20 15:38:08 -05:00
78ea3335bf
etcdserver: autodetect v0.4 WALs and upgrade them to v0.5 automatically
2014-11-20 15:38:08 -05:00
9d53b94546
rafthttp: add streaming server and client
2014-11-20 11:34:50 -08:00
9a728a127a
dep: bump golang.org/x/net/context
...
Move from code.google.com/p/go.net/context to
golang.org/x/net/context before bumping to latest.
2014-11-20 10:19:12 -08:00
b29240baf0
Merge remote-tracking branch 'coreos/master' into merge
...
* coreos/master:
scripts: build-docker tag and use ENTRYPOINT
scripts: build-release add etcd-migrate
create .godir
raft: optimistically increase the next if the follower is already matched
raft: add handleHeartbeat handleHeartbeat commits to the commit index in the message. It never decreases the commit index of the raft state machine.
rafthttp: send takes raft message instead of bytes
*: add rafthttp pkg into test list
raft: include commitIndex in heartbeat
rafthttp: move server stats in raftHandler to etcdserver
*: etcdhttp.raftHandler -> rafthttp.RaftHandler
etcdserver: rename sender.go -> sendhub.go
*: etcdserver.sender -> rafthttp.Sender
Conflicts:
raft/log.go
raft/raft_paper_test.go
2014-11-19 17:05:16 -05:00
355ee4f393
raft: Integrate snapshots into the raft.Storage interface.
...
Compaction is now treated as an implementation detail of Storage
implementations; Node.Compact() and related functionality have been
removed. Ready.Snapshot is now used only for incoming snapshots.
A return value has been added to ApplyConfChange to allow applications
to track the node information that must be stored in the snapshot.
raftpb.Snapshot has been split into Snapshot and SnapshotMetadata, to
allow the full snapshot data to be read from disk only when needed.
raft.Storage has new methods Snapshot, ApplySnapshot, HardState, and
SetHardState. The Snapshot and HardState parameters have been removed
from RestartNode() and will now be loaded from Storage instead.
The only remaining difference between StartNode and RestartNode is that
the former bootstraps an initial list of Peers.
2014-11-19 16:40:26 -05:00
1a72143ecb
rafthttp: send takes raft message instead of bytes
...
This gives streaming mechanism the chance to assemble and disassemble
raft messages.
2014-11-17 22:39:53 -08:00
a2c568a144
Merge pull request #1669 from yichengq/215
...
*: add rafthttp as a separate package
2014-11-17 16:14:59 -08:00
f24e214ee5
rafthttp: move server stats in raftHandler to etcdserver
2014-11-17 16:02:20 -08:00
5dc5f8145c
*: etcdhttp.raftHandler -> rafthttp.RaftHandler
2014-11-17 15:52:24 -08:00
3fcc011717
etcdserver: rename sender.go -> sendhub.go
2014-11-17 15:35:15 -08:00
84fbf7aab5
*: etcdserver.sender -> rafthttp.Sender
2014-11-17 15:35:10 -08:00
300c5a2001
Merge remote-tracking branch 'coreos/master' into log-storage-interface
...
* coreos/master: (21 commits)
etcdserver: refactor ValidateClusterAndAssignIDs
integration: add integration test for remove member
integration: add test for member restart
version: bump to alpha.3
etcdserver: add buffer to the sender queue
*: gracefully stop etcdserver
Fix up migration tool, add snapshot migration
etcd4: migration from v0.4 -> v0.5
etcdserver: export Member.StoreKey
etcdserver: recover cluster when receiving newer snapshot
etcdserver: check and select committed entries to apply
etcdserver: recover from snapshot before applying requests
raft: not set applied when restored from snapshot
sender: support elegant stop
etcdserver: add StopNotify
etcdserver: fix TestDoProposalStopped test
etcdserver: minor cleanup
etcdserver: validate new node is not registered before in best effort
etcdserver: fix server.Stop()
*: print out configuration when necessary
...
Conflicts:
etcdserver/server.go
etcdserver/server_test.go
raft/log.go
2014-11-17 18:28:24 -05:00
e04e4632b3
Merge pull request #1736 from xiang90/verify
...
etcdserver: refactor ValidateClusterAndAssignIDs
2014-11-17 14:34:59 -08:00
0541f0afa0
etcdserver: refactor ValidateClusterAndAssignIDs
2014-11-17 14:23:37 -08:00
64d9bcabf1
Add Storage.Term() method and hide the first entry from other methods.
...
The first entry in the log is a dummy which is used for matchTerm
but may not have an actual payload. This change permits Storage
implementations to treat this term value specially instead of
storing it as a dummy Entry.
Storage.FirstIndex() no longer includes the term-only entry.
This reverses a recent decision to create entry zero as initially
unstable; Storage implementations are now required to make
Term(0) == 0 and the first unstable entry is now index 1.
stableTo(0) is no longer allowed.
2014-11-17 16:54:12 -05:00
c26de66262
integration: add integration test for remove member
2014-11-17 13:28:09 -08:00
7c4b84a6cd
etcdserver: add buffer to the sender queue
2014-11-14 15:18:16 -08:00
8bf71d796e
*: gracefully stop etcdserver
2014-11-14 14:12:24 -08:00
192f200d9e
Fix up migration tool, add snapshot migration
...
Fixes all updates since bcwaldon sketched the original, with cleanup and
into an acutal working state. The commit log follows:
fix pb reference and remove unused file post rebase
unbreak the migrate folder
correctly detect node IDs
fix snapshotting
Fix previous broken snapshot
Add raft log entries to the translation; fix test for all timezones. (Still in progress, but passing)
Fix etcd:join and etcd:remove
print more data when dumping the log
Cleanup based on yichengq's comments
more comments
Fix the commited index based on the snapshot, if one exists
detect nodeIDs from snapshot
add initial tool documentation and match the semantics in the build script and main
formalize migration doc
rename function and clarify docs
fix nil pointer
fix the record conversion test
add migration to test suite and fix govet
2014-11-14 16:46:08 -05:00
5ea1f2d96f
etcd4: migration from v0.4 -> v0.5
2014-11-14 15:57:26 -05:00
c36abeabd1
etcdserver: export Member.StoreKey
2014-11-14 15:57:26 -05:00
b6887e4a83
Merge pull request #1719 from yichengq/228
...
etcdserver: recover snapshot before applying committed entries
2014-11-14 12:18:41 -08:00
77433ff6da
etcdserver: recover cluster when receiving newer snapshot
2014-11-14 12:11:21 -08:00
dfaa7290c4
etcdserver: check and select committed entries to apply
2014-11-14 12:11:16 -08:00
f6a7f96967
etcdserver: recover from snapshot before applying requests
2014-11-14 12:08:39 -08:00
12dba7d413
sender: support elegant stop
2014-11-13 17:44:36 -08:00
e66bda957b
Merge pull request #1714 from xiang90/stop
...
StopNotify
2014-11-13 15:16:52 -08:00
6a1fe00615
Merge pull request #1704 from xiang90/print_config
...
*: print out configuration when necessary
2014-11-13 14:35:50 -08:00
11f392bdc8
Merge pull request #1708 from yichengq/223
...
etcdserver: validate new node is not registered before in best effort
2014-11-13 14:30:40 -08:00
b5d480f17a
etcdserver: add StopNotify
2014-11-13 14:16:48 -08:00
978d0f1ca1
etcdserver: fix TestDoProposalStopped test
...
We start etcd server in this test without the cluster. Sometimes it panics when
accessing the cluster. Most of the time it does not panic, since we can stop the
server fast enough before applying the first configuration change entry.
2014-11-13 14:08:59 -08:00
fb344bc33f
etcdserver: minor cleanup
2014-11-13 14:01:56 -08:00
813ff6ba48
Merge pull request #1713 from xiang90/stop
...
etcdserver: fix server.Stop()
2014-11-13 13:58:07 -08:00
ac907d746b
etcdserver: validate new node is not registered before in best effort
2014-11-13 13:56:11 -08:00
30dfdb0ea9
etcdserver: fix server.Stop()
...
Stop should be idempotent. It should simply send a stop signal to the server.
It is the server's responsibility to stop the go-routines and related components.
2014-11-13 13:47:12 -08:00
39eddd8565
Merge remote-tracking branch 'coreos/master' into log-storage-interface
...
* coreos/master:
etcdserver: add sender tests
raft: Only call stableTo when we have ready entries or a snapshot.
etcdserver: add ID() function to the Server interface.
sender: use RoundTripper instead of Client in sender
2014-11-13 15:50:08 -05:00
Yicheng Qin