copy of etcd repository
 
 
 
 
 
 
Go to file
Yicheng Qin ab5df57ecf etcdserver: fix raft state machine may block
When snapshot store requests raft snapshot from etcdserver apply loop,
it may block on the channel for some time, or wait some time for KV to
snapshot. This is unexpected because raft state machine should be unblocked.

Even worse, this block may lead to deadlock:
1. raft state machine waits on getting snapshot from raft memory storage
2. raft memory storage waits snapshot store to get snapshot
3. snapshot store requests raft snapshot from apply loop
4. apply loop is applying entries, and waits raftNode loop to finish
messages sending
5. raftNode loop waits peer loop in Transport to send out messages
6. peer loop in Transport waits for raft state machine to process message

Fix it by changing the logic of getSnap to be asynchronously creation.
2015-10-20 09:19:34 -07:00
Documentation docs/api.md: fix documentation 2015-10-09 10:41:12 +08:00
Godeps Godeps: update ugorji/go/codec dependency 2015-10-09 10:59:42 +02:00
client client: regenerate code to unmarshal key response 2015-10-09 10:59:42 +02:00
discovery *: fix spelling issues (codespell). 2015-09-11 10:22:29 +10:00
error metrics: add `events` metrics in etcdhttp. 2015-10-01 08:11:42 +01:00
etcdctl pkg/transport: pass dial timeout to NewTransport 2015-10-11 10:09:25 -07:00
etcdctlv3 *: support v3 compaction 2015-09-14 19:59:36 -07:00
etcdmain rafthttp: build transport inside pkg instead of passed-in 2015-10-11 21:42:37 -07:00
etcdserver etcdserver: fix raft state machine may block 2015-10-20 09:19:34 -07:00
hack hack/benchmark: add script for benchmark 2015-08-19 20:37:27 -07:00
integration rafthttp: build transport inside pkg instead of passed-in 2015-10-11 21:42:37 -07:00
logos logos: add SVG and PNG logos 2014-12-18 14:59:06 -08:00
pkg pkg/transport: pass dial timeout to NewTransport 2015-10-11 10:09:25 -07:00
proxy Merge pull request #3579 from gyuho/etcdserver/etcdhttp/httptypes/errors.go-WriteTo-returns-error 2015-09-25 14:31:48 -07:00
raft raft: fix a description of MemoryStorage.Compact 2015-10-06 21:49:33 -07:00
rafthttp etcdserver: fix raft state machine may block 2015-10-20 09:19:34 -07:00
scripts scripts: add release.sh 2015-09-09 09:50:41 -07:00
snap *: update gogoproto 2015-09-03 15:32:25 -07:00
storage Merge pull request #3616 from yichengq/storage-txn 2015-10-05 17:12:52 -07:00
store etcdserver, store: fix grammars in comments (a->an existing) 2015-09-14 13:41:13 -07:00
tools Merge pull request #3544 from xiang90/bench 2015-09-17 15:10:13 -07:00
version *: bump to v2.2.0+git 2015-09-10 10:03:07 -07:00
wal *: fix spelling issues (codespell). 2015-09-11 10:22:29 +10:00
.dockerignore Add .dockerignore to avoid including .git in docker build context 2014-08-15 16:38:29 +08:00
.gitignore etcd: use old default data-dir format 2014-10-24 16:41:42 -07:00
.godir create .godir 2014-11-18 15:01:57 -08:00
.header *: switch to line comments for copyright 2015-01-26 09:53:30 -08:00
.travis.yml travis: test for go 1.5 build 2015-08-20 11:39:41 -07:00
CONTRIBUTING.md Contributing: Link to reporting bugs doc 2015-08-25 12:15:03 -07:00
DCO docs(readme/contrib): clean up README, merge changes from CONTRIBUTING.md and split out DCO 2014-04-04 10:58:34 -07:00
Dockerfile Dockerfile: initial commit 2014-10-27 16:43:27 -07:00
LICENSE feat(*): initial commit 2014-01-19 12:25:11 -08:00
MAINTAINERS MAINTAINERS: add Brandon Philips 2014-09-07 19:45:34 -07:00
NOTICE feat(*): initial commit 2014-01-19 12:25:11 -08:00
Procfile Procfile: use proxy as default 2015-08-18 09:42:13 -07:00
README.md ectd/Getting-etcd: update README to require Go1.4+ 2015-09-28 15:35:09 -07:00
ROADMAP.md roadmap.md: update roadmap for 2.3 2015-09-10 12:24:48 -07:00
V3DemoProcfile Procfile: add a v3DemoProcfile 2015-09-12 23:08:56 -07:00
build build: fix build error on ubuntu 2015-09-02 13:28:55 +08:00
build.bat build: implemented build shell-script for Windows 2015-07-31 17:43:47 +10:00
cover test, scripts: use /usr/bin/env to find bash 2015-08-08 20:52:53 -06:00
main.go migrate: remove starter code 2015-03-20 10:51:42 -07:00
test test: add license header check 2015-09-15 14:09:01 -07:00

README.md

etcd

Build Status Docker Repository on Quay.io

Note: master branch may be in unstable or even broken state during development. Please use releases instead of master branch to get stable binaries.

etcd Logo

etcd is a distributed, consistent key-value store for shared configuration and service discovery, with a focus on being:

  • Simple: curl'able user facing API (HTTP+JSON)
  • Secure: optional SSL client cert authentication
  • Fast: benchmarked 1000s of writes/s per instance
  • Reliable: properly distributed using Raft

etcd is written in Go and uses the Raft consensus algorithm to manage a highly-available replicated log.

See etcdctl for a simple command line client. Or feel free to just use curl, as in the examples below.

If you're considering etcd for production use, please see: production-ready.md

Getting Started

Getting etcd

The easiest way to get etcd is to install one of the pre-built binaries from the tagged releases: instructions are available on GitHub.

For those wanting to try the very latest version, you can build the latest version of etcd from the master branch. You will first need Go installed on your machine (version 1.4+ is required). All development occurs on master, including new features and bug fixes. Bug fixes are first targeted at master and subsequently ported to release branches, as described in the branch management guide.

Running etcd

First start a single-member cluster of etcd:

./bin/etcd

This will bring up etcd listening on port 2379 for client communication and on port 2380 for server-to-server communication.

Next, let's set a single key, and then retrieve it:

curl -L http://127.0.0.1:2379/v2/keys/mykey -XPUT -d value="this is awesome"
curl -L http://127.0.0.1:2379/v2/keys/mykey

You have successfully started an etcd and written a key to the store.

Running local etcd cluster

First install goreman, which manages Procfile-based applications.

Our Procfile script will set up a local example cluster. You can start it with:

goreman start

This will bring up 3 etcd members infra1, infra2 and infra3 and etcd proxy proxy, which runs locally and composes a cluster.

You can write a key to the cluster and retrieve the value back from any member or proxy.

Next Steps

Now it's time to dig into the full etcd API and other guides.

Contact

Contributing

See CONTRIBUTING for details on submitting patches and the contribution workflow.

Reporting bugs

See reporting bugs for details about reporting any issue you may encounter..

Project Details

Versioning

Service Versioning

etcd uses semantic versioning New minor versions may add additional features to the API.

You can get the version of etcd by issuing a request to /version:

curl -L http://127.0.0.1:2379/version

API Versioning

The v2 API responses should not change after the 2.0.0 release but new features will be added over time.

32-bit systems

etcd has known issues on 32-bit systems due to a bug in the Go runtime. See #358 for more information.

License

etcd is under the Apache 2.0 license. See the LICENSE file for details.