{"action":"created","issue":{"url":"https://api.github.com/repos/hashicorp/consul/issues/856","labels_url":"https://api.github.com/repos/hashicorp/consul/issues/856/labels{/name}","comments_url":"https://api.github.com/repos/hashicorp/consul/issues/856/comments","events_url":"https://api.github.com/repos/hashicorp/consul/issues/856/events","html_url":"https://github.com/hashicorp/consul/issues/856","id":67620477,"number":856,"title":"Auto bootstrapping after outage does not work","user":{"login":"fidian","id":428348,"avatar_url":"https://avatars.githubusercontent.com/u/428348?v=3","gravatar_id":"","url":"https://api.github.com/users/fidian","html_url":"https://github.com/fidian","followers_url":"https://api.github.com/users/fidian/followers","following_url":"https://api.github.com/users/fidian/following{/other_user}","gists_url":"https://api.github.com/users/fidian/gists{/gist_id}","starred_url":"https://api.github.com/users/fidian/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fidian/subscriptions","organizations_url":"https://api.github.com/users/fidian/orgs","repos_url":"https://api.github.com/users/fidian/repos","events_url":"https://api.github.com/users/fidian/events{/privacy}","received_events_url":"https://api.github.com/users/fidian/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-04-10T15:29:00Z","updated_at":"2015-04-10T17:39:54Z","closed_at":"2015-04-10T17:39:54Z","body":"This is likely related to #526.\r\n\r\nI have three Consul servers and all are talking with Atlas.  They are automatically bootstrapped and it's set to a quorum of 3.  I proceed to kill two of them.  I happened to kill the cluster leader.  Now I get messages like this:\r\n\r\n    2015/04/10 15:23:49 [ERR] agent: failed to sync remote state: No cluster leader\r\n    2015/04/10 15:23:58 [WARN] dns: Query results too stale, re-requesting\r\n    2015/04/10 15:23:58 [ERR] dns: rpc error: No cluster leader\r\n    2015/04/10 15:23:58 [WARN] dns: Query results too stale, re-requesting\r\n    2015/04/10 15:23:58 [ERR] dns: rpc error: No cluster leader\r\n    2015/04/10 15:23:58 [WARN] dns: Query results too stale, re-requesting\r\n    2015/04/10 15:23:58 [ERR] dns: rpc error: No cluster leader\r\n    2015/04/10 15:23:58 [WARN] dns: Query results too stale, re-requesting\r\n    2015/04/10 15:23:58 [ERR] dns: rpc error: No cluster leader\r\n    2015/04/10 15:23:58 [WARN] dns: Query results too stale, re-requesting\r\n    2015/04/10 15:23:58 [ERR] dns: rpc error: No cluster leader\r\n\r\nOk, I figure that perhaps there's some sort of split-brain code thinking there's a problem.  I spin up two new servers (all are made from the same AMI in Amazon).  Now I have three servers all complaining.\r\n\r\n*Issue 1:* Isn't the use of Atlas supposed to fix this problem?  Wouldn't the lonely survivor talk to Atlas and realize that it should be its own cluster leader?  Shouldn't a connection to Atlas be deemed important enough and let Atlas decide who is the new cluster leader?  The old one has no connection any longer and whomever is talking to Atlas should possibly take control?\r\n\r\n*Issue 2:* When I spin up two more servers, shouldn't the group realize they're the only ones and then they should automatically bootstrap the cluster?\r\n\r\nI guess I'm really confused with how this automatic bootstrapping is supposed to work and how Atlas helps to solve the problem."},"comment":{"url":"https://api.github.com/repos/hashicorp/consul/issues/comments/91632560","html_url":"https://github.com/hashicorp/consul/issues/856#issuecomment-91632560","issue_url":"https://api.github.com/repos/hashicorp/consul/issues/856","id":91632560,"user":{"login":"fidian","id":428348,"avatar_url":"https://avatars.githubusercontent.com/u/428348?v=3","gravatar_id":"","url":"https://api.github.com/users/fidian","html_url":"https://github.com/fidian","followers_url":"https://api.github.com/users/fidian/followers","following_url":"https://api.github.com/users/fidian/following{/other_user}","gists_url":"https://api.github.com/users/fidian/gists{/gist_id}","starred_url":"https://api.github.com/users/fidian/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fidian/subscriptions","organizations_url":"https://api.github.com/users/fidian/orgs","repos_url":"https://api.github.com/users/fidian/repos","events_url":"https://api.github.com/users/fidian/events{/privacy}","received_events_url":"https://api.github.com/users/fidian/received_events","type":"User","site_admin":false},"created_at":"2015-04-10T17:39:54Z","updated_at":"2015-04-10T17:39:54Z","body":"I can understand the difficulty - thanks for the in-depth explanation!"}}