{"action":"created","issue":{"url":"https://api.github.com/repos/projectcalico/calico/issues/815","labels_url":"https://api.github.com/repos/projectcalico/calico/issues/815/labels{/name}","comments_url":"https://api.github.com/repos/projectcalico/calico/issues/815/comments","events_url":"https://api.github.com/repos/projectcalico/calico/issues/815/events","html_url":"https://github.com/projectcalico/calico/issues/815","id":106751071,"number":815,"title":"Exception hit intermittently when deleting VMs","user":{"login":"lwr20","id":2923811,"avatar_url":"https://avatars.githubusercontent.com/u/2923811?v=3","gravatar_id":"","url":"https://api.github.com/users/lwr20","html_url":"https://github.com/lwr20","followers_url":"https://api.github.com/users/lwr20/followers","following_url":"https://api.github.com/users/lwr20/following{/other_user}","gists_url":"https://api.github.com/users/lwr20/gists{/gist_id}","starred_url":"https://api.github.com/users/lwr20/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lwr20/subscriptions","organizations_url":"https://api.github.com/users/lwr20/orgs","repos_url":"https://api.github.com/users/lwr20/repos","events_url":"https://api.github.com/users/lwr20/events{/privacy}","received_events_url":"https://api.github.com/users/lwr20/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/projectcalico/calico/labels/bug","name":"bug","color":"fc2929"},{"url":"https://api.github.com/repos/projectcalico/calico/labels/low%20priority","name":"low priority","color":"bfe5bf"},{"url":"https://api.github.com/repos/projectcalico/calico/labels/neutron%20driver","name":"neutron driver","color":"009800"}],"state":"open","locked":false,"assignee":{"login":"lwr20","id":2923811,"avatar_url":"https://avatars.githubusercontent.com/u/2923811?v=3","gravatar_id":"","url":"https://api.github.com/users/lwr20","html_url":"https://github.com/lwr20","followers_url":"https://api.github.com/users/lwr20/followers","following_url":"https://api.github.com/users/lwr20/following{/other_user}","gists_url":"https://api.github.com/users/lwr20/gists{/gist_id}","starred_url":"https://api.github.com/users/lwr20/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lwr20/subscriptions","organizations_url":"https://api.github.com/users/lwr20/orgs","repos_url":"https://api.github.com/users/lwr20/repos","events_url":"https://api.github.com/users/lwr20/events{/privacy}","received_events_url":"https://api.github.com/users/lwr20/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/projectcalico/calico/milestones/18","html_url":"https://github.com/projectcalico/calico/milestones/1.2.0","labels_url":"https://api.github.com/repos/projectcalico/calico/milestones/18/labels","id":1297741,"number":18,"title":"1.2.0","description":"","creator":{"login":"fasaxc","id":469264,"avatar_url":"https://avatars.githubusercontent.com/u/469264?v=3","gravatar_id":"","url":"https://api.github.com/users/fasaxc","html_url":"https://github.com/fasaxc","followers_url":"https://api.github.com/users/fasaxc/followers","following_url":"https://api.github.com/users/fasaxc/following{/other_user}","gists_url":"https://api.github.com/users/fasaxc/gists{/gist_id}","starred_url":"https://api.github.com/users/fasaxc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fasaxc/subscriptions","organizations_url":"https://api.github.com/users/fasaxc/orgs","repos_url":"https://api.github.com/users/fasaxc/repos","events_url":"https://api.github.com/users/fasaxc/events{/privacy}","received_events_url":"https://api.github.com/users/fasaxc/received_events","type":"User","site_admin":false},"open_issues":9,"closed_issues":5,"state":"open","created_at":"2015-09-09T13:55:31Z","updated_at":"2015-09-29T08:11:18Z","due_on":null,"closed_at":null},"comments":2,"created_at":"2015-09-16T11:07:54Z","updated_at":"2015-09-30T14:23:55Z","closed_at":null,"body":"Sometimes when I delete a VM, I see this exception:\r\n\r\ncalico.openstack.t_etcd [-] Request to etcd failed. This will cause the current API call to fail.\r\ncalico.openstack.t_etcd Traceback (most recent call last):\r\ncalico.openstack.t_etcd   File \"/usr/lib/python2.7/dist-packages/calico/openstack/t_etcd.py\", line 106, in wrapped\r\ncalico.openstack.t_etcd     return fn(self, *args, **kwargs)\r\ncalico.openstack.t_etcd   File \"/usr/lib/python2.7/dist-packages/calico/openstack/t_etcd.py\", line 293, in get_endpoint_data\r\ncalico.openstack.t_etcd     result = self.client.read(endpoint.key, timeout=ETCD_TIMEOUT)\r\ncalico.openstack.t_etcd   File \"/usr/lib/python2.7/dist-packages/etcd/client.py\", line 356, in read\r\ncalico.openstack.t_etcd     timeout=timeout)\r\ncalico.openstack.t_etcd   File \"/usr/lib/python2.7/dist-packages/etcd/client.py\", line 612, in api_execute\r\ncalico.openstack.t_etcd     return self._handle_server_response(response)\r\ncalico.openstack.t_etcd   File \"/usr/lib/python2.7/dist-packages/etcd/client.py\", line 643, in _handle_server_response\r\ncalico.openstack.t_etcd     etcd.EtcdError.handle(**r)\r\ncalico.openstack.t_etcd   File \"/usr/lib/python2.7/dist-packages/etcd/__init__.py\", line 193, in handle\r\ncalico.openstack.t_etcd     raise exc(msg, payload)\r\ncalico.openstack.t_etcd EtcdKeyNotFound: Key not found : /calico/v1/host/calico-st04/workload/openstack/42916f9b-ec59-448b-8848-5f03a964244f\r\ncalico.openstack.t_etcd\r\n\r\nSeems benign, but its obviously log spam."},"comment":{"url":"https://api.github.com/repos/projectcalico/calico/issues/comments/144428119","html_url":"https://github.com/projectcalico/calico/issues/815#issuecomment-144428119","issue_url":"https://api.github.com/repos/projectcalico/calico/issues/815","id":144428119,"user":{"login":"fasaxc","id":469264,"avatar_url":"https://avatars.githubusercontent.com/u/469264?v=3","gravatar_id":"","url":"https://api.github.com/users/fasaxc","html_url":"https://github.com/fasaxc","followers_url":"https://api.github.com/users/fasaxc/followers","following_url":"https://api.github.com/users/fasaxc/following{/other_user}","gists_url":"https://api.github.com/users/fasaxc/gists{/gist_id}","starred_url":"https://api.github.com/users/fasaxc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fasaxc/subscriptions","organizations_url":"https://api.github.com/users/fasaxc/orgs","repos_url":"https://api.github.com/users/fasaxc/repos","events_url":"https://api.github.com/users/fasaxc/events{/privacy}","received_events_url":"https://api.github.com/users/fasaxc/received_events","type":"User","site_admin":false},"created_at":"2015-09-30T14:23:55Z","updated_at":"2015-09-30T14:23:55Z","body":"@lwr20 I rolled a fix for this into the PR above, please can you keep an eye out.  It was always log spam; the exception was caught at one level higher up the stack but by then it had already been logged.\r\n\r\nYou should now get a warning log: \"Expected etcd error, re-raising\" instead."}}