{"action":"created","issue":{"url":"https://api.github.com/repos/saltstack/salt/issues/26600","labels_url":"https://api.github.com/repos/saltstack/salt/issues/26600/labels{/name}","comments_url":"https://api.github.com/repos/saltstack/salt/issues/26600/comments","events_url":"https://api.github.com/repos/saltstack/salt/issues/26600/events","html_url":"https://github.com/saltstack/salt/issues/26600","id":102678534,"number":26600,"title":"random salt-call authentication error","user":{"login":"soodr","id":1273518,"avatar_url":"https://avatars.githubusercontent.com/u/1273518?v=3","gravatar_id":"","url":"https://api.github.com/users/soodr","html_url":"https://github.com/soodr","followers_url":"https://api.github.com/users/soodr/followers","following_url":"https://api.github.com/users/soodr/following{/other_user}","gists_url":"https://api.github.com/users/soodr/gists{/gist_id}","starred_url":"https://api.github.com/users/soodr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/soodr/subscriptions","organizations_url":"https://api.github.com/users/soodr/orgs","repos_url":"https://api.github.com/users/soodr/repos","events_url":"https://api.github.com/users/soodr/events{/privacy}","received_events_url":"https://api.github.com/users/soodr/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/saltstack/salt/labels/Info%20Needed","name":"Info Needed","color":"c7def8"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/saltstack/salt/milestones/37","html_url":"https://github.com/saltstack/salt/milestones/Blocked","labels_url":"https://api.github.com/repos/saltstack/salt/milestones/37/labels","id":343741,"number":37,"title":"Blocked","description":"Issues which are blocked in some way, whether they need further discussion, clarification, justification, or are blocked for some other reason.","creator":{"login":"basepi","id":702318,"avatar_url":"https://avatars.githubusercontent.com/u/702318?v=3","gravatar_id":"","url":"https://api.github.com/users/basepi","html_url":"https://github.com/basepi","followers_url":"https://api.github.com/users/basepi/followers","following_url":"https://api.github.com/users/basepi/following{/other_user}","gists_url":"https://api.github.com/users/basepi/gists{/gist_id}","starred_url":"https://api.github.com/users/basepi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/basepi/subscriptions","organizations_url":"https://api.github.com/users/basepi/orgs","repos_url":"https://api.github.com/users/basepi/repos","events_url":"https://api.github.com/users/basepi/events{/privacy}","received_events_url":"https://api.github.com/users/basepi/received_events","type":"User","site_admin":false},"open_issues":274,"closed_issues":631,"state":"open","created_at":"2013-05-28T22:24:12Z","updated_at":"2015-08-28T18:58:34Z","due_on":null,"closed_at":null},"comments":4,"created_at":"2015-08-24T00:47:52Z","updated_at":"2015-08-28T19:20:06Z","closed_at":null,"body":"Getting the following stack trace with a salt-call or salt * on master with an authenticated minion. The error is random.\r\nThe Salt master needs to be restarted to fix it.\r\n\r\nMinion :\r\n```yaml\r\n           Salt: 2015.5.1\r\n         Python: 2.7.8 (default, Jun 30 2014, 16:08:48) [MSC v.1500 64 bit (AMD64)]\r\n         Jinja2: 2.7.3\r\n       M2Crypto: 0.21.1\r\n msgpack-python: 0.4.5\r\n   msgpack-pure: Not Installed\r\n       pycrypto: 2.6\r\n        libnacl: Not Installed\r\n         PyYAML: 3.11\r\n          ioflo: Not Installed\r\n          PyZMQ: 14.6.0\r\n           RAET: Not Installed\r\n            ZMQ: 4.0.5\r\n           Mako: Not Installed\r\n```\r\nStack Trace :\r\n```python-traceback\r\nC:\\Users\\Administrator>c:\\salt\\salt-call.bat state.sls newrelic\r\n[ERROR   ] Got a bad pillar from master, type NoneType, expecting dict: None\r\n[ERROR   ] An un-handled exception was caught by salt's global exception handler\r\n:\r\nAuthenticationError: message authentication failed\r\nTraceback (most recent call last):\r\n  File \"c:\\salt\\bin\\Scripts\\salt-call\", line 11, in <module>\r\n    salt_call()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\scripts.py\", line 227, in salt_call\r\n    client.run()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\cli\\call.py\", line 69, in run\r\n    caller.run()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\cli\\caller.py\", line 236, in run\r\n    ret = self.call()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\cli\\caller.py\", line 138, in call\r\n    ret['return'] = func(*args, **kwargs)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\modules\\state.py\", line 645, in sls\r\n    st_ = salt.state.HighState(opts, pillar, kwargs.get('__pub_jid'))\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\state.py\", line 3028, in __init__\r\n    BaseHighState.__init__(self, opts)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\state.py\", line 2206, in __init__\r\n    self.opts = self.__gen_opts(opts)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\state.py\", line 2233, in __gen_opts\r\n    mopts = self.client.master_opts()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\fileclient.py\", line 1193, in master_\r\nopts\r\n    return self.channel.send(load)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\transport\\__init__.py\", line 314, in\r\nsend\r\n    return self._crypted_transfer(load, tries, timeout)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\transport\\__init__.py\", line 305, in\r\n_crypted_transfer\r\n    return _do_transfer()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\transport\\__init__.py\", line 299, in\r\n_do_transfer\r\n    data = self.auth.crypticle.loads(data)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\crypt.py\", line 841, in loads\r\n    data = self.decrypt(data)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\crypt.py\", line 818, in decrypt\r\n    raise AuthenticationError('message authentication failed')\r\nAuthenticationError: message authentication failed\r\nTraceback (most recent call last):\r\n  File \"c:\\salt\\bin\\Scripts\\salt-call\", line 11, in <module>\r\n    salt_call()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\scripts.py\", line 227, in salt_call\r\n    client.run()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\cli\\call.py\", line 69, in run\r\n    caller.run()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\cli\\caller.py\", line 236, in run\r\n    ret = self.call()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\cli\\caller.py\", line 138, in call\r\n    ret['return'] = func(*args, **kwargs)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\modules\\state.py\", line 645, in sls\r\n    st_ = salt.state.HighState(opts, pillar, kwargs.get('__pub_jid'))\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\state.py\", line 3028, in __init__\r\n    BaseHighState.__init__(self, opts)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\state.py\", line 2206, in __init__\r\n    self.opts = self.__gen_opts(opts)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\state.py\", line 2233, in __gen_opts\r\n    mopts = self.client.master_opts()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\fileclient.py\", line 1193, in master_\r\nopts\r\n    return self.channel.send(load)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\transport\\__init__.py\", line 314, in\r\nsend\r\n    return self._crypted_transfer(load, tries, timeout)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\transport\\__init__.py\", line 305, in\r\n_crypted_transfer\r\n    return _do_transfer()\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\transport\\__init__.py\", line 299, in\r\n_do_transfer\r\n    data = self.auth.crypticle.loads(data)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\crypt.py\", line 841, in loads\r\n    data = self.decrypt(data)\r\n  File \"c:\\salt\\bin\\lib\\site-packages\\salt\\crypt.py\", line 818, in decrypt\r\n    raise AuthenticationError('message authentication failed')\r\nsalt.exceptions.AuthenticationError: message authentication failed\r\n```\r\nMaster :\r\n```yaml\r\n           Salt: 2015.2.0rc1\r\n         Python: 2.7.8 (default, Sep 24 2014, 11:50:00)\r\n         Jinja2: 2.7.3\r\n       M2Crypto: 0.22\r\n msgpack-python: 0.4.6\r\n   msgpack-pure: Not Installed\r\n       pycrypto: 2.6.1\r\n        libnacl: 1.4.2\r\n         PyYAML: 3.11\r\n          ioflo: 1.2.1\r\n          PyZMQ: 14.5.0\r\n           RAET: 0.6.3\r\n            ZMQ: 4.0.5\r\n           Mako: 1.0.0\r\n```"},"comment":{"url":"https://api.github.com/repos/saltstack/salt/issues/comments/135865067","html_url":"https://github.com/saltstack/salt/issues/26600#issuecomment-135865067","issue_url":"https://api.github.com/repos/saltstack/salt/issues/26600","id":135865067,"user":{"login":"jfindlay","id":702905,"avatar_url":"https://avatars.githubusercontent.com/u/702905?v=3","gravatar_id":"","url":"https://api.github.com/users/jfindlay","html_url":"https://github.com/jfindlay","followers_url":"https://api.github.com/users/jfindlay/followers","following_url":"https://api.github.com/users/jfindlay/following{/other_user}","gists_url":"https://api.github.com/users/jfindlay/gists{/gist_id}","starred_url":"https://api.github.com/users/jfindlay/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jfindlay/subscriptions","organizations_url":"https://api.github.com/users/jfindlay/orgs","repos_url":"https://api.github.com/users/jfindlay/repos","events_url":"https://api.github.com/users/jfindlay/events{/privacy}","received_events_url":"https://api.github.com/users/jfindlay/received_events","type":"User","site_admin":false},"created_at":"2015-08-28T19:20:06Z","updated_at":"2015-08-28T19:20:06Z","body":"@soodr, thanks for the extra info.  Is there more context to the log statements you posted, like a python traceback?"}}