{"action":"created","issue":{"url":"https://api.github.com/repos/saltstack/salt/issues/16432","labels_url":"https://api.github.com/repos/saltstack/salt/issues/16432/labels{/name}","comments_url":"https://api.github.com/repos/saltstack/salt/issues/16432/comments","events_url":"https://api.github.com/repos/saltstack/salt/issues/16432/events","html_url":"https://github.com/saltstack/salt/issues/16432","id":45118248,"number":16432,"title":"Minions hanging on highstate forever","user":{"login":"Jille","id":460628,"avatar_url":"https://avatars.githubusercontent.com/u/460628?v=3","gravatar_id":"","url":"https://api.github.com/users/Jille","html_url":"https://github.com/Jille","followers_url":"https://api.github.com/users/Jille/followers","following_url":"https://api.github.com/users/Jille/following{/other_user}","gists_url":"https://api.github.com/users/Jille/gists{/gist_id}","starred_url":"https://api.github.com/users/Jille/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Jille/subscriptions","organizations_url":"https://api.github.com/users/Jille/orgs","repos_url":"https://api.github.com/users/Jille/repos","events_url":"https://api.github.com/users/Jille/events{/privacy}","received_events_url":"https://api.github.com/users/Jille/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/saltstack/salt/labels/Bug","name":"Bug","color":"e11d21"},{"url":"https://api.github.com/repos/saltstack/salt/labels/Medium+Severity","name":"Medium Severity","color":"fad8c7"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/saltstack/salt/milestones/13","labels_url":"https://api.github.com/repos/saltstack/salt/milestones/13/labels","id":9265,"number":13,"title":"Approved","description":"All issues that are ready to be worked on, both bugs and features.","creator":{"login":"thatch45","id":507599,"avatar_url":"https://avatars.githubusercontent.com/u/507599?v=3","gravatar_id":"","url":"https://api.github.com/users/thatch45","html_url":"https://github.com/thatch45","followers_url":"https://api.github.com/users/thatch45/followers","following_url":"https://api.github.com/users/thatch45/following{/other_user}","gists_url":"https://api.github.com/users/thatch45/gists{/gist_id}","starred_url":"https://api.github.com/users/thatch45/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thatch45/subscriptions","organizations_url":"https://api.github.com/users/thatch45/orgs","repos_url":"https://api.github.com/users/thatch45/repos","events_url":"https://api.github.com/users/thatch45/events{/privacy}","received_events_url":"https://api.github.com/users/thatch45/received_events","type":"User","site_admin":false},"open_issues":1786,"closed_issues":1345,"state":"open","created_at":"2011-05-14T04:00:56Z","updated_at":"2015-01-02T16:42:46Z","due_on":null,"closed_at":null},"comments":23,"created_at":"2014-10-07T15:04:25Z","updated_at":"2015-01-04T04:21:20Z","closed_at":null,"body":"My system runs a lot of test-highstates to check whether there are any changes made to the system bypassing salt. Since a week or something they sometimes hang. Running another (test-)highstate gives:\r\n```\r\n    Data failed to compile:\r\n----------\r\n    The function \"state.highstate\" is running as PID 18861 and was started at 2014, Oct 06 10:49:30.897978 with jid 20141006104930897978\r\n```\r\n\r\nstrace tells me this, looping forever seemingly without doing anything else:\r\n```\r\nopen(\"/dev/urandom\", O_RDONLY)          = 30\r\nread(30, \"[16 random bytes]\", 16) = 16\r\nclose(30)                               = 0\r\npoll([{fd=28, events=POLLIN}], 1, 0)    = 0 (Timeout)\r\nwrite(26, \"\\1\\0\\0\\0\\0\\0\\0\\0\", 8)        = 8\r\npoll([{fd=28, events=POLLIN}], 1, 0)    = 0 (Timeout)\r\npoll([{fd=28, events=POLLIN}], 1, 0)    = 0 (Timeout)\r\npoll([{fd=28, events=POLLIN}], 1, 60000) = 1 ([{fd=28, revents=POLLIN}])\r\npoll([{fd=28, events=POLLIN}], 1, 0)    = 1 ([{fd=28, revents=POLLIN}])\r\nread(28, \"\\1\\0\\0\\0\\0\\0\\0\\0\", 8)         = 8\r\npoll([{fd=28, events=POLLIN}], 1, 0)    = 0 (Timeout)\r\nselect(0, NULL, NULL, NULL, {0, 20000}) = 0 (Timeout)\r\n```\r\n\r\nI'm using our own compiled version of 2014.7.0rc1 (git revision 20f2334 to be exact). If updating to rc2 would help I'm willing to do so.\r\n```\r\n           Salt: 2014.7.0\r\n         Python: 2.7.3 (default, Feb 27 2014, 19:58:35)\r\n         Jinja2: 2.6\r\n       M2Crypto: 0.21.1\r\n msgpack-python: 0.1.10\r\n   msgpack-pure: Not Installed\r\n       pycrypto: 2.4.1\r\n        libnacl: Not Installed\r\n         PyYAML: 3.10\r\n          ioflo: Not Installed\r\n          PyZMQ: 13.0.0\r\n           RAET: Not Installed\r\n            ZMQ: 3.2.2\r\n           Mako: Not Installed\r\n```\r\n\r\n(I've got the feeling I've opened this issue before, but I might've forgotten to hit Submit due to being distracted and/or trying to win some more information.)"},"comment":{"url":"https://api.github.com/repos/saltstack/salt/issues/comments/68620534","html_url":"https://github.com/saltstack/salt/issues/16432#issuecomment-68620534","issue_url":"https://api.github.com/repos/saltstack/salt/issues/16432","id":68620534,"user":{"login":"wt","id":416255,"avatar_url":"https://avatars.githubusercontent.com/u/416255?v=3","gravatar_id":"","url":"https://api.github.com/users/wt","html_url":"https://github.com/wt","followers_url":"https://api.github.com/users/wt/followers","following_url":"https://api.github.com/users/wt/following{/other_user}","gists_url":"https://api.github.com/users/wt/gists{/gist_id}","starred_url":"https://api.github.com/users/wt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wt/subscriptions","organizations_url":"https://api.github.com/users/wt/orgs","repos_url":"https://api.github.com/users/wt/repos","events_url":"https://api.github.com/users/wt/events{/privacy}","received_events_url":"https://api.github.com/users/wt/received_events","type":"User","site_admin":false},"created_at":"2015-01-04T04:21:20Z","updated_at":"2015-01-04T04:21:20Z","body":"After a few more days, I can say that minions are hanging much, much, much less often. However they are still hanging. I have around 200 minions and at least 3 or 4 are hanging each hour. Without the change to the master, that number was significantly higher."}}