{"action":"created","issue":{"url":"https://api.github.com/repos/saltstack/salt/issues/26073","labels_url":"https://api.github.com/repos/saltstack/salt/issues/26073/labels{/name}","comments_url":"https://api.github.com/repos/saltstack/salt/issues/26073/comments","events_url":"https://api.github.com/repos/saltstack/salt/issues/26073/events","html_url":"https://github.com/saltstack/salt/issues/26073","id":99507527,"number":26073,"title":"Timeout gets reset by event on the bus on 2015.5.3","user":{"login":"JaseFace","id":6116767,"avatar_url":"https://avatars.githubusercontent.com/u/6116767?v=3","gravatar_id":"","url":"https://api.github.com/users/JaseFace","html_url":"https://github.com/JaseFace","followers_url":"https://api.github.com/users/JaseFace/followers","following_url":"https://api.github.com/users/JaseFace/following{/other_user}","gists_url":"https://api.github.com/users/JaseFace/gists{/gist_id}","starred_url":"https://api.github.com/users/JaseFace/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JaseFace/subscriptions","organizations_url":"https://api.github.com/users/JaseFace/orgs","repos_url":"https://api.github.com/users/JaseFace/repos","events_url":"https://api.github.com/users/JaseFace/events{/privacy}","received_events_url":"https://api.github.com/users/JaseFace/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/saltstack/salt/labels/Bug","name":"Bug","color":"e11d21"},{"url":"https://api.github.com/repos/saltstack/salt/labels/Cannot%20Reproduce","name":"Cannot Reproduce","color":"c7def8"},{"url":"https://api.github.com/repos/saltstack/salt/labels/Core","name":"Core","color":"fef2c0"},{"url":"https://api.github.com/repos/saltstack/salt/labels/High%20Severity","name":"High Severity","color":"ff9143"},{"url":"https://api.github.com/repos/saltstack/salt/labels/P3","name":"P3","color":"0a3d77"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/saltstack/salt/milestones/37","html_url":"https://github.com/saltstack/salt/milestones/Blocked","labels_url":"https://api.github.com/repos/saltstack/salt/milestones/37/labels","id":343741,"number":37,"title":"Blocked","description":"Issues which are blocked in some way, whether they need further discussion, clarification, justification, or are blocked for some other reason.","creator":{"login":"basepi","id":702318,"avatar_url":"https://avatars.githubusercontent.com/u/702318?v=3","gravatar_id":"","url":"https://api.github.com/users/basepi","html_url":"https://github.com/basepi","followers_url":"https://api.github.com/users/basepi/followers","following_url":"https://api.github.com/users/basepi/following{/other_user}","gists_url":"https://api.github.com/users/basepi/gists{/gist_id}","starred_url":"https://api.github.com/users/basepi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/basepi/subscriptions","organizations_url":"https://api.github.com/users/basepi/orgs","repos_url":"https://api.github.com/users/basepi/repos","events_url":"https://api.github.com/users/basepi/events{/privacy}","received_events_url":"https://api.github.com/users/basepi/received_events","type":"User","site_admin":false},"open_issues":271,"closed_issues":610,"state":"open","created_at":"2013-05-28T22:24:12Z","updated_at":"2015-08-10T17:01:22Z","due_on":null,"closed_at":null},"comments":3,"created_at":"2015-08-06T19:28:50Z","updated_at":"2015-08-10T20:25:00Z","closed_at":null,"body":"For some reason when the timeout is set too high on salt commands, it never timesout on unconnected or not responding minions.  When the timeout is low it properly drops, but it seems above ~13 seconds or so in our setup causes it to never fail.  I've let jobs run overnight, and they continually send the jid check event, while no further minions are returning:\r\n\r\n```\r\n[DEBUG   ] MasterEvent PUB socket URI: ipc:///var/run/salt/master/master_event_pub.ipc\r\n[DEBUG   ] MasterEvent PULL socket URI: ipc:///var/run/salt/master/master_event_pull.ipc\r\n[DEBUG   ] Sending event - data = {'_stamp': '2015-08-06T19:24:56.930262'}\r\n[DEBUG   ] Checking whether jid 20150806122354756801 is still running\r\n```\r\n\r\nIs it possible this event is actually resetting the timeout?\r\n\r\n```\r\n                  Salt: 2015.5.3\r\n                Python: 2.7.6 (default, Mar 22 2014, 22:59:56)\r\n                Jinja2: 2.7.2\r\n              M2Crypto: 0.21.1\r\n        msgpack-python: 0.3.0\r\n          msgpack-pure: Not Installed\r\n              pycrypto: 2.6.1\r\n               libnacl: Not Installed\r\n                PyYAML: 3.10\r\n                 ioflo: Not Installed\r\n                 PyZMQ: 14.0.1\r\n                  RAET: Not Installed\r\n                   ZMQ: 4.0.4\r\n                  Mako: 0.9.1\r\n               Tornado: Not Installed\r\n Debian source package: 2015.5.3+ds-1trusty1\r\n```\r\n\r\nTalking with others in #salt, it doesn't sound like anyone else has hit this.  All minions are also 2015.5.3.  Has anyone else seen this?  The relevant bits of our simple master config:\r\n\r\n```\r\ncon_cache: True\r\nfile_buffer_size: 10486750\r\nstate_output: mixed\r\ntimeout: 15\r\norder_masters: True\r\npillar_opts: False\r\nstate_aggregate: True\r\nstate_verbose: False\r\ncachedir: /opt/cache/salt/master\r\nworker_threads: 20\r\n```"},"comment":{"url":"https://api.github.com/repos/saltstack/salt/issues/comments/129595945","html_url":"https://github.com/saltstack/salt/issues/26073#issuecomment-129595945","issue_url":"https://api.github.com/repos/saltstack/salt/issues/26073","id":129595945,"user":{"login":"jfindlay","id":702905,"avatar_url":"https://avatars.githubusercontent.com/u/702905?v=3","gravatar_id":"","url":"https://api.github.com/users/jfindlay","html_url":"https://github.com/jfindlay","followers_url":"https://api.github.com/users/jfindlay/followers","following_url":"https://api.github.com/users/jfindlay/following{/other_user}","gists_url":"https://api.github.com/users/jfindlay/gists{/gist_id}","starred_url":"https://api.github.com/users/jfindlay/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jfindlay/subscriptions","organizations_url":"https://api.github.com/users/jfindlay/orgs","repos_url":"https://api.github.com/users/jfindlay/repos","events_url":"https://api.github.com/users/jfindlay/events{/privacy}","received_events_url":"https://api.github.com/users/jfindlay/received_events","type":"User","site_admin":false},"created_at":"2015-08-10T20:25:00Z","updated_at":"2015-08-10T20:25:00Z","body":"@JaseFace, those are good points.  There is something going on here that we need to track down, thanks."}}