{"action":"created","issue":{"url":"https://api.github.com/repos/saltstack/salt/issues/6231","labels_url":"https://api.github.com/repos/saltstack/salt/issues/6231/labels{/name}","comments_url":"https://api.github.com/repos/saltstack/salt/issues/6231/comments","events_url":"https://api.github.com/repos/saltstack/salt/issues/6231/events","html_url":"https://github.com/saltstack/salt/issues/6231","id":16965401,"number":6231,"title":" Minion losing connection and not returning without a restart of service","user":{"login":"leonhedding","id":2034304,"avatar_url":"https://avatars.githubusercontent.com/u/2034304?v=3","gravatar_id":"","url":"https://api.github.com/users/leonhedding","html_url":"https://github.com/leonhedding","followers_url":"https://api.github.com/users/leonhedding/followers","following_url":"https://api.github.com/users/leonhedding/following{/other_user}","gists_url":"https://api.github.com/users/leonhedding/gists{/gist_id}","starred_url":"https://api.github.com/users/leonhedding/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/leonhedding/subscriptions","organizations_url":"https://api.github.com/users/leonhedding/orgs","repos_url":"https://api.github.com/users/leonhedding/repos","events_url":"https://api.github.com/users/leonhedding/events{/privacy}","received_events_url":"https://api.github.com/users/leonhedding/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/saltstack/salt/labels/Bug","name":"Bug","color":"e11d21"},{"url":"https://api.github.com/repos/saltstack/salt/labels/High%20Severity","name":"High Severity","color":"ff9143"}],"state":"closed","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/saltstack/salt/milestones/40","html_url":"https://github.com/saltstack/salt/milestones/Outstanding%20Bugs","labels_url":"https://api.github.com/repos/saltstack/salt/milestones/40/labels","id":439101,"number":40,"title":"Outstanding Bugs","description":"All non-regression bugs should go here.","creator":{"login":"basepi","id":702318,"avatar_url":"https://avatars.githubusercontent.com/u/702318?v=3","gravatar_id":"","url":"https://api.github.com/users/basepi","html_url":"https://github.com/basepi","followers_url":"https://api.github.com/users/basepi/followers","following_url":"https://api.github.com/users/basepi/following{/other_user}","gists_url":"https://api.github.com/users/basepi/gists{/gist_id}","starred_url":"https://api.github.com/users/basepi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/basepi/subscriptions","organizations_url":"https://api.github.com/users/basepi/orgs","repos_url":"https://api.github.com/users/basepi/repos","events_url":"https://api.github.com/users/basepi/events{/privacy}","received_events_url":"https://api.github.com/users/basepi/received_events","type":"User","site_admin":false},"open_issues":3,"closed_issues":592,"state":"closed","created_at":"2013-09-27T21:11:47Z","updated_at":"2014-10-10T15:44:48Z","due_on":null,"closed_at":"2014-04-21T17:27:05Z"},"comments":54,"created_at":"2013-07-19T10:28:47Z","updated_at":"2015-04-10T22:16:05Z","closed_at":"2014-04-16T17:51:08Z","body":"I did a test.ping I had handful not responding. The versions reports are below. I can also get at random times 20 clients not responding, but am not right now. I have a cron job which restarts the service on my minions ever hour. Some of these servers are on the other side of a WAN connection. I have configured a TCP keepalive of 60 seconds because of the NAT'ing for them.\r\n\r\nWhy do I keep loosing my connection with the minions?\r\n\r\nMaster on CentOS 6\r\n[root@saltstack ~]# salt --versions-report\r\n           Salt: 0.15.3\r\n         Python: 2.6.6 (r266:84292, Jul 10 2013, 22:48:45)\r\n         Jinja2: unknown\r\n       M2Crypto: 0.20.2\r\n msgpack-python: 0.1.13\r\n   msgpack-pure: Not Installed\r\n       pycrypto: 2.0.1\r\n         PyYAML: 3.10\r\n          PyZMQ: 2.2.0.1\r\n            ZMQ: 3.2.3\r\n[root@saltstack ~]# cat /etc/redhat-release\r\nCentOS release 6.4 (Final)\r\n[root@saltstack ~]#\r\n\r\n\r\nCentOS 6.4 Minion\r\nSalt: 0.15.3\r\nPython: 2.6.6 (r266:84292, Feb 21 2013, 23:54:59)\r\nJinja2: unknown\r\nM2Crypto: 0.20.2\r\nmsgpack-python: 0.1.13\r\nmsgpack-pure: Not Installed\r\npycrypto: 2.0.1\r\nPyYAML: 3.10\r\nPyZMQ: 2.2.0.1\r\nZMQ: 3.2.3\r\n\r\nCentOS 6.4 Minion\r\nSalt: 0.15.3\r\nPython: 2.6.6 (r266:84292, Feb 22 2013, 00:00:18)\r\nJinja2: 2.2.1\r\nM2Crypto: 0.20.2\r\nmsgpack-python: 0.1.13\r\nmsgpack-pure: Not Installed\r\npycrypto: 2.0.1\r\nPyYAML: 3.10\r\nPyZMQ: 2.2.0.1\r\nZMQ: 3.2.3\r\n\r\nCentOS release 5.9 (Final)\r\n           Salt: 0.15.3\r\n         Python: 2.6.8 (unknown, Nov  7 2012, 14:47:34)\r\n         Jinja2: unknown\r\n       M2Crypto: 0.21.1\r\n msgpack-python: 0.1.12\r\n   msgpack-pure: Not Installed\r\n       pycrypto: 2.3\r\n         PyYAML: 3.08\r\n          PyZMQ: 2.1.9\r\n            ZMQ: 2.1.9\r\n\r\n\r\nWindows 2008 R2 64-bit Minion\r\nSalt: 0.16.0\r\nPython: 2.7.3 (default, Apr 10 2012, 23:24:47) [MSC v.1500 64 bit (AMD64)]\r\nJinja2: 2.6\r\nM2Crypto: 0.21.1\r\nmsgpack-python: 0.1.12\r\nmsgpack-pure: Not Installed\r\npycrypto: 2.3\r\nPyYAML: 3.10\r\nPyZMQ: 13.1.0\r\nZMQ: 3.2.2"},"comment":{"url":"https://api.github.com/repos/saltstack/salt/issues/comments/91706674","html_url":"https://github.com/saltstack/salt/issues/6231#issuecomment-91706674","issue_url":"https://api.github.com/repos/saltstack/salt/issues/6231","id":91706674,"user":{"login":"yytsui","id":6809335,"avatar_url":"https://avatars.githubusercontent.com/u/6809335?v=3","gravatar_id":"","url":"https://api.github.com/users/yytsui","html_url":"https://github.com/yytsui","followers_url":"https://api.github.com/users/yytsui/followers","following_url":"https://api.github.com/users/yytsui/following{/other_user}","gists_url":"https://api.github.com/users/yytsui/gists{/gist_id}","starred_url":"https://api.github.com/users/yytsui/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yytsui/subscriptions","organizations_url":"https://api.github.com/users/yytsui/orgs","repos_url":"https://api.github.com/users/yytsui/repos","events_url":"https://api.github.com/users/yytsui/events{/privacy}","received_events_url":"https://api.github.com/users/yytsui/received_events","type":"User","site_admin":false},"created_at":"2015-04-10T22:16:05Z","updated_at":"2015-04-10T22:16:05Z","body":"In my settings, I have 10 minions and a master ubuntu 12.04 instance on Azure. The connections are not stable. Sometimes some of the minions can reconnect after I restart the salt-minion service, but then they\r\nwill lost connections soon...like less than 5 minutes. Here are the versions report:\r\n=========================\r\n$ salt-minion --versions-report\r\n                  Salt: 2014.7.2\r\n                Python: 2.7.3 (default, Dec 18 2014, 19:10:20)\r\n                Jinja2: 2.6\r\n              M2Crypto: 0.21.1\r\n        msgpack-python: 0.1.10\r\n          msgpack-pure: Not Installed\r\n              pycrypto: 2.4.1\r\n               libnacl: Not Installed\r\n                PyYAML: 3.10\r\n                 ioflo: Not Installed\r\n                 PyZMQ: 14.5.0\r\n                  RAET: Not Installed\r\n                   ZMQ: 4.0.5\r\n                  Mako: Not Installed\r\n Debian source package: 2014.7.2+ds-1precise2\r\n==============================\r\non master \r\n$ sudo salt --versions-report\r\n                  Salt: 2014.7.2\r\n                Python: 2.7.3 (default, Dec 18 2014, 19:10:20)\r\n                Jinja2: 2.6\r\n              M2Crypto: 0.21.1\r\n        msgpack-python: 0.1.10\r\n          msgpack-pure: Not Installed\r\n              pycrypto: 2.6.1\r\n               libnacl: Not Installed\r\n                PyYAML: 3.10\r\n                 ioflo: Not Installed\r\n                 PyZMQ: 14.5.0\r\n                  RAET: Not Installed\r\n                   ZMQ: 4.0.5\r\n                  Mako: Not Installed\r\n Debian source package: 2014.7.2+ds-1precise2\r\n=======================================\r\nThe 10 minions were created by salt-cloud with map file.\r\nI have to manual upgrade them from ZMQ2 to ZMQ4.\r\nNot sure if is a Azure related issue? any thing else I can try or any other useful information I can help to provide?\r\n"}}