{"action":"created","issue":{"url":"https://api.github.com/repos/shipyard/shipyard/issues/644","labels_url":"https://api.github.com/repos/shipyard/shipyard/issues/644/labels{/name}","comments_url":"https://api.github.com/repos/shipyard/shipyard/issues/644/comments","events_url":"https://api.github.com/repos/shipyard/shipyard/issues/644/events","html_url":"https://github.com/shipyard/shipyard/issues/644","id":112671599,"number":644,"title":"Controller loses shipyard-swarm-manager","user":{"login":"djskinner","id":2514172,"avatar_url":"https://avatars.githubusercontent.com/u/2514172?v=3","gravatar_id":"","url":"https://api.github.com/users/djskinner","html_url":"https://github.com/djskinner","followers_url":"https://api.github.com/users/djskinner/followers","following_url":"https://api.github.com/users/djskinner/following{/other_user}","gists_url":"https://api.github.com/users/djskinner/gists{/gist_id}","starred_url":"https://api.github.com/users/djskinner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/djskinner/subscriptions","organizations_url":"https://api.github.com/users/djskinner/orgs","repos_url":"https://api.github.com/users/djskinner/repos","events_url":"https://api.github.com/users/djskinner/events{/privacy}","received_events_url":"https://api.github.com/users/djskinner/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/shipyard/shipyard/labels/swarm","name":"swarm","color":"c7def8"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-10-21T20:23:21Z","updated_at":"2015-12-13T04:47:53Z","closed_at":null,"body":"Hi,\r\n\r\nAfter having got Shipyard up and running with the automated deploy script I have been really impressed. However, after a few hours of running I am coming across an issue whereby the containers disappear from the list and the web UI is showing a loading spinner that never stops and nothing else happens. The controller itself isn't broken because I can load up a new tab, login etc.\r\n\r\nI've removed and reinstalled the whole thing which solves the issue but after a few hours it happens again.\r\n\r\nThere's nothing of interest in the container logs and I'm not sure what to consider next. Any ideas?\r\n\r\nThanks."},"comment":{"url":"https://api.github.com/repos/shipyard/shipyard/issues/comments/164223245","html_url":"https://github.com/shipyard/shipyard/issues/644#issuecomment-164223245","issue_url":"https://api.github.com/repos/shipyard/shipyard/issues/644","id":164223245,"user":{"login":"ephemeraleclipse","id":2537445,"avatar_url":"https://avatars.githubusercontent.com/u/2537445?v=3","gravatar_id":"","url":"https://api.github.com/users/ephemeraleclipse","html_url":"https://github.com/ephemeraleclipse","followers_url":"https://api.github.com/users/ephemeraleclipse/followers","following_url":"https://api.github.com/users/ephemeraleclipse/following{/other_user}","gists_url":"https://api.github.com/users/ephemeraleclipse/gists{/gist_id}","starred_url":"https://api.github.com/users/ephemeraleclipse/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ephemeraleclipse/subscriptions","organizations_url":"https://api.github.com/users/ephemeraleclipse/orgs","repos_url":"https://api.github.com/users/ephemeraleclipse/repos","events_url":"https://api.github.com/users/ephemeraleclipse/events{/privacy}","received_events_url":"https://api.github.com/users/ephemeraleclipse/received_events","type":"User","site_admin":false},"created_at":"2015-12-13T04:47:53Z","updated_at":"2015-12-13T04:47:53Z","body":"INFO[0000] shipyard version 3.0.2\r\nINFO[0000] checking database\r\nDEBU[0032] connected to docker: url=tcp://swarm:3375\r\nDEBU[0032] configured docker proxy target: http://swarm:3375\r\nINFO[0032] created admin user: username: admin password: shipyard\r\nINFO[0032] controller listening on :8080\r\nWARN[0122] unauthorized request for /containers/json from {{IP Redacted}}:2526\r\nDEBU[0125] GET: /containers/json?all=1\r\nDEBU[0130] GET: /api/accounts\r\nDEBU[0130] GET: /api/roles\r\nDEBU[0131] GET: /api/accounts/admin\r\nDEBU[0134] POST: /api/accounts\r\nDEBU[0134] updated account: name=admin\r\nDEBU[0137] GET: /images/json?all=1\r\nDEBU[0138] GET: /api/nodes\r\nDEBU[0732] GET: /api/registries\r\nDEBU[0737] GET: /api/nodes\r\nWARN[37066] unauthorized request for /containers/json from {{IP Redacted}}:50298\r\nDEBU[37075] GET: /containers/json?all=1\r\nDEBU[37077] GET: /images/json?all=1\r\nDEBU[37334] GET: /api/nodes\r\nDEBU[37406] POST: /containers/create?name=Shipyard-Nginx-Reverse-Proxy\r\nDEBU[37406] POST: /containers/360958b09337b71ec403c8d43066e54fef3872881e1d7c35dfa2ef8a2fbc003f/start\r\nDEBU[38087] GET: /containers/json?all=1\r\nDEBU[38097] POST: /containers/5095091be6bfad42b3550546410c63c6ab59acc1c063a35b8221211ee6af92e7/restart\r\nWARN[38114] unauthorized request for /containers/json from {{IP Redacted}}:59138\r\nDEBU[38131] GET: /containers/json?all=1\r\nWARN[38145] unauthorized request for /containers/json from {{IP Redacted}}:59271\r\nDEBU[38152] GET: /containers/json?all=1\r\nDEBU[38155] GET: /api/nodes\r\nDEBU[38160] GET: /images/json?all=1\r\nDEBU[38163] GET: /containers/json?all=1\r\nDEBU[38172] GET: /containers/2ae6307f2663f99a26cf18fe2cfec57cc932738f2217dc9e3c3b67683bf8e818/json\r\nDEBU[38174] GET: /containers/2ae6307f2663f99a26cf18fe2cfec57cc932738f2217dc9e3c3b67683bf8e818/logs?stderr=1&stdout=1&timestamps=1\r\nDEBU[38193] GET: /containers/json?all=1\r\nDEBU[38197] POST: /containers/2ae6307f2663f99a26cf18fe2cfec57cc932738f2217dc9e3c3b67683bf8e818/restart\r\nDEBU[38197] GET: /containers/json?all=1\r\nDEBU[38418] GET: /api/nodes\r\nDEBU[38419] GET: /api/nodes\r\nDEBU[38420] GET: /api/nodes\r\nDEBU[38421] GET: /api/nodes\r\nDEBU[38421] GET: /api/nodes\r\nDEBU[38422] GET: /api/nodes\r\nDEBU[38422] GET: /api/nodes\r\nDEBU[38423] GET: /api/nodes\r\nDEBU[38423] GET: /api/nodes\r\nDEBU[38423] GET: /containers/json?all=1\r\nDEBU[38458] GET: /containers/json?all=1\r\nDEBU[38462] GET: /api/nodes\r\nDEBU[38510] GET: /containers/json?all=1\r\nDEBU[38519] GET: /api/nodes\r\nDEBU[38606] POST: /containers/5095091be6bfad42b3550546410c63c6ab59acc1c063a35b8221211ee6af92e7/stop\r\nDEBU[46542] GET: /containers/json?all=1\r\nDEBU[46546] GET: /containers/json?all=1\r\nDEBU[46547] GET: /api/nodes\r\nDEBU[46548] GET: /containers/json?all=1\r\nDEBU[46705] GET: /containers/json?all=1\r\nDEBU[46707] GET: /api/nodes\r\nDEBU[46709] GET: /containers/json?all=1\r\nWARN[173775] unauthorized request for /containers/json from {{IP Redacted}}:32923\r\nDEBU[173784] GET: /containers/json?all=1\r\nDEBU[173798] GET: /api/nodes\r\nDEBU[173835] GET: /containers/json?all=1\r\nWARN[173841] invalid login for admin from {{IP Redacted}}:32940\r\nWARN[173861] unauthorized request for /containers/json from {{IP Redacted}}:32947\r\nWARN[173880] unauthorized request for /containers/json from {{IP Redacted}}:32952\r\nDEBU[173887] GET: /containers/json?all=1\r\nWARN[173910] unauthorized request for /containers/json from {{IP Redacted}}:33113\r\nDEBU[173920] GET: /containers/json?all=1\r\nINFO[0000] shipyard version 3.0.2\r\nINFO[0000] checking database\r\nDEBU[0000] connected to docker: url=tcp://swarm:3375\r\nDEBU[0000] configured docker proxy target: http://swarm:3375\r\nINFO[0000] controller listening on :8080\r\nDEBU[0006] GET: /containers/json?all=1\r\nDEBU[0011] GET: /containers/json?all=1\r\nDEBU[0014] GET: /containers/json?all=1\r\nDEBU[0043] GET: /containers/json?all=1\r\nDEBU[0046] GET: /containers/json?all=1\r\nDEBU[0161] GET: /containers/json?all=1\r\nDEBU[0166] GET: /containers/json?all=1\r\nDEBU[0175] GET: /containers/json?all=1\r\nDEBU[0176] GET: /api/nodes\r\nlxing@us1:~$ sudo docker --version\r\nDocker version 1.9.1, build a34a1d5\r\nlxing@us1:~$ sudo docker logs shipyard-controller\r\nINFO[0000] shipyard version 3.0.2\r\nINFO[0000] checking database\r\nDEBU[0032] connected to docker: url=tcp://swarm:3375\r\nDEBU[0032] configured docker proxy target: http://swarm:3375\r\nINFO[0032] created admin user: username: admin password: shipyard\r\nINFO[0032] controller listening on :8080\r\nWARN[0122] unauthorized request for /containers/json from {{IP Redacted}}:2526\r\nDEBU[0125] GET: /containers/json?all=1\r\nDEBU[0130] GET: /api/accounts\r\nDEBU[0130] GET: /api/roles\r\nDEBU[0131] GET: /api/accounts/admin\r\nDEBU[0134] POST: /api/accounts\r\nDEBU[0134] updated account: name=admin\r\nDEBU[0137] GET: /images/json?all=1\r\nDEBU[0138] GET: /api/nodes\r\nDEBU[0732] GET: /api/registries\r\nDEBU[0737] GET: /api/nodes\r\nWARN[37066] unauthorized request for /containers/json from {{IP Redacted}}:50298\r\nDEBU[37075] GET: /containers/json?all=1\r\nDEBU[37077] GET: /images/json?all=1\r\nDEBU[37334] GET: /api/nodes\r\nDEBU[37406] POST: /containers/create?name=Shipyard-Nginx-Reverse-Proxy\r\nDEBU[37406] POST: /containers/360958b09337b71ec403c8d43066e54fef3872881e1d7c35dfa2ef8a2fbc003f/start\r\nDEBU[38087] GET: /containers/json?all=1\r\nDEBU[38097] POST: /containers/5095091be6bfad42b3550546410c63c6ab59acc1c063a35b8221211ee6af92e7/restart\r\nWARN[38114] unauthorized request for /containers/json from {{IP Redacted}}:59138\r\nDEBU[38131] GET: /containers/json?all=1\r\nWARN[38145] unauthorized request for /containers/json from {{IP Redacted}}:59271\r\nDEBU[38152] GET: /containers/json?all=1\r\nDEBU[38155] GET: /api/nodes\r\nDEBU[38160] GET: /images/json?all=1\r\nDEBU[38163] GET: /containers/json?all=1\r\nDEBU[38172] GET: /containers/2ae6307f2663f99a26cf18fe2cfec57cc932738f2217dc9e3c3b67683bf8e818/json\r\nDEBU[38174] GET: /containers/2ae6307f2663f99a26cf18fe2cfec57cc932738f2217dc9e3c3b67683bf8e818/logs?stderr=1&stdout=1&timestamps=1\r\nDEBU[38193] GET: /containers/json?all=1\r\nDEBU[38197] POST: /containers/2ae6307f2663f99a26cf18fe2cfec57cc932738f2217dc9e3c3b67683bf8e818/restart\r\nDEBU[38197] GET: /containers/json?all=1\r\nDEBU[38418] GET: /api/nodes\r\nDEBU[38419] GET: /api/nodes\r\nDEBU[38420] GET: /api/nodes\r\nDEBU[38421] GET: /api/nodes\r\nDEBU[38421] GET: /api/nodes\r\nDEBU[38422] GET: /api/nodes\r\nDEBU[38422] GET: /api/nodes\r\nDEBU[38423] GET: /api/nodes\r\nDEBU[38423] GET: /api/nodes\r\nDEBU[38423] GET: /containers/json?all=1\r\nDEBU[38458] GET: /containers/json?all=1\r\nDEBU[38462] GET: /api/nodes\r\nDEBU[38510] GET: /containers/json?all=1\r\nDEBU[38519] GET: /api/nodes\r\nDEBU[38606] POST: /containers/5095091be6bfad42b3550546410c63c6ab59acc1c063a35b8221211ee6af92e7/stop\r\nDEBU[46542] GET: /containers/json?all=1\r\nDEBU[46546] GET: /containers/json?all=1\r\nDEBU[46547] GET: /api/nodes\r\nDEBU[46548] GET: /containers/json?all=1\r\nDEBU[46705] GET: /containers/json?all=1\r\nDEBU[46707] GET: /api/nodes\r\nDEBU[46709] GET: /containers/json?all=1\r\nWARN[173775] unauthorized request for /containers/json from {{IP Redacted}}:32923\r\nDEBU[173784] GET: /containers/json?all=1\r\nDEBU[173798] GET: /api/nodes\r\nDEBU[173835] GET: /containers/json?all=1\r\nWARN[173841] invalid login for admin from {{IP Redacted}}:32940\r\nWARN[173861] unauthorized request for /containers/json from {{IP Redacted}}:32947\r\nWARN[173880] unauthorized request for /containers/json from {{IP Redacted}}:32952\r\nDEBU[173887] GET: /containers/json?all=1\r\nWARN[173910] unauthorized request for /containers/json from {{IP Redacted}}:33113\r\nDEBU[173920] GET: /containers/json?all=1\r\nINFO[0000] shipyard version 3.0.2\r\nINFO[0000] checking database\r\nDEBU[0000] connected to docker: url=tcp://swarm:3375\r\nDEBU[0000] configured docker proxy target: http://swarm:3375\r\nINFO[0000] controller listening on :8080\r\nDEBU[0006] GET: /containers/json?all=1\r\nDEBU[0011] GET: /containers/json?all=1\r\nDEBU[0014] GET: /containers/json?all=1\r\nDEBU[0043] GET: /containers/json?all=1\r\nDEBU[0046] GET: /containers/json?all=1\r\nDEBU[0161] GET: /containers/json?all=1\r\nDEBU[0166] GET: /containers/json?all=1\r\nDEBU[0175] GET: /containers/json?all=1\r\nDEBU[0176] GET: /api/nodes"}}