{"action":"created","issue":{"url":"https://api.github.com/repos/coreos/bugs/issues/259","labels_url":"https://api.github.com/repos/coreos/bugs/issues/259/labels{/name}","comments_url":"https://api.github.com/repos/coreos/bugs/issues/259/comments","events_url":"https://api.github.com/repos/coreos/bugs/issues/259/events","html_url":"https://github.com/coreos/bugs/issues/259","id":56488810,"number":259,"title":"Docker and systemd-journald died on reboot","user":{"login":"joelchen","id":6938607,"avatar_url":"https://avatars.githubusercontent.com/u/6938607?v=3","gravatar_id":"","url":"https://api.github.com/users/joelchen","html_url":"https://github.com/joelchen","followers_url":"https://api.github.com/users/joelchen/followers","following_url":"https://api.github.com/users/joelchen/following{/other_user}","gists_url":"https://api.github.com/users/joelchen/gists{/gist_id}","starred_url":"https://api.github.com/users/joelchen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joelchen/subscriptions","organizations_url":"https://api.github.com/users/joelchen/orgs","repos_url":"https://api.github.com/users/joelchen/repos","events_url":"https://api.github.com/users/joelchen/events{/privacy}","received_events_url":"https://api.github.com/users/joelchen/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-02-04T07:06:54Z","updated_at":"2015-02-13T11:46:24Z","closed_at":"2015-02-13T11:46:24Z","body":"Hi CoreOS Team,\r\n\r\nAll of the services died on my CoreOS 575 system after reboot:\r\n```\r\nCoreOS alpha (575.0.0)\r\nFailed Units: 8\r\n  docker.service\r\n  mariadb.service\r\n  nginx.service\r\n  opensmtpd.service\r\n  systemd-journald.service\r\n  tomcat.service\r\n  docker.socket\r\n  systemd-journald.socket\r\n$ systemctl status docker -l\r\n● docker.service - Docker Application Container Engine\r\n   Loaded: loaded (/usr/lib64/systemd/system/docker.service; disabled; vendor preset: disabled)\r\n   Active: failed (Result: start-limit) since Wed 2015-02-04 14:10:23 SGT; 3min 32s ago\r\n     Docs: http://docs.docker.com\r\n  Process: 1132 ExecStart=/usr/lib/coreos/dockerd --daemon --host=fd:// $DOCKER_OPTS (code=exited, status=1/FAILURE)\r\n Main PID: 1132 (code=exited, status=1/FAILURE)\r\n$ journalctl -u docker -f\r\n-- Logs begin at Thu 2015-01-15 17:02:27 SGT. --\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"-job container_inspect(7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3) = OK (0)\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"+job attach(7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3)\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"POST /v1.16/containers/7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3/start\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"+job start(7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3)\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"+job allocate_interface(7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3)\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"-job allocate_interface(7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3) = OK (0)\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"+job log(start, 7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3, dckr/opensmtpd:latest)\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"-job log(start, 7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3, dckr/opensmtpd:latest) = OK (0)\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"warning\" msg=\"WARNING: Your kernel does not support OOM notifications: open /sys/fs/cgroup/memory/docker/7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3/memory.oom_control: no such file or directory\"\r\nFeb 04 14:10:12 ip-172-31-7-86.ap-southeast-1.compute.internal dockerd[519]: time=\"2015-02-04T14:10:12+08:00\" level=\"info\" msg=\"-job start(7d7bb9aea25b6b2527ec8b55d956628c62198eae3dd33852fc961a1dadbe9ea3) = OK (0)\"\r\n$ systemctl status systemd-journald -l\r\n● systemd-journald.service - Journal Service\r\n   Loaded: loaded (/usr/lib64/systemd/system/systemd-journald.service; static; vendor preset: disabled)\r\n   Active: failed (Result: start-limit) since Wed 2015-02-04 14:10:20 SGT; 6min ago\r\n     Docs: man:systemd-journald.service(8)\r\n           man:journald.conf(5)\r\n  Process: 973 ExecStart=/usr/lib/systemd/systemd-journald (code=dumped, signal=BUS)\r\n Main PID: 973 (code=dumped, signal=BUS)\r\n$ journalctl -u systemd-journald -f\r\n-- Logs begin at Thu 2015-01-15 17:02:27 SGT. --\r\nFeb 04 03:20:50 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[6003]: Journal started\r\nFeb 04 03:20:26 ip-172-31-7-86.ap-southeast-1.compute.internal systemd[1]: systemd-journald.service watchdog timeout (limit 1min)!\r\nFeb 04 09:51:30 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[20422]: Permanent journal is using 2.7G (max allowed 2.7G, trying to leave 4.0G free of 12.1G available → current limit 2.7G).\r\nFeb 04 09:52:02 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[20422]: Journal started\r\nFeb 04 09:51:23 ip-172-31-7-86.ap-southeast-1.compute.internal systemd[1]: systemd-journald.service watchdog timeout (limit 1min)!\r\nFeb 04 14:08:16 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[20422]: Journal stopped\r\n-- Reboot --\r\nFeb 04 14:09:55 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[415]: Runtime journal is using 6.2M (max allowed 49.8M, trying to leave 74.7M free of 491.9M available → current limit 49.8M).\r\nFeb 04 14:09:56 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[415]: Permanent journal is using 2.6G (max allowed 2.7G, trying to leave 4.0G free of 12.2G available → current limit 2.7G).\r\nFeb 04 14:09:56 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[415]: Time spent on flushing to /var is 880.288ms for 2 entries.\r\nFeb 04 14:09:56 ip-172-31-7-86.ap-southeast-1.compute.internal systemd-journal[415]: Journal started\r\n```\r\nWarmest Regards,\r\nJoel"},"comment":{"url":"https://api.github.com/repos/coreos/bugs/issues/comments/74242227","html_url":"https://github.com/coreos/bugs/issues/259#issuecomment-74242227","issue_url":"https://api.github.com/repos/coreos/bugs/issues/259","id":74242227,"user":{"login":"joelchen","id":6938607,"avatar_url":"https://avatars.githubusercontent.com/u/6938607?v=3","gravatar_id":"","url":"https://api.github.com/users/joelchen","html_url":"https://github.com/joelchen","followers_url":"https://api.github.com/users/joelchen/followers","following_url":"https://api.github.com/users/joelchen/following{/other_user}","gists_url":"https://api.github.com/users/joelchen/gists{/gist_id}","starred_url":"https://api.github.com/users/joelchen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joelchen/subscriptions","organizations_url":"https://api.github.com/users/joelchen/orgs","repos_url":"https://api.github.com/users/joelchen/repos","events_url":"https://api.github.com/users/joelchen/events{/privacy}","received_events_url":"https://api.github.com/users/joelchen/received_events","type":"User","site_admin":false},"created_at":"2015-02-13T11:46:24Z","updated_at":"2015-02-13T11:46:24Z","body":"This issue seems fixed on CoreOS 584."}}