{"action":"created","issue":{"url":"https://api.github.com/repos/docker/docker/issues/14093","labels_url":"https://api.github.com/repos/docker/docker/issues/14093/labels{/name}","comments_url":"https://api.github.com/repos/docker/docker/issues/14093/comments","events_url":"https://api.github.com/repos/docker/docker/issues/14093/events","html_url":"https://github.com/docker/docker/issues/14093","id":90080742,"number":14093,"title":"docker daemon dies with \"Unable to open the database file: unable to open database file\"","user":{"login":"pmoust","id":2493339,"avatar_url":"https://avatars.githubusercontent.com/u/2493339?v=3","gravatar_id":"","url":"https://api.github.com/users/pmoust","html_url":"https://github.com/pmoust","followers_url":"https://api.github.com/users/pmoust/followers","following_url":"https://api.github.com/users/pmoust/following{/other_user}","gists_url":"https://api.github.com/users/pmoust/gists{/gist_id}","starred_url":"https://api.github.com/users/pmoust/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pmoust/subscriptions","organizations_url":"https://api.github.com/users/pmoust/orgs","repos_url":"https://api.github.com/users/pmoust/repos","events_url":"https://api.github.com/users/pmoust/events{/privacy}","received_events_url":"https://api.github.com/users/pmoust/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-06-22T12:05:00Z","updated_at":"2015-09-21T18:45:24Z","closed_at":null,"body":"#### Description of problem:\r\nDocker daemon starts and then dies with\r\n```\r\n 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25158]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"+job serveapi(fd://)\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25158]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"+job init_networkdriver()\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25158]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"Listening for HTTP on fd ()\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25158]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"-job init_networkdriver() = OK (0)\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25158]: time=\"2015-06-22T11:07:12Z\" level=\"fatal\" msg=\"Unable to open the database file: unable to open database file\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25184]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"+job serveapi(fd://)\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25184]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"+job init_networkdriver()\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25184]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"Listening for HTTP on fd ()\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25184]: time=\"2015-06-22T11:07:12Z\" level=\"info\" msg=\"-job init_networkdriver() = OK (0)\"\r\nJun 22 11:07:27 ip-10-30-2-252.ec2.internal dockerd[25184]: time=\"2015-06-22T11:07:12Z\" level=\"fatal\" msg=\"Unable to open the database file: unable to open database file\"\r\n```\r\n\r\n#### docker version:\r\n```\r\npmoust@ip-10-30-2-252 ~ $ docker version\r\nClient version: 1.4.1\r\nClient API version: 1.16\r\nGo version (client): go1.3.3\r\nGit commit (client): 5bc2ff8-dirty\r\nOS/Arch (client): linux/amd64\r\nServer version: 1.4.1\r\nServer API version: 1.16\r\nGo version (server): go1.3.3\r\nGit commit (server): 5bc2ff8-dirty\r\n```\r\n\r\n#### docker info:\r\n```\r\npmoust@ip-10-30-2-252 ~ $ docker info\r\nContainers: 109\r\nImages: 243\r\nStorage Driver: btrfs\r\n Build Version: Btrfs v3.17.1\r\n Library Version: 101\r\nExecution Driver: native-0.2\r\nKernel Version: 3.18.1\r\nOperating System: CoreOS 557.2.0\r\nCPUs: 1\r\nTotal Memory: 996.5 MiB\r\nName: ip-10-30-2-252.ec2.internal\r\nID: B27Y:DLKV:K3V5:HYXZ:REDG:QEX6:FASL:3GXT:WUPT:M2QO:FFPY:RAL5\r\n```\r\n\r\n#### uname -a:\r\n```\r\npmoust@ip-10-30-2-252 ~ $ uname -a\r\nLinux ip-10-30-2-252.ec2.internal 3.18.1 #2 SMP Tue Feb 3 20:55:12 UTC 2015 x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz GenuineIntel GNU/Linux\r\n```\r\n\r\n#### Environment details (AWS, VirtualBox, physical, etc.):\r\nAWS EC2 running CoreOS stable (557.2.0)\r\n\r\n### Repro:\r\nHappened across all our cluster machines after a few days of pulling/running containers during services' rolling updates.\r\nCannot reproduce it locally.\r\n\r\n#### Actual Results:\r\ndocker service starts and then dies.\r\n\r\n#### Expected Results:\r\ndocker service started and stable.\r\n\r\n#### Additional info:\r\n```\r\nip-10-30-2-252 pmoust # df -i;df -h\r\nFilesystem     Inodes IUsed  IFree IUse% Mounted on\r\nrootfs              0     0      0     - /\r\ndevtmpfs       124484   319 124165    1% /dev\r\ntmpfs          127548     1 127547    1% /dev/shm\r\ntmpfs          127548   472 127076    1% /run\r\ntmpfs          127548    14 127534    1% /sys/fs/cgroup\r\n/dev/xvda9          0     0      0     - /\r\n/dev/xvda3      65024  5220  59804    9% /usr\r\ntmpfs          127548     1 127547    1% /media\r\ntmpfs          127548     8 127540    1% /tmp\r\n/dev/xvda6      32768    12  32756    1% /usr/share/oem\r\n/dev/xvda9          0     0      0     - /var/lib/docker/btrfs\r\nFilesystem      Size  Used Avail Use% Mounted on\r\nrootfs           30G   25G  4.6G  85% /\r\ndevtmpfs        487M     0  487M   0% /dev\r\ntmpfs           499M     0  499M   0% /dev/shm\r\ntmpfs           499M  788K  498M   1% /run\r\ntmpfs           499M     0  499M   0% /sys/fs/cgroup\r\n/dev/xvda9       30G   25G  4.6G  85% /\r\n/dev/xvda3     1001M  306M  644M  33% /usr\r\ntmpfs           499M     0  499M   0% /media\r\ntmpfs           499M     0  499M   0% /tmp\r\n/dev/xvda6      108M   56K   99M   1% /usr/share/oem\r\n/dev/xvda9       30G   25G  4.6G  85% /var/lib/docker/btrfs\r\n```"},"comment":{"url":"https://api.github.com/repos/docker/docker/issues/comments/142072559","html_url":"https://github.com/docker/docker/issues/14093#issuecomment-142072559","issue_url":"https://api.github.com/repos/docker/docker/issues/14093","id":142072559,"user":{"login":"anandkumarpatel","id":2194285,"avatar_url":"https://avatars.githubusercontent.com/u/2194285?v=3","gravatar_id":"","url":"https://api.github.com/users/anandkumarpatel","html_url":"https://github.com/anandkumarpatel","followers_url":"https://api.github.com/users/anandkumarpatel/followers","following_url":"https://api.github.com/users/anandkumarpatel/following{/other_user}","gists_url":"https://api.github.com/users/anandkumarpatel/gists{/gist_id}","starred_url":"https://api.github.com/users/anandkumarpatel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anandkumarpatel/subscriptions","organizations_url":"https://api.github.com/users/anandkumarpatel/orgs","repos_url":"https://api.github.com/users/anandkumarpatel/repos","events_url":"https://api.github.com/users/anandkumarpatel/events{/privacy}","received_events_url":"https://api.github.com/users/anandkumarpatel/received_events","type":"User","site_admin":false},"created_at":"2015-09-21T18:45:24Z","updated_at":"2015-09-21T18:45:24Z","body":"+1 got this today\r\n\r\n```\r\nINFO[2670956] POST /containers/create?Image=runnable%2Flibra&Labels=&Env=LOOKUP_CMD%3D%2Fdocker&Env=LOOKUP_ARGS%3D-d&HostConfig=\r\nINFO[2670956] +job create()\r\nUnable to open the database file: unable to open database file\r\nINFO[2670956] -job create() = ERR (1)\r\nERRO[2670956] Handler for POST /containers/create returned error: Unable to open the database file: unable to open database file\r\nERRO[2670956] HTTP Error: statusCode=500 Unable to open the database file: unable to open database file\r\nINFO[2670957] POST /containers/create?Image=runnable%2Flibra&Labels=&Env=LOOKUP_CMD%3D%2Fdocker&Env=LOOKUP_ARGS%3D-d&HostConfig=\r\nINFO[2670957] +job create()\r\nUnable to open the database file: unable to open database file\r\nINFO[2670957] -job create() = ERR (1)\r\nERRO[2670957] Handler for POST /containers/create returned error: Unable to open the database file: unable to open database file\r\nERRO[2670957] HTTP Error: statusCode=500 Unable to open the database file: unable to open database file\r\nINFO[2670958] POST /containers/create?Image=runnable%2Flibra&Labels=&Env=LOOKUP_CMD%3D%2Fdocker&Env=LOOKUP_ARGS%3D-d&HostConfig=\r\nINFO[2670958] +job create()\r\nUnable to open the database file: unable to open database file\r\nINFO[2670959] -job create() = ERR (1)\r\nERRO[2670959] Handler for POST /containers/create returned error: Unable to open the database file: unable to open database file\r\nERRO[2670959] HTTP Error: statusCode=500 Unable to open the database file: unable to open database file\r\nINFO[2670960] POST /containers/create?Image=runnable%2Flibra&Labels=&Env=LOOKUP_CMD%3D%2Fdocker&Env=LOOKUP_ARGS%3D-d&HostConfig=\r\nINFO[2670960] +job create()\r\nUnable to open the database file: unable to open database file\r\nINFO[2670960] -job create() = ERR (1)\r\nERRO[2670960] Handler for POST /containers/create returned error: Unable to open the database file: unable to open database file\r\nERRO[2670960] HTTP Error: statusCode=500 Unable to open the database file: unable to open database file\r\nINFO[2670961] POST /containers/create?Image=runnable%2Flibra&Labels=&Env=LOOKUP_CMD%3D%2Fdocker&Env=LOOKUP_ARGS%3D-d&HostConfig=\r\nINFO[2670961] +job create()\r\nUnable to open the database file: unable to open database file\r\nINFO[2670961] -job create() = ERR (1)\r\nERRO[2670961] Handler for POST /containers/create returned error: Unable to open the database file: unable to open database file\r\nERRO[2670961] HTTP Error: statusCode=500 Unable to open the database file: unable to open database file\r\n```\r\n```\r\nroot@dewgong:/home/ubuntu# docker -D version; docker -D info; uname -a\r\nClient version: 1.6.2\r\nClient API version: 1.18\r\nGo version (client): go1.4.2\r\nGit commit (client): 7c8fca2\r\nOS/Arch (client): linux/amd64\r\nServer version: 1.6.2\r\nServer API version: 1.18\r\nGo version (server): go1.4.2\r\nGit commit (server): 7c8fca2\r\nOS/Arch (server): linux/amd64\r\nContainers: 560\r\nImages: 7436\r\nStorage Driver: aufs\r\n Root Dir: /docker/aufs\r\n Backing Filesystem: extfs\r\n Dirs: 8556\r\n Dirperm1 Supported: false\r\nExecution Driver: native-0.2\r\nKernel Version: 3.13.0-48-generic\r\nOperating System: Ubuntu 14.04.2 LTS\r\nCPUs: 32\r\nTotal Memory: 58.81 GiB\r\nName: dewgong\r\nID: OGVM:6KKW:KAOM:KAJJ:SJDL:4QZJ:ZLLU:RTJ4:RAB4:NIZW:DOA7:RNUL\r\nDebug mode (server): false\r\nDebug mode (client): true\r\nFds: 345\r\nGoroutines: 927\r\nSystem Time: Mon Sep 21 18:45:28 UTC 2015\r\nEventsListeners: 1\r\nInit SHA1: 7f9c6798b022e64f04d2aff8c75cbf38a2779493\r\nInit Path: /usr/bin/docker\r\nDocker Root Dir: /docker\r\nWARNING: No swap limit support\r\nLinux dewgong 3.13.0-48-generic #80-Ubuntu SMP Thu Mar 12 11:16:15 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux\r\n```"}}