{"action":"created","issue":{"url":"https://api.github.com/repos/docker/docker/issues/18010","labels_url":"https://api.github.com/repos/docker/docker/issues/18010/labels{/name}","comments_url":"https://api.github.com/repos/docker/docker/issues/18010/comments","events_url":"https://api.github.com/repos/docker/docker/issues/18010/events","html_url":"https://github.com/docker/docker/issues/18010","id":117111726,"number":18010,"title":"docker container filesystem became `read-only` after running 5 months","user":{"login":"chengweiv5","id":689798,"avatar_url":"https://avatars.githubusercontent.com/u/689798?v=3","gravatar_id":"","url":"https://api.github.com/users/chengweiv5","html_url":"https://github.com/chengweiv5","followers_url":"https://api.github.com/users/chengweiv5/followers","following_url":"https://api.github.com/users/chengweiv5/following{/other_user}","gists_url":"https://api.github.com/users/chengweiv5/gists{/gist_id}","starred_url":"https://api.github.com/users/chengweiv5/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chengweiv5/subscriptions","organizations_url":"https://api.github.com/users/chengweiv5/orgs","repos_url":"https://api.github.com/users/chengweiv5/repos","events_url":"https://api.github.com/users/chengweiv5/events{/privacy}","received_events_url":"https://api.github.com/users/chengweiv5/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-11-16T12:18:59Z","updated_at":"2015-11-16T14:28:10Z","closed_at":null,"body":"BUG REPORT INFORMATION\r\n\r\nUse the commands below to provide key information from your environment:\r\n\r\ndocker version\r\n\r\n```\r\n# docker version\r\nClient version: 1.3.2\r\nClient API version: 1.15\r\nGo version (client): go1.2.2\r\nGit commit (client): a43e801\r\nOS/Arch (client): linux/amd64\r\nServer version: 1.3.2\r\nServer API version: 1.15\r\nGo version (server): go1.2.2\r\nGit commit (server): a43e801\r\n```\r\n\r\ndocker info\r\n\r\n```\r\n# docker info\r\nContainers: 1\r\nImages: 76\r\nStorage Driver: devicemapper\r\n Pool Name: docker-252:16-524291-pool\r\n Pool Blocksize: 65.54 kB\r\n Data file: /data/docker/devicemapper/devicemapper/data\r\n Metadata file: /data/docker/devicemapper/devicemapper/metadata\r\n Data Space Used: 7.292 GB\r\n Data Space Total: 107.4 GB\r\n Metadata Space Used: 6.828 MB\r\n Metadata Space Total: 2.147 GB\r\n Library Version: 1.02.89-RHEL6 (2014-09-01)\r\nExecution Driver: native-0.2\r\nKernel Version: 2.6.32-431.el6.x86_64\r\nOperating System: <unknown>\r\n```\r\n\r\nuname -a\r\n\r\n```\r\n# uname -a\r\nLinux localhost 2.6.32-431.el6.x86_64 #1 SMP Fri Mar 14 11:51:38 CST 2014 x86_64 x86_64 x86_64 GNU/Linux\r\n```\r\n\r\nProvide additional environment details (AWS, VirtualBox, physical, etc.): KVM\r\n\r\nList the steps to reproduce the issue:\r\n1. start a container with below command\r\n\r\n```\r\n# docker run -d --name graphite --net=host -v /data/graphite/storage:/data/graphite/storage local-registry/chengweiv5/graphite:0.2-dev-2da77a3\r\n```\r\n\r\n2. wait for 5 months\r\n\r\nDescribe the results you received: the container `/` filesystem became Read-only\r\n\r\nDescribe the results you expected: the container `/' filesystem is still Read-write\r\n\r\nProvide additional info you think is important:\r\n\r\nI have a graphite container started 5 months ago and I suddenly it doesn't work anymore because the host data partition is full which I mounted to docker container.\r\n\r\nFrom the graphite log, it says below:\r\n\r\n~~~\r\nTraceback (most recent call last):\r\n  File \"/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py\", line 101, in get_response\r\n    request.path_info)\r\n  File \"/usr/local/lib/python2.7/dist-packages/django/core/urlresolvers.py\", line 252, in resolve\r\n    sub_match = pattern.resolve(new_path)\r\n  File \"/usr/local/lib/python2.7/dist-packages/django/core/urlresolvers.py\", line 158, in resolve\r\n    return ResolverMatch(self.callback, args, kwargs, self.name)\r\n  File \"/usr/local/lib/python2.7/dist-packages/django/core/urlresolvers.py\", line 164, in _get_callback\r\n    self._callback = get_callable(self._callback_str)\r\n  File \"/usr/local/lib/python2.7/dist-packages/django/utils/functional.py\", line 124, in wrapper\r\n    result = func(*args)\r\n  File \"/usr/local/lib/python2.7/dist-packages/django/core/urlresolvers.py\", line 91, in get_callable\r\n    lookup_view = getattr(import_module(mod_name), func_name)\r\n  File \"/usr/local/lib/python2.7/dist-packages/django/utils/importlib.py\", line 35, in import_module\r\n    __import__(name)\r\n  File \"/opt/graphite/webapp/graphite/browser/views.py\", line 20, in <module>\r\n    from graphite.util import getProfile, getProfileByUsername, defaultUser, json\r\n  File \"/opt/graphite/webapp/graphite/util.py\", line 31, in <module>\r\n    from graphite.logger import log\r\n  File \"/opt/graphite/webapp/graphite/logger.py\", line 75, in <module>\r\n    log = GraphiteLogger() # import-shared logger instance\r\n  File \"/opt/graphite/webapp/graphite/logger.py\", line 40, in __init__\r\n    self.infoHandler = Rotater(self.infoLogFile,when=\"midnight\",backupCount=1)\r\n  File \"/usr/lib/python2.7/logging/handlers.py\", line 171, in __init__\r\n    BaseRotatingHandler.__init__(self, filename, 'a', encoding, delay)\r\n  File \"/usr/lib/python2.7/logging/handlers.py\", line 64, in __init__\r\n    logging.FileHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 903, in __init__\r\n    StreamHandler.__init__(self, self._open())\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 928, in _open\r\n    stream = open(self.baseFilename, self.mode)\r\nIOError: [Errno 30] Read-only file system: '/var/log/graphite/info.log'\r\n~~~\r\n\r\nit's quite interesting because I didn't mount any thing as RO to /var or its subdirectory.\r\n\r\nSo I'm trying to create a file in `/` of the container\r\n\r\n```\r\n# docker exec -it graphite /bin/touch /file\r\n/bin/touch: cannot touch '/file': Read-only file system\r\n```\r\n\r\nbelow are more details.\r\n\r\n```\r\n# docker ps\r\nCONTAINER ID        IMAGE                                                                COMMAND             CREATED             STATUS              PORTS               NAMES\r\n38a6d1080f40        local-registry/chengweiv5/graphite:0.2-dev-2da77a3   \"/sbin/my_init\"     5 months ago        Up 5 months                             graphite            \r\n```\r\n\r\nI started this container with command\r\n\r\n```\r\n# docker run -d --name graphite --net=host -v /data/graphite/storage:/data/graphite/storage local-registry/chengweiv5/graphite:0.2-dev-2da77a3\r\n```\r\n\r\nIt was works fine, but now has a `Read-only` root filesystem, weird!\r\n\r\n----------END REPORT ---------\r\n\r\n#ENEEDMOREINFO\r\n"},"comment":{"url":"https://api.github.com/repos/docker/docker/issues/comments/157047422","html_url":"https://github.com/docker/docker/issues/18010#issuecomment-157047422","issue_url":"https://api.github.com/repos/docker/docker/issues/18010","id":157047422,"user":{"login":"chengweiv5","id":689798,"avatar_url":"https://avatars.githubusercontent.com/u/689798?v=3","gravatar_id":"","url":"https://api.github.com/users/chengweiv5","html_url":"https://github.com/chengweiv5","followers_url":"https://api.github.com/users/chengweiv5/followers","following_url":"https://api.github.com/users/chengweiv5/following{/other_user}","gists_url":"https://api.github.com/users/chengweiv5/gists{/gist_id}","starred_url":"https://api.github.com/users/chengweiv5/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chengweiv5/subscriptions","organizations_url":"https://api.github.com/users/chengweiv5/orgs","repos_url":"https://api.github.com/users/chengweiv5/repos","events_url":"https://api.github.com/users/chengweiv5/events{/privacy}","received_events_url":"https://api.github.com/users/chengweiv5/received_events","type":"User","site_admin":false},"created_at":"2015-11-16T14:28:10Z","updated_at":"2015-11-16T14:28:10Z","body":"thanks @phemmer , I'll check it."}}