{"action":"created","issue":{"url":"https://api.github.com/repos/deis/deis/issues/3218","labels_url":"https://api.github.com/repos/deis/deis/issues/3218/labels{/name}","comments_url":"https://api.github.com/repos/deis/deis/issues/3218/comments","events_url":"https://api.github.com/repos/deis/deis/issues/3218/events","html_url":"https://github.com/deis/deis/issues/3218","id":60144054,"number":3218,"title":"Meta issue: \"Tag not found\" error when using `deis pull`","user":{"login":"carmstrong","id":536009,"avatar_url":"https://avatars.githubusercontent.com/u/536009?v=3","gravatar_id":"","url":"https://api.github.com/users/carmstrong","html_url":"https://github.com/carmstrong","followers_url":"https://api.github.com/users/carmstrong/followers","following_url":"https://api.github.com/users/carmstrong/following{/other_user}","gists_url":"https://api.github.com/users/carmstrong/gists{/gist_id}","starred_url":"https://api.github.com/users/carmstrong/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/carmstrong/subscriptions","organizations_url":"https://api.github.com/users/carmstrong/orgs","repos_url":"https://api.github.com/users/carmstrong/repos","events_url":"https://api.github.com/users/carmstrong/events{/privacy}","received_events_url":"https://api.github.com/users/carmstrong/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/deis/deis/labels/bug","name":"bug","color":"e11d21"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":6,"created_at":"2015-03-06T19:05:27Z","updated_at":"2015-03-09T12:38:54Z","closed_at":null,"body":"This issue is meant to coordinate the discussion of the \"Tag not found\" error some users see when using `deis pull`. This issue seemed to have two different root causes which manifested in the same way, making it difficult to resolve:\r\n\r\n* The deis-registry component sometimes timed out when pulling the layers from the remote registry. This was resolved in https://github.com/deis/docker-registry/pull/10 which shipped in Deis v1.4.0.\r\n* The deis-cache component, which was configured to be used as an LRU cache for registry in #1858, seems to be configured to only use [50MB](https://github.com/deis/deis/blob/8826c83b28a573334083edc83571488238857924/cache/main.go#L23) of memory, which is suspected to be too little to effectively serve as an LRU cache.\r\n\r\nUsers who are still seeing this issue after upgrading to Deis v1.4.0 are encourgaed to try disabling registry's LRU cache. This is achieved by logging into the host which runs `deis-registry` and:\r\n```console\r\n$ nse deis-registry\r\n$ vi /app/templates/config.yml\r\n$ # comment the lines for cache_lru\r\n$ /app/bin/reload\r\n```\r\n\r\nIf `deis pull` works reliably after this for some time, it points to the cache as the culprit. We have not been able to confirm this in our testing, so we can't resolve this until we have some confidence in the fix. If cache is indeed the culprit, we should consider bumping its memory (although we'd be choosing an arbitrary value that may also be too small), or removing the registry's LRU cache entirely. We should ideally do some testing to see what effect (if any) the registry LRU cache has on performance.\r\n\r\n/cc @johanneswuerbach \r\n\r\nrefs #3116\r\nrefs #2916 \r\n"},"comment":{"url":"https://api.github.com/repos/deis/deis/issues/comments/77845698","html_url":"https://github.com/deis/deis/issues/3218#issuecomment-77845698","issue_url":"https://api.github.com/repos/deis/deis/issues/3218","id":77845698,"user":{"login":"fretboarder","id":10065328,"avatar_url":"https://avatars.githubusercontent.com/u/10065328?v=3","gravatar_id":"","url":"https://api.github.com/users/fretboarder","html_url":"https://github.com/fretboarder","followers_url":"https://api.github.com/users/fretboarder/followers","following_url":"https://api.github.com/users/fretboarder/following{/other_user}","gists_url":"https://api.github.com/users/fretboarder/gists{/gist_id}","starred_url":"https://api.github.com/users/fretboarder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fretboarder/subscriptions","organizations_url":"https://api.github.com/users/fretboarder/orgs","repos_url":"https://api.github.com/users/fretboarder/repos","events_url":"https://api.github.com/users/fretboarder/events{/privacy}","received_events_url":"https://api.github.com/users/fretboarder/received_events","type":"User","site_admin":false},"created_at":"2015-03-09T12:38:53Z","updated_at":"2015-03-09T12:38:53Z","body":"I have disabled the cache_lru in the registry container as  described by @carmstrong (although I had to use sed instead of vi, which is not installed).\r\nThe first few tests seem promising now. I was able to pull an image out of a private registry.\r\nBTW: I'm using Deis(1.4.1)/CoreOS on bare metal. "}}