{"action":"closed","issue":{"url":"https://api.github.com/repos/raintank/raintank-metric/issues/15","labels_url":"https://api.github.com/repos/raintank/raintank-metric/issues/15/labels{/name}","comments_url":"https://api.github.com/repos/raintank/raintank-metric/issues/15/comments","events_url":"https://api.github.com/repos/raintank/raintank-metric/issues/15/events","html_url":"https://github.com/raintank/raintank-metric/issues/15","id":99265686,"number":15,"title":"eventQueue filling up","user":{"login":"ctdk","id":83435,"avatar_url":"https://avatars.githubusercontent.com/u/83435?v=3","gravatar_id":"","url":"https://api.github.com/users/ctdk","html_url":"https://github.com/ctdk","followers_url":"https://api.github.com/users/ctdk/followers","following_url":"https://api.github.com/users/ctdk/following{/other_user}","gists_url":"https://api.github.com/users/ctdk/gists{/gist_id}","starred_url":"https://api.github.com/users/ctdk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ctdk/subscriptions","organizations_url":"https://api.github.com/users/ctdk/orgs","repos_url":"https://api.github.com/users/ctdk/repos","events_url":"https://api.github.com/users/ctdk/events{/privacy}","received_events_url":"https://api.github.com/users/ctdk/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"ctdk","id":83435,"avatar_url":"https://avatars.githubusercontent.com/u/83435?v=3","gravatar_id":"","url":"https://api.github.com/users/ctdk","html_url":"https://github.com/ctdk","followers_url":"https://api.github.com/users/ctdk/followers","following_url":"https://api.github.com/users/ctdk/following{/other_user}","gists_url":"https://api.github.com/users/ctdk/gists{/gist_id}","starred_url":"https://api.github.com/users/ctdk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ctdk/subscriptions","organizations_url":"https://api.github.com/users/ctdk/orgs","repos_url":"https://api.github.com/users/ctdk/repos","events_url":"https://api.github.com/users/ctdk/events{/privacy}","received_events_url":"https://api.github.com/users/ctdk/received_events","type":"User","site_admin":false},"milestone":null,"comments":5,"created_at":"2015-08-05T18:14:02Z","updated_at":"2015-08-14T00:37:25Z","closed_at":"2015-08-14T00:37:25Z","body":"We're seeing it both on dev-portal and production where the eventQueue for grafana events is filling up with events and not being read by raintank-metric. The code there looks in order, but I noticed that the raintank-metric processes in production are restarting with fair regularity (but not every minute), but unfortunately their logs get wiped out so we don't see whatever error messages they spit out before dying. I've changed their logging to syslog to try and capture that. This could possibly be related to the eventQueue issue."}}