{"action":"created","issue":{"url":"https://api.github.com/repos/influxdb/influxdb/issues/2849","labels_url":"https://api.github.com/repos/influxdb/influxdb/issues/2849/labels{/name}","comments_url":"https://api.github.com/repos/influxdb/influxdb/issues/2849/comments","events_url":"https://api.github.com/repos/influxdb/influxdb/issues/2849/events","html_url":"https://github.com/influxdb/influxdb/issues/2849","id":86664254,"number":2849,"title":"RC32: Frequent write errors","user":{"login":"bww","id":774903,"avatar_url":"https://avatars.githubusercontent.com/u/774903?v=3","gravatar_id":"","url":"https://api.github.com/users/bww","html_url":"https://github.com/bww","followers_url":"https://api.github.com/users/bww/followers","following_url":"https://api.github.com/users/bww/following{/other_user}","gists_url":"https://api.github.com/users/bww/gists{/gist_id}","starred_url":"https://api.github.com/users/bww/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bww/subscriptions","organizations_url":"https://api.github.com/users/bww/orgs","repos_url":"https://api.github.com/users/bww/repos","events_url":"https://api.github.com/users/bww/events{/privacy}","received_events_url":"https://api.github.com/users/bww/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-06-09T16:53:21Z","updated_at":"2015-06-09T18:55:29Z","closed_at":null,"body":"After upgrading to RC32 I'm seeing write errors ranging between 25-75% of requests for no apparent reason. Sometimes there will be no problem for an hour followed by an extended period with high error rates.\r\n\r\nI would expect either all (or essentially all) writes to succeed or all writes to fail if there's some kind of misconfiguration. A huge percentage of writes failing, but not all, is concerning.\r\n\r\nThere isn't any obvious problem with my setup that I can see and I've had earlier 0.9.x versions running successfully for months on this host.\r\n\r\nThe service responds with the following opaque error:\r\n\r\n    write failed\r\n\r\nI can't find a way to get the service to trace anything more useful than the HTTP request log line, e.g.,\r\n\r\n    [http] 2015/06/09 16:36:17 172.31.34.132 - root [09/Jun/2015:16:36:17 +0000] POST /write?consistency=&db=xyz&precision=&rp=default HTTP/1.1 500 36 - Go Metrics a7099361-0ec5-11e5-92c2-000000000000 1.400526ms\r\n\r\nI tried setting `write-tracing` to `true` in config to get some more diagnostic information but as far as I can tell that didn't seem to do anything.\r\n\r\nI'm using the RC32 client from this repo in `/client` to send writes. The following is typical of the input I'm sending:\r\n\r\n    collector.request_duration.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909362984541\r\n    collector.timeout.meter,environment=devel,host=the.host.com count=0,fifteen-minute=0.0,five-minute=0.0,mean=0.0,one-minute=0.0 1433867909363035654\r\n    service.notify.clients.count,environment=devel,host=the.host.com count=0 1433867909363045462\r\n    service.request_duration.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363051340\r\n    collector.request.meter,environment=devel,host=the.host.com count=0,fifteen-minute=0.0,five-minute=0.0,mean=0.0,one-minute=0.0 1433867909363109642\r\n    notify.delivery.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363114736\r\n    service.requests.meter,environment=devel,host=the.host.com count=0,fifteen-minute=0.0,five-minute=0.0,mean=0.0,one-minute=0.0 1433867909363124859\r\n    store.fetch.duration.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363128004\r\n    store.store.duration.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363136722\r\n    aggregator.metric.count.meter,environment=devel,host=the.host.com count=0,fifteen-minute=0.0,five-minute=0.0,mean=0.0,one-minute=0.0 1433867909363145322\r\n    aggregator.aggregate.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363171425\r\n    aggregator.timescale.duration.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363180985\r\n    aggregator.timescale.count.meter,environment=devel,host=the.host.com count=0,fifteen-minute=0.0,five-minute=0.0,mean=0.0,one-minute=0.0 1433867909363198635\r\n    collector.collect_duration.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363201891\r\n    collector.errors.meter,environment=devel,host=the.host.com count=0,fifteen-minute=0.0,five-minute=0.0,mean=0.0,one-minute=0.0 1433867909363217543\r\n    notify.routing.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363220560\r\n    notify.notifications.meter,environment=devel,host=the.host.com count=0,fifteen-minute=0.0,five-minute=0.0,mean=0.0,one-minute=0.0 1433867909363229164\r\n    aggregator.metric.duration.timer,environment=devel,host=the.host.com 50-percentile=0.0,75-percentile=0.0,95-percentile=0.0,99-percentile=0.0,999-percentile=0.0,count=0,fifteen-minute=0.0,five-minute=0.0,max=0,mean=0.0,mean-rate=0.0,min=0,one-minute=0.0,std-dev=0.0 1433867909363242469\r\n    notify.backlog.count,environment=devel,host=the.host.com count=0 1433867909363251125\r\n\r\n\r\nServer OS: 64-bit Ubuntu 14.04.2 LTS, from .deb package\r\nClient OS: tested with Ubuntu 14.04.2 LTS and OS X 10.10.3\r\nRelease: 0.9 RC32"},"comment":{"url":"https://api.github.com/repos/influxdb/influxdb/issues/comments/110463952","html_url":"https://github.com/influxdb/influxdb/issues/2849#issuecomment-110463952","issue_url":"https://api.github.com/repos/influxdb/influxdb/issues/2849","id":110463952,"user":{"login":"jwilder","id":219935,"avatar_url":"https://avatars.githubusercontent.com/u/219935?v=3","gravatar_id":"","url":"https://api.github.com/users/jwilder","html_url":"https://github.com/jwilder","followers_url":"https://api.github.com/users/jwilder/followers","following_url":"https://api.github.com/users/jwilder/following{/other_user}","gists_url":"https://api.github.com/users/jwilder/gists{/gist_id}","starred_url":"https://api.github.com/users/jwilder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jwilder/subscriptions","organizations_url":"https://api.github.com/users/jwilder/orgs","repos_url":"https://api.github.com/users/jwilder/repos","events_url":"https://api.github.com/users/jwilder/events{/privacy}","received_events_url":"https://api.github.com/users/jwilder/received_events","type":"User","site_admin":false},"created_at":"2015-06-09T18:55:29Z","updated_at":"2015-06-09T18:55:29Z","body":"#2853 adds more logging to help troubleshoot write error."}}