{"action":"created","issue":{"url":"https://api.github.com/repos/mozilla-services/heka/issues/1256","labels_url":"https://api.github.com/repos/mozilla-services/heka/issues/1256/labels{/name}","comments_url":"https://api.github.com/repos/mozilla-services/heka/issues/1256/comments","events_url":"https://api.github.com/repos/mozilla-services/heka/issues/1256/events","html_url":"https://github.com/mozilla-services/heka/issues/1256","id":53373514,"number":1256,"title":"UdpInput needs parser_type even when I use raw input data","user":{"login":"liyichao","id":2576762,"avatar_url":"https://avatars.githubusercontent.com/u/2576762?v=3","gravatar_id":"","url":"https://api.github.com/users/liyichao","html_url":"https://github.com/liyichao","followers_url":"https://api.github.com/users/liyichao/followers","following_url":"https://api.github.com/users/liyichao/following{/other_user}","gists_url":"https://api.github.com/users/liyichao/gists{/gist_id}","starred_url":"https://api.github.com/users/liyichao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liyichao/subscriptions","organizations_url":"https://api.github.com/users/liyichao/orgs","repos_url":"https://api.github.com/users/liyichao/repos","events_url":"https://api.github.com/users/liyichao/events{/privacy}","received_events_url":"https://api.github.com/users/liyichao/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-01-05T08:16:52Z","updated_at":"2015-01-05T09:02:59Z","closed_at":null,"body":"the following config is not valid:\r\n\r\n    [UdpInput]\r\n    address = \":8125\"\r\n\r\nI have to use:\r\n\r\n    [UdpInput]\r\n    address = \":9125\"\r\n    parser_type = \"token\"\r\n\r\nBecause I would like to parse the data in my own filter, I do not want to use any parser from heka.\r\n\r\nOtherwise, I have to think of a delimiter.  There is \"\\n\" in my message body, so the default is not suitable to me. I have also tried to specify \"\\n\\n\" as my delimiter of my token parser, only to find that only one byte is allowed."},"comment":{"url":"https://api.github.com/repos/mozilla-services/heka/issues/comments/68682425","html_url":"https://github.com/mozilla-services/heka/issues/1256#issuecomment-68682425","issue_url":"https://api.github.com/repos/mozilla-services/heka/issues/1256","id":68682425,"user":{"login":"liyichao","id":2576762,"avatar_url":"https://avatars.githubusercontent.com/u/2576762?v=3","gravatar_id":"","url":"https://api.github.com/users/liyichao","html_url":"https://github.com/liyichao","followers_url":"https://api.github.com/users/liyichao/followers","following_url":"https://api.github.com/users/liyichao/following{/other_user}","gists_url":"https://api.github.com/users/liyichao/gists{/gist_id}","starred_url":"https://api.github.com/users/liyichao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liyichao/subscriptions","organizations_url":"https://api.github.com/users/liyichao/orgs","repos_url":"https://api.github.com/users/liyichao/repos","events_url":"https://api.github.com/users/liyichao/events{/privacy}","received_events_url":"https://api.github.com/users/liyichao/received_events","type":"User","site_admin":false},"created_at":"2015-01-05T09:02:59Z","updated_at":"2015-01-05T09:02:59Z","body":"I encounter this when I aggregate stats like p95, mean in my application, and want to use heka to further aggregate my stats.\r\n\r\nThe message UdpInput receives is the same as `heka.statmetric ` message that heka agents sent to a central heka server:\r\n\r\n>test.count 2 1420438130\r\ntest.count_ps 0.200000 1420438130\r\ntest.lower 1.000000 1420438130\r\ntest.upper 2.000000 1420438130\r\ntest.sum 3.000000 1420438130\r\ntest.mean 1.500000 1420438130\r\ntest.mean_95 1.500000 1420438130\r\ntest.upper_95 2.000000 1420438130\r\n\r\nInstead of using protobuf, I use plaintext protocol like graphite's for simplificity, but the metrics are p95, max, min which do not fit in statsd' type system, so I can't use statsdInput.\r\n\r\nThe solution I choose is to use UdpInput, and write a lua filter to aggregate them. Of course, I can use \"\\n\" as the delimiter, but that produces a message pack for every stat, which is not straightforward.\r\n\r\n"}}