{"action":"created","issue":{"url":"https://api.github.com/repos/logstash-plugins/logstash-filter-de_dot/issues/6","labels_url":"https://api.github.com/repos/logstash-plugins/logstash-filter-de_dot/issues/6/labels{/name}","comments_url":"https://api.github.com/repos/logstash-plugins/logstash-filter-de_dot/issues/6/comments","events_url":"https://api.github.com/repos/logstash-plugins/logstash-filter-de_dot/issues/6/events","html_url":"https://github.com/logstash-plugins/logstash-filter-de_dot/issues/6","id":121041972,"number":6,"title":"de-dot filter not working on json codec","user":{"login":"pkr1234","id":11294187,"avatar_url":"https://avatars.githubusercontent.com/u/11294187?v=3","gravatar_id":"","url":"https://api.github.com/users/pkr1234","html_url":"https://github.com/pkr1234","followers_url":"https://api.github.com/users/pkr1234/followers","following_url":"https://api.github.com/users/pkr1234/following{/other_user}","gists_url":"https://api.github.com/users/pkr1234/gists{/gist_id}","starred_url":"https://api.github.com/users/pkr1234/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pkr1234/subscriptions","organizations_url":"https://api.github.com/users/pkr1234/orgs","repos_url":"https://api.github.com/users/pkr1234/repos","events_url":"https://api.github.com/users/pkr1234/events{/privacy}","received_events_url":"https://api.github.com/users/pkr1234/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-12-08T16:16:01Z","updated_at":"2015-12-08T20:20:12Z","closed_at":null,"body":"I've configured my logstash agent (which does NOT have the de-dot filter) to send logs to Redis. \r\n\r\n```\r\n        file {\r\n                type => \"myapplog\"\r\n                path => [\"/var/log/myapp/application/*.log\"]\r\n                exclude => [\"*.gz\"]\r\n\t\tcodec => \"json\"\r\n        }\r\n```\r\n\r\n\r\nOn the Server side, my logstash server HAS the de-dot filter installed. It pulls data from redis and pushes into elasticsearch, But my logs are filled with errors related to \".\" character. I have three fields that are dodgy and I'm expecting de-dot filter to handle them\r\n\r\n\r\n```\r\n{:timestamp=>\"2015-12-08T15:35:31.908000+0000\", :message=>\"Failed action. \", :status=>400, :action=>[\"index\", {:_id=>nil, :_index=>\"logstash-2015.12.08\", :_type=>\"tomcatapplog\", :_routing=>nil}, #<LogStash::Event:0x5e4eb538 @metadata={\"retry_count\"=>0}, @accessors=#<LogStash::Util::Accessors:0x265ef763 @store={\"@timestamp\"=>\"2015-12-08T14:16:00.215Z\", \"@version\"=>1, \"message\"=>\"Refreshing WebApplicationContext for namespace 'health-check-dispatcher-servlet': startup date [Tue Dec 08 14:16:00 UTC 2015]; parent: Root WebApplicationContext\", \"logger_name\"=>\"org.springframework.web.context.support.AnnotationConfigWebApplicationContext\", \"thread_name\"=>\"localhost-startStop-1\", \"level\"=>\"INFO\", \"level_value\"=>20000, \"HOSTNAME\"=>\"ip-10-0-0-10\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|timestamp\"=>\"1449584159077\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|transactionID\"=>\"[t-2024875724-1]\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|commitTimestamp\"=>\"1449584159077\", \"caller_class_name\"=>\"org.springframework.context.support.AbstractApplicationContext\", \"caller_method_name\"=>\"prepareRefresh\", \"caller_file_name\"=>\"AbstractApplicationContext.java\", \"caller_line_number\"=>510, \"service\"=>\"myservice\", \"host\"=>\"ip-10-0-0-10\", \"path\"=>\"/var/log/tomcat8/application/myservice.log\", \"type\"=>\"tomcatapplog\", \"TemplateTagName\"=>\"___TEST___\", \"Application\"=>\"General\", \"Cluster\"=>\"_Tomcat_\", \"InstanceId\"=>\"i-1172069a\", \"InstancePrivateIp\"=>\"10.0.0.10\"}, @lut={\"type\"=>[{\"@timestamp\"=>\"2015-12-08T14:16:00.215Z\", \"@version\"=>1, \"message\"=>\"Refreshing WebApplicationContext for namespace 'health-check-dispatcher-servlet': startup date [Tue Dec 08 14:16:00 UTC 2015]; parent: Root WebApplicationContext\", \"logger_name\"=>\"org.springframework.web.context.support.AnnotationConfigWebApplicationContext\", \"thread_name\"=>\"localhost-startStop-1\", \"level\"=>\"INFO\", \"level_value\"=>20000, \"HOSTNAME\"=>\"ip-10-0-0-10\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|timestamp\"=>\"1449584159077\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|transactionID\"=>\"[t-2024875724-1]\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|commitTimestamp\"=>\"1449584159077\", \"caller_class_name\"=>\"org.springframework.context.support.AbstractApplicationContext\", \"caller_method_name\"=>\"prepareRefresh\", \"caller_file_name\"=>\"AbstractApplicationContext.java\", \"caller_line_number\"=>510, \"service\"=>\"myservice\", \"host\"=>\"ip-10-0-0-10\", \"path\"=>\"/var/log/tomcat8/application/myservice.log\", \"type\"=>\"tomcatapplog\", \"TemplateTagName\"=>\"___TEST___\", \"Application\"=>\"General\", \"Cluster\"=>\"_Tomcat_\", \"InstanceId\"=>\"i-1172069a\", \"InstancePrivateIp\"=>\"10.0.0.10\"}, \"type\"]}>, @data={\"@timestamp\"=>\"2015-12-08T14:16:00.215Z\", \"@version\"=>1, \"message\"=>\"Refreshing WebApplicationContext for namespace 'health-check-dispatcher-servlet': startup date [Tue Dec 08 14:16:00 UTC 2015]; parent: Root WebApplicationContext\", \"logger_name\"=>\"org.springframework.web.context.support.AnnotationConfigWebApplicationContext\", \"thread_name\"=>\"localhost-startStop-1\", \"level\"=>\"INFO\", \"level_value\"=>20000, \"HOSTNAME\"=>\"ip-10-0-0-10\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|timestamp\"=>\"1449584159077\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|transactionID\"=>\"[t-2024875724-1]\", \"com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|commitTimestamp\"=>\"1449584159077\", \"caller_class_name\"=>\"org.springframework.context.support.AbstractApplicationContext\", \"caller_method_name\"=>\"prepareRefresh\", \"caller_file_name\"=>\"AbstractApplicationContext.java\", \"caller_line_number\"=>510, \"service\"=>\"myservice\", \"host\"=>\"ip-10-0-0-10\", \"path\"=>\"/var/log/tomcat8/application/myservice.log\", \"type\"=>\"tomcatapplog\", \"TemplateTagName\"=>\"___TEST___\", \"Application\"=>\"General\", \"Cluster\"=>\"_Tomcat_\", \"InstanceId\"=>\"i-1172069a\", \"InstancePrivateIp\"=>\"10.0.0.10\"}, @metadata_accessors=#<LogStash::Util::Accessors:0x27c58846 @store={\"retry_count\"=>0}, @lut={}>, @cancelled=false>], :response=>{\"create\"=>{\"_index\"=>\"logstash-2015.12.08\", \"_type\"=>\"myapplog\", \"_id\"=>\"AVGCO7whlPprfuh1wD8C\", \"status\"=>400, \"error\"=>{\"type\"=>\"mapper_parsing_exception\", \"reason\"=>\"Field name [com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|commitTimestamp] cannot contain '.'\"}}}, :level=>:warn}\r\n\r\n```\r\n\r\n\r\ne.g.\r\n\r\n```\r\n\"reason\"=>\"Field name [com.cc.sqllogging.mysqlinterceptors.v1.services.impl.SLF4JLogService|commitTimestamp] cannot contain '.'\"}}}, :level=>:warn}\r\n```"},"comment":{"url":"https://api.github.com/repos/logstash-plugins/logstash-filter-de_dot/issues/comments/163005221","html_url":"https://github.com/logstash-plugins/logstash-filter-de_dot/issues/6#issuecomment-163005221","issue_url":"https://api.github.com/repos/logstash-plugins/logstash-filter-de_dot/issues/6","id":163005221,"user":{"login":"mogadanez","id":790307,"avatar_url":"https://avatars.githubusercontent.com/u/790307?v=3","gravatar_id":"","url":"https://api.github.com/users/mogadanez","html_url":"https://github.com/mogadanez","followers_url":"https://api.github.com/users/mogadanez/followers","following_url":"https://api.github.com/users/mogadanez/following{/other_user}","gists_url":"https://api.github.com/users/mogadanez/gists{/gist_id}","starred_url":"https://api.github.com/users/mogadanez/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mogadanez/subscriptions","organizations_url":"https://api.github.com/users/mogadanez/orgs","repos_url":"https://api.github.com/users/mogadanez/repos","events_url":"https://api.github.com/users/mogadanez/events{/privacy}","received_events_url":"https://api.github.com/users/mogadanez/received_events","type":"User","site_admin":false},"created_at":"2015-12-08T20:20:12Z","updated_at":"2015-12-08T20:20:12Z","body":"in my case \"dotted\" filed is nested deep in source JSON\r\n```\r\n{\r\n...\r\n\"query_options:{\r\n \"q.op\": \"AND\"\r\n}\r\n...\r\n}\r\n```"}}