{"action":"created","issue":{"url":"https://api.github.com/repos/shinsaka/fluent-plugin-elb-log/issues/16","labels_url":"https://api.github.com/repos/shinsaka/fluent-plugin-elb-log/issues/16/labels{/name}","comments_url":"https://api.github.com/repos/shinsaka/fluent-plugin-elb-log/issues/16/comments","events_url":"https://api.github.com/repos/shinsaka/fluent-plugin-elb-log/issues/16/events","html_url":"https://github.com/shinsaka/fluent-plugin-elb-log/issues/16","id":110600354,"number":16,"title":"ELB logs not reflecting in ElasticSearch for a custom index.","user":{"login":"paritosh16","id":10785743,"avatar_url":"https://avatars.githubusercontent.com/u/10785743?v=3","gravatar_id":"","url":"https://api.github.com/users/paritosh16","html_url":"https://github.com/paritosh16","followers_url":"https://api.github.com/users/paritosh16/followers","following_url":"https://api.github.com/users/paritosh16/following{/other_user}","gists_url":"https://api.github.com/users/paritosh16/gists{/gist_id}","starred_url":"https://api.github.com/users/paritosh16/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/paritosh16/subscriptions","organizations_url":"https://api.github.com/users/paritosh16/orgs","repos_url":"https://api.github.com/users/paritosh16/repos","events_url":"https://api.github.com/users/paritosh16/events{/privacy}","received_events_url":"https://api.github.com/users/paritosh16/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-10-09T07:13:34Z","updated_at":"2015-10-13T04:26:37Z","closed_at":null,"body":"I have the following configuration for grabbing ELB logs from S3.\r\n```\r\n<source>\r\n  type elb_log\r\n  access_key_id     \r\n  secret_access_key \r\n  region            \r\n  s3_bucketname    \r\n  s3_prefix         \r\n  timestamp_file   \r\n  buf_file          \r\n  refresh_interval  \r\n  tag               \r\n</source>\r\n```\r\nI have defined the mapping for the ELB logs in elasticSearch. The plugin doesn't process the ELB logs for a custom index that I define. The log statements like `Processing 0 objects` reflect into ES. \r\n\r\nTo be honest, I really don't know if this is a issue at ES level or plugin level. The plugin logs are getting into ES but ELB logs aren't. Thank you for the help."},"comment":{"url":"https://api.github.com/repos/shinsaka/fluent-plugin-elb-log/issues/comments/147598591","html_url":"https://github.com/shinsaka/fluent-plugin-elb-log/issues/16#issuecomment-147598591","issue_url":"https://api.github.com/repos/shinsaka/fluent-plugin-elb-log/issues/16","id":147598591,"user":{"login":"paritosh16","id":10785743,"avatar_url":"https://avatars.githubusercontent.com/u/10785743?v=3","gravatar_id":"","url":"https://api.github.com/users/paritosh16","html_url":"https://github.com/paritosh16","followers_url":"https://api.github.com/users/paritosh16/followers","following_url":"https://api.github.com/users/paritosh16/following{/other_user}","gists_url":"https://api.github.com/users/paritosh16/gists{/gist_id}","starred_url":"https://api.github.com/users/paritosh16/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/paritosh16/subscriptions","organizations_url":"https://api.github.com/users/paritosh16/orgs","repos_url":"https://api.github.com/users/paritosh16/repos","events_url":"https://api.github.com/users/paritosh16/events{/privacy}","received_events_url":"https://api.github.com/users/paritosh16/received_events","type":"User","site_admin":false},"created_at":"2015-10-13T04:26:36Z","updated_at":"2015-10-13T04:26:36Z","body":"These are the fluentd's logs that are getting into ElasticSearch. \r\n```\r\n2015-10-13 02:38:42 +0000 [info]: processing 0 object(s).\r\n2015-10-13 02:43:42 +0000 [info]: processing 0 object(s).\r\n2015-10-13 02:48:42 +0000 [info]: processing 0 object(s).\r\n2015-10-13 02:53:42 +0000 [info]: processing 0 object(s).\r\n2015-10-13 02:58:42 +0000 [info]: processing 0 object(s).\r\n2015-10-13 03:03:42 +0000 [info]: processing 1 object(s).\r\n2015-10-13 03:08:43 +0000 [info]: processing 0 object(s).\r\n2015-10-13 03:13:43 +0000 [info]: processing 0 object(s).\r\n2015-10-13 03:18:43 +0000 [info]: processing 0 object(s).\r\n```\r\nI can see nothing in the logs that suggest me that fluentd is failing. But I think it is because fluent logs are getting through and the ones from S3 aren't."}}