{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/elasticsearch/issues/14888","labels_url":"https://api.github.com/repos/elastic/elasticsearch/issues/14888/labels{/name}","comments_url":"https://api.github.com/repos/elastic/elasticsearch/issues/14888/comments","events_url":"https://api.github.com/repos/elastic/elasticsearch/issues/14888/events","html_url":"https://github.com/elastic/elasticsearch/pull/14888","id":118047923,"number":14888,"title":"[Ingest] Ingest better bulk failure handling","user":{"login":"martijnvg","id":580421,"avatar_url":"https://avatars.githubusercontent.com/u/580421?v=3","gravatar_id":"","url":"https://api.github.com/users/martijnvg","html_url":"https://github.com/martijnvg","followers_url":"https://api.github.com/users/martijnvg/followers","following_url":"https://api.github.com/users/martijnvg/following{/other_user}","gists_url":"https://api.github.com/users/martijnvg/gists{/gist_id}","starred_url":"https://api.github.com/users/martijnvg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/martijnvg/subscriptions","organizations_url":"https://api.github.com/users/martijnvg/orgs","repos_url":"https://api.github.com/users/martijnvg/repos","events_url":"https://api.github.com/users/martijnvg/events{/privacy}","received_events_url":"https://api.github.com/users/martijnvg/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/elastic/elasticsearch/labels/:Plugin%20ingest","name":":Plugin ingest","color":"009800"},{"url":"https://api.github.com/repos/elastic/elasticsearch/labels/review","name":"review","color":"0052cc"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-11-20T14:02:58Z","updated_at":"2015-11-23T16:22:27Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/elastic/elasticsearch/pulls/14888","html_url":"https://github.com/elastic/elasticsearch/pull/14888","diff_url":"https://github.com/elastic/elasticsearch/pull/14888.diff","patch_url":"https://github.com/elastic/elasticsearch/pull/14888.patch"},"body":"With this change if ingest pipeline fails only the index request in the bulk fails whereas right now the entire bulk request is failed.\r\n\r\nIf pipeline processing fails then the index request gets reported as a failure in the bulk response in its respective place. The index request will not be executed after pipeline processing has been completed.\r\n\r\nIf pipeline failures occur a new bulk request will be created based on the current bulk request. Only index requests that have successfully been processed by the pipeline will be included in this new bulk request. Then when sending back the bulk response the new bulk request will map its response items in such a way that the order of all items and errors is the same and matches with the original bulk request that was sent."},"comment":{"url":"https://api.github.com/repos/elastic/elasticsearch/issues/comments/158985649","html_url":"https://github.com/elastic/elasticsearch/pull/14888#issuecomment-158985649","issue_url":"https://api.github.com/repos/elastic/elasticsearch/issues/14888","id":158985649,"user":{"login":"martijnvg","id":580421,"avatar_url":"https://avatars.githubusercontent.com/u/580421?v=3","gravatar_id":"","url":"https://api.github.com/users/martijnvg","html_url":"https://github.com/martijnvg","followers_url":"https://api.github.com/users/martijnvg/followers","following_url":"https://api.github.com/users/martijnvg/following{/other_user}","gists_url":"https://api.github.com/users/martijnvg/gists{/gist_id}","starred_url":"https://api.github.com/users/martijnvg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/martijnvg/subscriptions","organizations_url":"https://api.github.com/users/martijnvg/orgs","repos_url":"https://api.github.com/users/martijnvg/repos","events_url":"https://api.github.com/users/martijnvg/events{/privacy}","received_events_url":"https://api.github.com/users/martijnvg/received_events","type":"User","site_admin":false},"created_at":"2015-11-23T16:22:27Z","updated_at":"2015-11-23T16:22:27Z","body":"@javanna thanks, I updated the PR."}}