{"action":"created","issue":{"url":"https://api.github.com/repos/klokantech/hawk/issues/75","labels_url":"https://api.github.com/repos/klokantech/hawk/issues/75/labels{/name}","comments_url":"https://api.github.com/repos/klokantech/hawk/issues/75/comments","events_url":"https://api.github.com/repos/klokantech/hawk/issues/75/events","html_url":"https://github.com/klokantech/hawk/issues/75","id":115744436,"number":75,"title":"All process running?","user":{"login":"mzeinstra","id":5627431,"avatar_url":"https://avatars.githubusercontent.com/u/5627431?v=3","gravatar_id":"","url":"https://api.github.com/users/mzeinstra","html_url":"https://github.com/mzeinstra","followers_url":"https://api.github.com/users/mzeinstra/followers","following_url":"https://api.github.com/users/mzeinstra/following{/other_user}","gists_url":"https://api.github.com/users/mzeinstra/gists{/gist_id}","starred_url":"https://api.github.com/users/mzeinstra/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mzeinstra/subscriptions","organizations_url":"https://api.github.com/users/mzeinstra/orgs","repos_url":"https://api.github.com/users/mzeinstra/repos","events_url":"https://api.github.com/users/mzeinstra/events{/privacy}","received_events_url":"https://api.github.com/users/mzeinstra/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":27,"created_at":"2015-11-08T17:03:03Z","updated_at":"2015-11-19T17:08:51Z","closed_at":"2015-11-10T14:20:30Z","body":"I've done a large ingestion on thursday as you can see in AWS CloudWatch:\r\n\r\n![screen shot 2015-11-08 at 18 01 14](https://cloud.githubusercontent.com/assets/5627431/11021490/c8daf67e-8642-11e5-9101-70f6ab896ee7.png)\r\n\r\nMy records say that I've uploaded metadata for about 360k records. As is only 50k records have been ingested into cloudsearch (searchable documents) and the processing has been reasonable quiet since.\r\n\r\nHas the ingestion processes stopped?"},"comment":{"url":"https://api.github.com/repos/klokantech/hawk/issues/comments/158121252","html_url":"https://github.com/klokantech/hawk/issues/75#issuecomment-158121252","issue_url":"https://api.github.com/repos/klokantech/hawk/issues/75","id":158121252,"user":{"login":"o1da","id":2953202,"avatar_url":"https://avatars.githubusercontent.com/u/2953202?v=3","gravatar_id":"","url":"https://api.github.com/users/o1da","html_url":"https://github.com/o1da","followers_url":"https://api.github.com/users/o1da/followers","following_url":"https://api.github.com/users/o1da/following{/other_user}","gists_url":"https://api.github.com/users/o1da/gists{/gist_id}","starred_url":"https://api.github.com/users/o1da/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/o1da/subscriptions","organizations_url":"https://api.github.com/users/o1da/orgs","repos_url":"https://api.github.com/users/o1da/repos","events_url":"https://api.github.com/users/o1da/events{/privacy}","received_events_url":"https://api.github.com/users/o1da/received_events","type":"User","site_admin":false},"created_at":"2015-11-19T17:08:51Z","updated_at":"2015-11-19T17:08:51Z","body":"I have just checked ingestion process and your last batches are done. It seems that most of items were added - I can't see any 'Interaction with Cloud Search failed' error. \r\n\r\nCan you run your script to identify count of all specific error?\r\n\r\nIf there would appear errors connected with download or upload you should try send batches 73 and 74 again.\r\n\r\nAccording to the last changes you can send these batches in original state - already ingested items without any modifications don't trigger any \"expensive\" action."}}