{"action":"created","issue":{"url":"https://api.github.com/repos/snowplow/snowplow/issues/936","labels_url":"https://api.github.com/repos/snowplow/snowplow/issues/936/labels{/name}","comments_url":"https://api.github.com/repos/snowplow/snowplow/issues/936/comments","events_url":"https://api.github.com/repos/snowplow/snowplow/issues/936/events","html_url":"https://github.com/snowplow/snowplow/issues/936","id":39077949,"number":936,"title":"EmrEtlRunner: add ability to target existing persistent cluster","user":{"login":"alexanderdean","id":200511,"avatar_url":"https://avatars.githubusercontent.com/u/200511?v=3","gravatar_id":"","url":"https://api.github.com/users/alexanderdean","html_url":"https://github.com/alexanderdean","followers_url":"https://api.github.com/users/alexanderdean/followers","following_url":"https://api.github.com/users/alexanderdean/following{/other_user}","gists_url":"https://api.github.com/users/alexanderdean/gists{/gist_id}","starred_url":"https://api.github.com/users/alexanderdean/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexanderdean/subscriptions","organizations_url":"https://api.github.com/users/alexanderdean/orgs","repos_url":"https://api.github.com/users/alexanderdean/repos","events_url":"https://api.github.com/users/alexanderdean/events{/privacy}","received_events_url":"https://api.github.com/users/alexanderdean/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/snowplow/snowplow/labels/3.%20ETL","name":"3. ETL","color":"c3d69b"}],"state":"open","locked":false,"assignee":{"login":"alexanderdean","id":200511,"avatar_url":"https://avatars.githubusercontent.com/u/200511?v=3","gravatar_id":"","url":"https://api.github.com/users/alexanderdean","html_url":"https://github.com/alexanderdean","followers_url":"https://api.github.com/users/alexanderdean/followers","following_url":"https://api.github.com/users/alexanderdean/following{/other_user}","gists_url":"https://api.github.com/users/alexanderdean/gists{/gist_id}","starred_url":"https://api.github.com/users/alexanderdean/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexanderdean/subscriptions","organizations_url":"https://api.github.com/users/alexanderdean/orgs","repos_url":"https://api.github.com/users/alexanderdean/repos","events_url":"https://api.github.com/users/alexanderdean/events{/privacy}","received_events_url":"https://api.github.com/users/alexanderdean/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/snowplow/snowplow/milestones/72","html_url":"https://github.com/snowplow/snowplow/milestones/Persistent%20EMR%20cluster","labels_url":"https://api.github.com/repos/snowplow/snowplow/milestones/72/labels","id":934835,"number":72,"title":"Persistent EMR cluster","description":"","creator":{"login":"alexanderdean","id":200511,"avatar_url":"https://avatars.githubusercontent.com/u/200511?v=3","gravatar_id":"","url":"https://api.github.com/users/alexanderdean","html_url":"https://github.com/alexanderdean","followers_url":"https://api.github.com/users/alexanderdean/followers","following_url":"https://api.github.com/users/alexanderdean/following{/other_user}","gists_url":"https://api.github.com/users/alexanderdean/gists{/gist_id}","starred_url":"https://api.github.com/users/alexanderdean/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexanderdean/subscriptions","organizations_url":"https://api.github.com/users/alexanderdean/orgs","repos_url":"https://api.github.com/users/alexanderdean/repos","events_url":"https://api.github.com/users/alexanderdean/events{/privacy}","received_events_url":"https://api.github.com/users/alexanderdean/received_events","type":"User","site_admin":false},"open_issues":7,"closed_issues":0,"state":"open","created_at":"2015-01-14T10:11:17Z","updated_at":"2015-01-14T10:28:25Z","due_on":null,"closed_at":null},"comments":3,"created_at":"2014-07-30T10:09:33Z","updated_at":"2015-03-13T09:29:10Z","closed_at":null,"body":"Instead of spinning up a new cluster."},"comment":{"url":"https://api.github.com/repos/snowplow/snowplow/issues/comments/78886247","html_url":"https://github.com/snowplow/snowplow/issues/936#issuecomment-78886247","issue_url":"https://api.github.com/repos/snowplow/snowplow/issues/936","id":78886247,"user":{"login":"alexanderdean","id":200511,"avatar_url":"https://avatars.githubusercontent.com/u/200511?v=3","gravatar_id":"","url":"https://api.github.com/users/alexanderdean","html_url":"https://github.com/alexanderdean","followers_url":"https://api.github.com/users/alexanderdean/followers","following_url":"https://api.github.com/users/alexanderdean/following{/other_user}","gists_url":"https://api.github.com/users/alexanderdean/gists{/gist_id}","starred_url":"https://api.github.com/users/alexanderdean/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexanderdean/subscriptions","organizations_url":"https://api.github.com/users/alexanderdean/orgs","repos_url":"https://api.github.com/users/alexanderdean/repos","events_url":"https://api.github.com/users/alexanderdean/events{/privacy}","received_events_url":"https://api.github.com/users/alexanderdean/received_events","type":"User","site_admin":false},"created_at":"2015-03-13T09:29:10Z","updated_at":"2015-03-13T09:29:10Z","body":"Hi @ngocthanhit - my suggestion would be to add some startup code into Scala Hadoop Enrich and Hadoop Shred to clear out those file paths. You should be able to use something like `fullyDelete`: https://hadoop.apache.org/docs/r1.2.1/api/"}}