{"action":"created","issue":{"url":"https://api.github.com/repos/snowplow/sql-runner/issues/37","labels_url":"https://api.github.com/repos/snowplow/sql-runner/issues/37/labels{/name}","comments_url":"https://api.github.com/repos/snowplow/sql-runner/issues/37/comments","events_url":"https://api.github.com/repos/snowplow/sql-runner/issues/37/events","html_url":"https://github.com/snowplow/sql-runner/issues/37","id":106655790,"number":37,"title":"Optional steps and/or queries","user":{"login":"andrioni","id":159177,"avatar_url":"https://avatars.githubusercontent.com/u/159177?v=3","gravatar_id":"","url":"https://api.github.com/users/andrioni","html_url":"https://github.com/andrioni","followers_url":"https://api.github.com/users/andrioni/followers","following_url":"https://api.github.com/users/andrioni/following{/other_user}","gists_url":"https://api.github.com/users/andrioni/gists{/gist_id}","starred_url":"https://api.github.com/users/andrioni/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andrioni/subscriptions","organizations_url":"https://api.github.com/users/andrioni/orgs","repos_url":"https://api.github.com/users/andrioni/repos","events_url":"https://api.github.com/users/andrioni/events{/privacy}","received_events_url":"https://api.github.com/users/andrioni/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-09-15T21:54:14Z","updated_at":"2015-12-10T18:04:01Z","closed_at":null,"body":"The ability to skip some steps and/or queries sometimes would be nice.\r\n\r\nMy current use case: I'm using sql-runner to load data into Redshift using a dynamically generated manifest file, and sometimes the manifest file ends up empty. Whenever that happens, `COPY` just errors out.\r\n\r\nAnother option would be to say certain error codes are acceptable.\r\n\r\n(this also might move sql-runner dangerously close to being a full-fledged workflow scheduler, heh)\r\n\r\nRelated to #32."},"comment":{"url":"https://api.github.com/repos/snowplow/sql-runner/issues/comments/163704313","html_url":"https://github.com/snowplow/sql-runner/issues/37#issuecomment-163704313","issue_url":"https://api.github.com/repos/snowplow/sql-runner/issues/37","id":163704313,"user":{"login":"iaingray","id":3766748,"avatar_url":"https://avatars.githubusercontent.com/u/3766748?v=3","gravatar_id":"","url":"https://api.github.com/users/iaingray","html_url":"https://github.com/iaingray","followers_url":"https://api.github.com/users/iaingray/followers","following_url":"https://api.github.com/users/iaingray/following{/other_user}","gists_url":"https://api.github.com/users/iaingray/gists{/gist_id}","starred_url":"https://api.github.com/users/iaingray/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/iaingray/subscriptions","organizations_url":"https://api.github.com/users/iaingray/orgs","repos_url":"https://api.github.com/users/iaingray/repos","events_url":"https://api.github.com/users/iaingray/events{/privacy}","received_events_url":"https://api.github.com/users/iaingray/received_events","type":"User","site_admin":false},"created_at":"2015-12-10T18:04:01Z","updated_at":"2015-12-10T18:04:01Z","body":"This would be useful to us as well to provide graceful failure.  At the moment we have situations where (for example) reference table update queries break for some reason, and as a result the entire ETL process dies and has to be restarted from the point of breakage.\r\n\r\nI agree though it shouldn't be silent, some sort of alert needs to be fired off to let ops know a step has failed.\r\n\r\n"}}