{"action":"closed","issue":{"url":"https://api.github.com/repos/uswitch/blueshift/issues/6","labels_url":"https://api.github.com/repos/uswitch/blueshift/issues/6/labels{/name}","comments_url":"https://api.github.com/repos/uswitch/blueshift/issues/6/comments","events_url":"https://api.github.com/repos/uswitch/blueshift/issues/6/events","html_url":"https://github.com/uswitch/blueshift/issues/6","id":52413810,"number":6,"title":"Odd error and Data is not loaded yet data files are removed!","user":{"login":"ryanmedlin","id":705959,"avatar_url":"https://avatars.githubusercontent.com/u/705959?v=3","gravatar_id":"","url":"https://api.github.com/users/ryanmedlin","html_url":"https://github.com/ryanmedlin","followers_url":"https://api.github.com/users/ryanmedlin/followers","following_url":"https://api.github.com/users/ryanmedlin/following{/other_user}","gists_url":"https://api.github.com/users/ryanmedlin/gists{/gist_id}","starred_url":"https://api.github.com/users/ryanmedlin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ryanmedlin/subscriptions","organizations_url":"https://api.github.com/users/ryanmedlin/orgs","repos_url":"https://api.github.com/users/ryanmedlin/repos","events_url":"https://api.github.com/users/ryanmedlin/events{/privacy}","received_events_url":"https://api.github.com/users/ryanmedlin/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2014-12-18T20:43:25Z","updated_at":"2015-02-01T18:25:25Z","closed_at":"2015-02-01T18:25:25Z","body":"\r\n\r\nI am getting this error sometimes when running blueshift.  It loads data \"sometimes\" but when it gets this error is does not BUT it still removes the data files form the bucket so the data does not get loaded.\r\n\r\n\r\nCan someone help me troubleshoot this or point me to how to get more forensics info?\r\n\r\nThanks!\r\n\r\n\r\n\r\n_rules_time_trigger_sunday,campaign_targeting_rules_communication_ids_idx_0,campaign_targeti\r\nng_rules_communication_ids_idx_1,campaign_targeting_rules_communication_ids_idx_2,campaign_t\r\nargeting_rules_communication_ids_idx_3,campaign_targeting_rules_communication_ids_idx_4,data\r\nsnap_timestamp,datasnap_created,datasnap_txn_id,datasnap_customer_txn_id,datasnap_device_use\r\nr_agent,datasnap_device_ip_address,datasnap_device_platform,datasnap_device_os_version,datas\r\nnap_device_model,datasnap_device_manufacturer,datasnap_device_name,datasnap_device_vendor_id\r\n,datasnap_device_carrier_name,datasnap_device_country_code,datasnap_device_network_code) FRO\r\nM 's3://datasnap-events-staging-latest-flattened-redshift/c954b50a-29d4-4ce7-a623-91afe752e7\r\n07.manifest' CREDENTIALS 'aws_access_key_id=AKIAJLGOZADWN3CH5NSA;aws_secret_access_key=EUxsq\r\nwnJzdJUmSzfZ+ZlhupPkfaden23CL27mVXX' TIMEFORMAT 'auto' EMPTYASNULL BLANKSASNULL manifest\r\n[async-thread-macro-3] ERROR uswitch.blueshift.redshift - ROLLBACK\r\njava.sql.SQLException: ERROR: Mandatory url is not present in manifest file.\r\n        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.j\r\nava:1501)\r\n        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:12\r\n83)\r\n        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:186)\r\n        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:3\r\n92)\r\n        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Stateme\r\nnt.java:330)\r\n        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:3\r\n21)\r\n        at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)\r\n        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java\r\n:43)\r\n        at java.lang.reflect.Method.invoke(Method.java:606)\r\n        at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)\r\n        at clojure.lang.Reflector.invokeNoArgInstanceMember(Reflector.java:313)\r\n        at uswitch.blueshift.redshift$execute$fn__10871.invoke(redshift.clj:103)\r\n        at uswitch.blueshift.redshift$execute.doInvoke(redshift.clj:103)\r\n        at clojure.lang.RestFn.invoke(RestFn.java:482)\r\n        at uswitch.blueshift.redshift$merge_table.invoke(redshift.clj:117)\r\n        at uswitch.blueshift.redshift$load_table.invoke(redshift.clj:138)\r\n        at uswitch.blueshift.redshift.Loader$fn__10919$fn__10922$fn__10923.invoke(redshift.$lj:160)\r\n        at uswitch.blueshift.redshift.proxy$java.lang.Object$Callable$7da976d4.call(Unknown Source)\r\n        at com.codahale.metrics.Timer.time(Timer.java:99)\r\n        at uswitch.blueshift.redshift.Loader$fn__10919$fn__10922.invoke(redshift.clj:159)\r\n        at uswitch.blueshift.redshift.Loader$fn__10919.invoke(redshift.clj:159)\r\n        at clojure.core.async$thread_call$fn__6407$fn__6408.invoke(async.clj:390)\r\n        at clojure.core.async$thread_call$fn__6407.invoke(async.clj:390)\r\n        at clojure.lang.AFn.run(AFn.java:22)\r\n        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\r\n        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n        at java.lang.Thread.run(Thread.java:745)\r\n[async-thread-macro-3] ERROR uswitch.blueshift.redshift - Error loading into raw_events_fin$l_temp\r\njava.sql.SQLException: ERROR: Mandatory url is not present in manifest file.\r\n        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.$ava:1501)\r\n        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1$83)\r\n        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:186)\r\n        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:$92)"}}