{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/9258","labels_url":"https://api.github.com/repos/apache/spark/issues/9258/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/9258/comments","events_url":"https://api.github.com/repos/apache/spark/issues/9258/events","html_url":"https://github.com/apache/spark/pull/9258","id":113124090,"number":9258,"title":"[SPARK-8582][Core]Optimize checkpointing to avoid computing an RDD twice","user":{"login":"zsxwing","id":1000778,"avatar_url":"https://avatars.githubusercontent.com/u/1000778?v=3","gravatar_id":"","url":"https://api.github.com/users/zsxwing","html_url":"https://github.com/zsxwing","followers_url":"https://api.github.com/users/zsxwing/followers","following_url":"https://api.github.com/users/zsxwing/following{/other_user}","gists_url":"https://api.github.com/users/zsxwing/gists{/gist_id}","starred_url":"https://api.github.com/users/zsxwing/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zsxwing/subscriptions","organizations_url":"https://api.github.com/users/zsxwing/orgs","repos_url":"https://api.github.com/users/zsxwing/repos","events_url":"https://api.github.com/users/zsxwing/events{/privacy}","received_events_url":"https://api.github.com/users/zsxwing/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2015-10-24T01:03:44Z","updated_at":"2015-10-27T10:54:21Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/9258","html_url":"https://github.com/apache/spark/pull/9258","diff_url":"https://github.com/apache/spark/pull/9258.diff","patch_url":"https://github.com/apache/spark/pull/9258.patch"},"body":"Unlike #7021, this PR uses an approach similar to `persist` to compute and checkpoint an RDD at the same job. When computing an RDD at the first time, each partition will be checkpointed and read back as  an iterator (maybe compute it again, not sure which one is better). After finishing the job, we also check if all partitions are checkpointed, if not, we still need to launch a job to checkpoint the missing partitions."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/151455069","html_url":"https://github.com/apache/spark/pull/9258#issuecomment-151455069","issue_url":"https://api.github.com/repos/apache/spark/issues/9258","id":151455069,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-10-27T10:54:21Z","updated_at":"2015-10-27T10:54:21Z","body":"Test FAILed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44417/\nTest FAILed."}}