{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/2849","labels_url":"https://api.github.com/repos/apache/spark/issues/2849/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/2849/comments","events_url":"https://api.github.com/repos/apache/spark/issues/2849/events","html_url":"https://github.com/apache/spark/pull/2849","id":46223191,"number":2849,"title":"[SPARK-3561] Initial commit to provide pluggable strategy to facilitate access to nat...","user":{"login":"olegz","id":172397,"avatar_url":"https://avatars.githubusercontent.com/u/172397?v=3","gravatar_id":"","url":"https://api.github.com/users/olegz","html_url":"https://github.com/olegz","followers_url":"https://api.github.com/users/olegz/followers","following_url":"https://api.github.com/users/olegz/following{/other_user}","gists_url":"https://api.github.com/users/olegz/gists{/gist_id}","starred_url":"https://api.github.com/users/olegz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/olegz/subscriptions","organizations_url":"https://api.github.com/users/olegz/orgs","repos_url":"https://api.github.com/users/olegz/repos","events_url":"https://api.github.com/users/olegz/events{/privacy}","received_events_url":"https://api.github.com/users/olegz/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2014-10-20T00:40:17Z","updated_at":"2015-06-16T19:59:13Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/2849","html_url":"https://github.com/apache/spark/pull/2849","diff_url":"https://github.com/apache/spark/pull/2849.diff","patch_url":"https://github.com/apache/spark/pull/2849.patch"},"body":"Initial commit to provide pluggable strategy to facilitate access to native Hadoop resources\r\n\r\nAdded HadoopExecutionContext trait and its default implementation DefaultHadoopExecutionContext\r\nModified SparkContext to instantiate and delegate to the instance of HadoopExecutionContext where appropriate\r\n\r\nChanged HadoopExecutionContext to JobExecutionContext\r\nChanged DefaultHadoopExecutionContext to DefaultExecutionContext\r\nName changes are due to the fact that when Spark executes outside of Hadoop having Hadoop in the name woudl be confusing\r\nAdded initial documentation and tests\r\n\r\npolished scaladoc\r\n\r\nannotated JobExecutionContext with @DeveloperAPI\r\n\r\neliminated TaskScheduler null checks in favor of NoOpTaskScheduler\r\nto be used in cases where execution of Spark DAG is delegated to an external execution environment\r\n\r\nadded execution-context check to SparkSubmit\r\n\r\nAdded recognition of execution-context to SparkContext\r\nupdated spark-class script to recognize when 'execution-context:' is used\r\n\r\npolished merge\r\n\r\nchanged annotations from @DeveloperApi to @Experimental as part of the PR suggestion\r\n\r\nexternalized persist and unpersist operations\r\n\r\nadded classpath hooks to spark-class"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/112551214","html_url":"https://github.com/apache/spark/pull/2849#issuecomment-112551214","issue_url":"https://api.github.com/repos/apache/spark/issues/2849","id":112551214,"user":{"login":"olegz","id":172397,"avatar_url":"https://avatars.githubusercontent.com/u/172397?v=3","gravatar_id":"","url":"https://api.github.com/users/olegz","html_url":"https://github.com/olegz","followers_url":"https://api.github.com/users/olegz/followers","following_url":"https://api.github.com/users/olegz/following{/other_user}","gists_url":"https://api.github.com/users/olegz/gists{/gist_id}","starred_url":"https://api.github.com/users/olegz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/olegz/subscriptions","organizations_url":"https://api.github.com/users/olegz/orgs","repos_url":"https://api.github.com/users/olegz/repos","events_url":"https://api.github.com/users/olegz/events{/privacy}","received_events_url":"https://api.github.com/users/olegz/received_events","type":"User","site_admin":false},"created_at":"2015-06-16T19:59:13Z","updated_at":"2015-06-16T19:59:13Z","body":"Well, I am waiting in the resolution of https://issues.apache.org/jira/browse/SPARK-3561 since it has recently been updated to \"In Progress\". I would rather update the PR, to make it mergable unless there is a different proposed approach which I would like to read about."}}