{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7696","labels_url":"https://api.github.com/repos/apache/spark/issues/7696/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7696/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7696/events","html_url":"https://github.com/apache/spark/pull/7696","id":97464612,"number":7696,"title":"[SPARK-9381][SQL]Migrate JSON data source to the new partitioning data source","user":{"login":"chenghao-intel","id":2367031,"avatar_url":"https://avatars.githubusercontent.com/u/2367031?v=3","gravatar_id":"","url":"https://api.github.com/users/chenghao-intel","html_url":"https://github.com/chenghao-intel","followers_url":"https://api.github.com/users/chenghao-intel/followers","following_url":"https://api.github.com/users/chenghao-intel/following{/other_user}","gists_url":"https://api.github.com/users/chenghao-intel/gists{/gist_id}","starred_url":"https://api.github.com/users/chenghao-intel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chenghao-intel/subscriptions","organizations_url":"https://api.github.com/users/chenghao-intel/orgs","repos_url":"https://api.github.com/users/chenghao-intel/repos","events_url":"https://api.github.com/users/chenghao-intel/events{/privacy}","received_events_url":"https://api.github.com/users/chenghao-intel/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":75,"created_at":"2015-07-27T13:33:41Z","updated_at":"2015-08-05T02:26:29Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7696","html_url":"https://github.com/apache/spark/pull/7696","diff_url":"https://github.com/apache/spark/pull/7696.diff","patch_url":"https://github.com/apache/spark/pull/7696.patch"},"body":"Support partitioning for the JSON data source.\r\n\r\nStill 2 open issues for the `HadoopFsRelation`\r\n- `refresh()` will invoke the `discoveryPartition()`, which will auto infer the data type for the partition columns, and maybe conflict with the given partition columns. (TODO enable `HadoopFsRelationSuite.Partition column type casting\"\r\n- When insert data into a cached HadoopFsRelation based table, we need to invalidate the cache after the insertion (TODO enable `InsertSuite.Caching`)"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/127821773","html_url":"https://github.com/apache/spark/pull/7696#issuecomment-127821773","issue_url":"https://api.github.com/repos/apache/spark/issues/7696","id":127821773,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-08-05T02:26:29Z","updated_at":"2015-08-05T02:26:29Z","body":"  [Test build #39791 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39791/console) for   PR 7696 at commit [`d90b104`](https://github.com/apache/spark/commit/d90b1047959fa5b1ef08c7c71c76991ebd4e3d28).\n * This patch **passes all tests**.\n * This patch merges cleanly.\n * This patch adds no public classes."}}