{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7238","labels_url":"https://api.github.com/repos/apache/spark/issues/7238/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7238/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7238/events","html_url":"https://github.com/apache/spark/pull/7238","id":93255022,"number":7238,"title":"[SPARK-8838][SQL] Add config to enable/disable merging part-files when merging parquet schema","user":{"login":"viirya","id":68855,"avatar_url":"https://avatars.githubusercontent.com/u/68855?v=3","gravatar_id":"","url":"https://api.github.com/users/viirya","html_url":"https://github.com/viirya","followers_url":"https://api.github.com/users/viirya/followers","following_url":"https://api.github.com/users/viirya/following{/other_user}","gists_url":"https://api.github.com/users/viirya/gists{/gist_id}","starred_url":"https://api.github.com/users/viirya/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/viirya/subscriptions","organizations_url":"https://api.github.com/users/viirya/orgs","repos_url":"https://api.github.com/users/viirya/repos","events_url":"https://api.github.com/users/viirya/events{/privacy}","received_events_url":"https://api.github.com/users/viirya/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":83,"created_at":"2015-07-06T11:22:50Z","updated_at":"2015-07-27T06:07:04Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7238","html_url":"https://github.com/apache/spark/pull/7238","diff_url":"https://github.com/apache/spark/pull/7238.diff","patch_url":"https://github.com/apache/spark/pull/7238.patch"},"body":"JIRA: https://issues.apache.org/jira/browse/SPARK-8838\r\n\r\nCurrently all part-files are merged when merging parquet schema. However, in case there are many part-files and we can make sure that all the part-files have the same schema as their summary file. If so, we provide a configuration to disable merging part-files when merging parquet schema.\r\n\r\nIn short, we need to merge parquet schema because different summary files may contain different schema. But the part-files are confirmed to have the same schema with summary files."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/125097743","html_url":"https://github.com/apache/spark/pull/7238#issuecomment-125097743","issue_url":"https://api.github.com/repos/apache/spark/issues/7238","id":125097743,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-07-27T06:07:04Z","updated_at":"2015-07-27T06:07:04Z","body":"  [Test build #38517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38517/consoleFull) for   PR 7238 at commit [`afc2fa1`](https://github.com/apache/spark/commit/afc2fa1834e45a14c127c510ce29a6661faf335d)."}}