{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/4525","labels_url":"https://api.github.com/repos/apache/spark/issues/4525/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/4525/comments","events_url":"https://api.github.com/repos/apache/spark/issues/4525/events","html_url":"https://github.com/apache/spark/pull/4525","id":57282834,"number":4525,"title":"[SPARK-5522] Accelerate the Histroty Server start","user":{"login":"marsishandsome","id":5574887,"avatar_url":"https://avatars.githubusercontent.com/u/5574887?v=3","gravatar_id":"","url":"https://api.github.com/users/marsishandsome","html_url":"https://github.com/marsishandsome","followers_url":"https://api.github.com/users/marsishandsome/followers","following_url":"https://api.github.com/users/marsishandsome/following{/other_user}","gists_url":"https://api.github.com/users/marsishandsome/gists{/gist_id}","starred_url":"https://api.github.com/users/marsishandsome/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/marsishandsome/subscriptions","organizations_url":"https://api.github.com/users/marsishandsome/orgs","repos_url":"https://api.github.com/users/marsishandsome/repos","events_url":"https://api.github.com/users/marsishandsome/events{/privacy}","received_events_url":"https://api.github.com/users/marsishandsome/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2015-02-11T06:52:56Z","updated_at":"2015-02-12T09:17:33Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/4525","html_url":"https://github.com/apache/spark/pull/4525","diff_url":"https://github.com/apache/spark/pull/4525.diff","patch_url":"https://github.com/apache/spark/pull/4525.patch"},"body":"When starting the history server, all the log files will be fetched and parsed in order to get the applications' meta data e.g. App Name, Start Time, Duration, etc. In our production cluster, there exist 2600 log files (160G) in HDFS and it costs 3 hours to restart the history server, which is a little bit too long for us.\r\n\r\nIt would be better, if the history server can show logs with missing information during start-up and fill the missing information after fetching and parsing a log file."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/74039909","html_url":"https://github.com/apache/spark/pull/4525#issuecomment-74039909","issue_url":"https://api.github.com/repos/apache/spark/issues/4525","id":74039909,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-02-12T09:17:33Z","updated_at":"2015-02-12T09:17:33Z","body":"  [Test build #27342 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27342/consoleFull) for   PR 4525 at commit [`2e59eb7`](https://github.com/apache/spark/commit/2e59eb73086ad2c9243f6d1f340707841190d2d3).\n * This patch merges cleanly."}}