{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/2342","labels_url":"https://api.github.com/repos/apache/spark/issues/2342/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/2342/comments","events_url":"https://api.github.com/repos/apache/spark/issues/2342/events","html_url":"https://github.com/apache/spark/pull/2342","id":42378486,"number":2342,"title":"[WIP][SPARK-3468] WebUI Timeline-View feature","user":{"login":"sarutak","id":4736016,"avatar_url":"https://avatars.githubusercontent.com/u/4736016?v=3","gravatar_id":"","url":"https://api.github.com/users/sarutak","html_url":"https://github.com/sarutak","followers_url":"https://api.github.com/users/sarutak/followers","following_url":"https://api.github.com/users/sarutak/following{/other_user}","gists_url":"https://api.github.com/users/sarutak/gists{/gist_id}","starred_url":"https://api.github.com/users/sarutak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sarutak/subscriptions","organizations_url":"https://api.github.com/users/sarutak/orgs","repos_url":"https://api.github.com/users/sarutak/repos","events_url":"https://api.github.com/users/sarutak/events{/privacy}","received_events_url":"https://api.github.com/users/sarutak/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":26,"created_at":"2014-09-10T05:16:43Z","updated_at":"2015-04-01T08:13:29Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/2342","html_url":"https://github.com/apache/spark/pull/2342","diff_url":"https://github.com/apache/spark/pull/2342.diff","patch_url":"https://github.com/apache/spark/pull/2342.patch"},"body":"I sometimes trouble-shoot and analyse the cause of long time spending job.\r\n\r\nAt the time, I find the stages which spends long time or fails, then I find the tasks which spends long time or fails, next I analyse the proportion of each phase in a task.\r\n\r\nAnother case, I find executors which spends long time for running a task and analyse the details of a task.\r\n\r\nIn such situation, I think it's helpful to visualize timeline  for each application, job, task and the details of proportion of activity for each task.\r\n\r\nI added 3 timeline features to existing Web UI.\r\n\r\n[Application Timeline View]\r\nThis view shows following things.\r\n\r\n* When each executor was added/removed and the reason why it's removed.\r\n* When each job  was started/finished.\r\n* Status of each job.\r\n\r\n![screenshot from 2015-04-01 16 49 25](https://cloud.githubusercontent.com/assets/4736016/6936886/e35fd582-d891-11e4-980d-8de13f50e442.png)\r\n\r\n\r\n[Stage Timeline View]\r\nSimilar to Application Timeline View, this view shows following things.\r\n\r\n* When each executor was added/removed and the reason why it's removed.\r\n* When each job was started/finished.\r\n* Status of each stage.\r\n\r\n![screenshot from 2015-04-01 16 50 59](https://cloud.githubusercontent.com/assets/4736016/6936900/0dca6526-d892-11e4-84a8-efd9037af444.png)\r\n\r\n\r\n[Task Assignment Timeline View]\r\nThis view shows following things.\r\n\r\n* When each task started/finished\r\n* How long each task spent and the proportion.\r\n* Status of each task.\r\n* Where each task ran on.\r\n\r\n![screenshot from 2015-04-01 16 51 54](https://cloud.githubusercontent.com/assets/4736016/6936910/20fd5acc-d892-11e4-9018-80e463881fc2.png)\r\n\r\n\r\nAll the view above is zoomable by mouse wheel action and scrollable by drag action. \r\n\r\n\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/88388611","html_url":"https://github.com/apache/spark/pull/2342#issuecomment-88388611","issue_url":"https://api.github.com/repos/apache/spark/issues/2342","id":88388611,"user":{"login":"sarutak","id":4736016,"avatar_url":"https://avatars.githubusercontent.com/u/4736016?v=3","gravatar_id":"","url":"https://api.github.com/users/sarutak","html_url":"https://github.com/sarutak","followers_url":"https://api.github.com/users/sarutak/followers","following_url":"https://api.github.com/users/sarutak/following{/other_user}","gists_url":"https://api.github.com/users/sarutak/gists{/gist_id}","starred_url":"https://api.github.com/users/sarutak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sarutak/subscriptions","organizations_url":"https://api.github.com/users/sarutak/orgs","repos_url":"https://api.github.com/users/sarutak/repos","events_url":"https://api.github.com/users/sarutak/events{/privacy}","received_events_url":"https://api.github.com/users/sarutak/received_events","type":"User","site_admin":false},"created_at":"2015-04-01T08:13:29Z","updated_at":"2015-04-01T08:13:29Z","body":"I've updated the description."}}