{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/8611","labels_url":"https://api.github.com/repos/apache/spark/issues/8611/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/8611/comments","events_url":"https://api.github.com/repos/apache/spark/issues/8611/events","html_url":"https://github.com/apache/spark/pull/8611","id":105011774,"number":8611,"title":"[WIP] [SPARK-8518] [ML] Log-linear models for survival analysis ","user":{"login":"yanboliang","id":1962026,"avatar_url":"https://avatars.githubusercontent.com/u/1962026?v=3","gravatar_id":"","url":"https://api.github.com/users/yanboliang","html_url":"https://github.com/yanboliang","followers_url":"https://api.github.com/users/yanboliang/followers","following_url":"https://api.github.com/users/yanboliang/following{/other_user}","gists_url":"https://api.github.com/users/yanboliang/gists{/gist_id}","starred_url":"https://api.github.com/users/yanboliang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yanboliang/subscriptions","organizations_url":"https://api.github.com/users/yanboliang/orgs","repos_url":"https://api.github.com/users/yanboliang/repos","events_url":"https://api.github.com/users/yanboliang/events{/privacy}","received_events_url":"https://api.github.com/users/yanboliang/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-09-05T07:47:03Z","updated_at":"2015-09-07T11:44:10Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/8611","html_url":"https://github.com/apache/spark/pull/8611","diff_url":"https://github.com/apache/spark/pull/8611.diff","patch_url":"https://github.com/apache/spark/pull/8611.patch"},"body":"[Accelerated Failure Time (AFT) model](https://en.wikipedia.org/wiki/Accelerated_failure_time_model) is the most commonly used and easy to parallel method of survival analysis for censored survival data. It is the log-linear model based on the Weibull distribution of the survival time.\r\nUsers can refer to the R function [```survreg```](https://stat.ethz.ch/R-manual/R-devel/library/survival/html/survreg.html) to compare the model and [```predict```](https://stat.ethz.ch/R-manual/R-devel/library/survival/html/predict.survreg.html) to compare the prediction. There are different kinds of model prediction, I have just select the most common used type ```quantile```.\r\nThis is the initial implementation, please overlook the tiny issues and focus on the main ones.\r\nSome important features are under working and should be discussed include: \r\n> Standardization\r\n> Regularization\r\n> More robust test cases\r\n> The model prediction type\r\n> Should we support other kind of distribution?"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/138277247","html_url":"https://github.com/apache/spark/pull/8611#issuecomment-138277247","issue_url":"https://api.github.com/repos/apache/spark/issues/8611","id":138277247,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-09-07T11:44:10Z","updated_at":"2015-09-07T11:44:10Z","body":"  [Test build #42091 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42091/console) for   PR 8611 at commit [`c30a1c2`](https://github.com/apache/spark/commit/c30a1c2c6e256380032441c3e52adaeb5f9be1da).\n * This patch **passes all tests**.\n * This patch merges cleanly.\n * This patch adds the following public classes _(experimental)_:\n  * `class AFTRegression(override val uid: String)`\n"}}