{"action":"created","issue":{"url":"https://api.github.com/repos/apache/flink/issues/861","labels_url":"https://api.github.com/repos/apache/flink/issues/861/labels{/name}","comments_url":"https://api.github.com/repos/apache/flink/issues/861/comments","events_url":"https://api.github.com/repos/apache/flink/issues/861/events","html_url":"https://github.com/apache/flink/pull/861","id":90327256,"number":861,"title":"[Flink-2030][ml]Data Set Statistics and Histograms","user":{"login":"sachingoel0101","id":8874261,"avatar_url":"https://avatars.githubusercontent.com/u/8874261?v=3","gravatar_id":"","url":"https://api.github.com/users/sachingoel0101","html_url":"https://github.com/sachingoel0101","followers_url":"https://api.github.com/users/sachingoel0101/followers","following_url":"https://api.github.com/users/sachingoel0101/following{/other_user}","gists_url":"https://api.github.com/users/sachingoel0101/gists{/gist_id}","starred_url":"https://api.github.com/users/sachingoel0101/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sachingoel0101/subscriptions","organizations_url":"https://api.github.com/users/sachingoel0101/orgs","repos_url":"https://api.github.com/users/sachingoel0101/repos","events_url":"https://api.github.com/users/sachingoel0101/events{/privacy}","received_events_url":"https://api.github.com/users/sachingoel0101/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":37,"created_at":"2015-06-23T08:47:48Z","updated_at":"2015-08-18T08:15:49Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/flink/pulls/861","html_url":"https://github.com/apache/flink/pull/861","diff_url":"https://github.com/apache/flink/pull/861.diff","patch_url":"https://github.com/apache/flink/pull/861.patch"},"body":"This implements the Online Histograms for both categorical and continuous data. For continuous data, we emulate a continuous probability distribution which supports finding cumulative sum upto a particular value, and finding value upto a specific cumulative probability [Quantiles]. \r\nFor categorical fields, we emulate a probability mass function which supports finding the probability associated with every class.\r\nThe continuous histogram follows this paper: http://www.jmlr.org/papers/volume11/ben-haim10a/ben-haim10a.pdf\r\n\r\nNote: This is a sub-task of https://issues.apache.org/jira/browse/FLINK-1727 which already has a PR pending review at https://github.com/apache/flink/pull/710.\r\n\r\nEdit: This adds methods to evaluate statistics on data sets of vectors, like column wise statistics. These include minimum, maximum, mean, variance, entropy, gini impurity, etc. [FLINK-2379]"},"comment":{"url":"https://api.github.com/repos/apache/flink/issues/comments/132116059","html_url":"https://github.com/apache/flink/pull/861#issuecomment-132116059","issue_url":"https://api.github.com/repos/apache/flink/issues/861","id":132116059,"user":{"login":"chiwanpark","id":1941681,"avatar_url":"https://avatars.githubusercontent.com/u/1941681?v=3","gravatar_id":"","url":"https://api.github.com/users/chiwanpark","html_url":"https://github.com/chiwanpark","followers_url":"https://api.github.com/users/chiwanpark/followers","following_url":"https://api.github.com/users/chiwanpark/following{/other_user}","gists_url":"https://api.github.com/users/chiwanpark/gists{/gist_id}","starred_url":"https://api.github.com/users/chiwanpark/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chiwanpark/subscriptions","organizations_url":"https://api.github.com/users/chiwanpark/orgs","repos_url":"https://api.github.com/users/chiwanpark/repos","events_url":"https://api.github.com/users/chiwanpark/events{/privacy}","received_events_url":"https://api.github.com/users/chiwanpark/received_events","type":"User","site_admin":false},"created_at":"2015-08-18T08:15:49Z","updated_at":"2015-08-18T08:15:49Z","body":"I think that we can merge this PR after we decide the return type of `createHistogram` method. Any other points seem okay."}}