{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/4654","labels_url":"https://api.github.com/repos/apache/spark/issues/4654/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/4654/comments","events_url":"https://api.github.com/repos/apache/spark/issues/4654/events","html_url":"https://github.com/apache/spark/pull/4654","id":57968404,"number":4654,"title":"[SPARK-5016] Distribute Gaussian Initialization in GaussianMixture","user":{"login":"MechCoder","id":1867024,"avatar_url":"https://avatars.githubusercontent.com/u/1867024?v=3","gravatar_id":"","url":"https://api.github.com/users/MechCoder","html_url":"https://github.com/MechCoder","followers_url":"https://api.github.com/users/MechCoder/followers","following_url":"https://api.github.com/users/MechCoder/following{/other_user}","gists_url":"https://api.github.com/users/MechCoder/gists{/gist_id}","starred_url":"https://api.github.com/users/MechCoder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MechCoder/subscriptions","organizations_url":"https://api.github.com/users/MechCoder/orgs","repos_url":"https://api.github.com/users/MechCoder/repos","events_url":"https://api.github.com/users/MechCoder/events{/privacy}","received_events_url":"https://api.github.com/users/MechCoder/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":26,"created_at":"2015-02-17T19:18:35Z","updated_at":"2015-03-03T14:19:05Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/4654","html_url":"https://github.com/apache/spark/pull/4654","diff_url":"https://github.com/apache/spark/pull/4654.diff","patch_url":"https://github.com/apache/spark/pull/4654.patch"},"body":"GaussianMixture initializes and updates k Gaussian Models (using the Mean and the Covariance Matrix). It might be helpful to distribute these updates across k reducers, given the fact that initializing these models require the partial inverse computation."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/76953094","html_url":"https://github.com/apache/spark/pull/4654#issuecomment-76953094","issue_url":"https://api.github.com/repos/apache/spark/issues/4654","id":76953094,"user":{"login":"MechCoder","id":1867024,"avatar_url":"https://avatars.githubusercontent.com/u/1867024?v=3","gravatar_id":"","url":"https://api.github.com/users/MechCoder","html_url":"https://github.com/MechCoder","followers_url":"https://api.github.com/users/MechCoder/followers","following_url":"https://api.github.com/users/MechCoder/following{/other_user}","gists_url":"https://api.github.com/users/MechCoder/gists{/gist_id}","starred_url":"https://api.github.com/users/MechCoder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MechCoder/subscriptions","organizations_url":"https://api.github.com/users/MechCoder/orgs","repos_url":"https://api.github.com/users/MechCoder/repos","events_url":"https://api.github.com/users/MechCoder/events{/privacy}","received_events_url":"https://api.github.com/users/MechCoder/received_events","type":"User","site_admin":false},"created_at":"2015-03-03T14:19:05Z","updated_at":"2015-03-03T14:19:05Z","body":"@jkbradley I wrote a script here (https://gist.github.com/MechCoder/5939294f74f105e5c499) to compare the timings in this branch and master, It seems to me that there is no significant improvements as @tgaloppo suggested.\r\n\r\nWould you be able to run this on a cluster and verify the same? After that I can close this.\r\n\r\nThanks.\r\n\r\n\r\n"}}