{"action":"created","issue":{"url":"https://api.github.com/repos/juanshishido/okcupid/issues/3","labels_url":"https://api.github.com/repos/juanshishido/okcupid/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/juanshishido/okcupid/issues/3/comments","events_url":"https://api.github.com/repos/juanshishido/okcupid/issues/3/events","html_url":"https://github.com/juanshishido/okcupid/issues/3","id":117903243,"number":3,"title":"determining `k`","user":{"login":"juanshishido","id":7218875,"avatar_url":"https://avatars.githubusercontent.com/u/7218875?v=3","gravatar_id":"","url":"https://api.github.com/users/juanshishido","html_url":"https://github.com/juanshishido","followers_url":"https://api.github.com/users/juanshishido/followers","following_url":"https://api.github.com/users/juanshishido/following{/other_user}","gists_url":"https://api.github.com/users/juanshishido/gists{/gist_id}","starred_url":"https://api.github.com/users/juanshishido/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/juanshishido/subscriptions","organizations_url":"https://api.github.com/users/juanshishido/orgs","repos_url":"https://api.github.com/users/juanshishido/repos","events_url":"https://api.github.com/users/juanshishido/events{/privacy}","received_events_url":"https://api.github.com/users/juanshishido/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":22,"created_at":"2015-11-19T20:40:26Z","updated_at":"2015-12-02T05:08:50Z","closed_at":null,"body":"We talked about the _within_ cluster sum of squares as a metric, which we will try.\r\n\r\nAnother option is the [silhouette coefficient](http://scikit-learn.org/stable/modules/generated/sklearn.metrics.silhouette_score.html).\r\n\r\n>In general, intrinsic methods[, such as the silhouette coefficient,] evaluate a clustering by examining how well the clusters are separated and how compact the clusters are.\r\n\r\n(Han, Kamber, Pei)\r\n\r\nAnother potentially useful link: [Selecting the number of clusters](http://scikit-learn.org/stable/auto_examples/cluster/plot_kmeans_silhouette_analysis.html).\r\n\r\nBoth of these approaches concentrate on the clusters themselves. However, we can focus on \"downstream\" outcomes and, instead, choose `k` based on how *distinct* the resulting clusters are based on the **dimension** (e.g., ethnicity) we're interested in investigating. This still requires a metric."},"comment":{"url":"https://api.github.com/repos/juanshishido/okcupid/issues/comments/161183375","html_url":"https://github.com/juanshishido/okcupid/issues/3#issuecomment-161183375","issue_url":"https://api.github.com/repos/juanshishido/okcupid/issues/3","id":161183375,"user":{"login":"jnaras","id":3860886,"avatar_url":"https://avatars.githubusercontent.com/u/3860886?v=3","gravatar_id":"","url":"https://api.github.com/users/jnaras","html_url":"https://github.com/jnaras","followers_url":"https://api.github.com/users/jnaras/followers","following_url":"https://api.github.com/users/jnaras/following{/other_user}","gists_url":"https://api.github.com/users/jnaras/gists{/gist_id}","starred_url":"https://api.github.com/users/jnaras/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jnaras/subscriptions","organizations_url":"https://api.github.com/users/jnaras/orgs","repos_url":"https://api.github.com/users/jnaras/repos","events_url":"https://api.github.com/users/jnaras/events{/privacy}","received_events_url":"https://api.github.com/users/jnaras/received_events","type":"User","site_admin":false},"created_at":"2015-12-02T05:08:50Z","updated_at":"2015-12-02T05:08:50Z","body":"Yes, that sounds good. I forgot about the n_init argument :) Hopefully that introduces enough variation to change up the clusters a bit."}}