{"action":"created","issue":{"url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/49","labels_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/49/labels{/name}","comments_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/49/comments","events_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/49/events","html_url":"https://github.com/jupyter-incubator/sparkmagic/issues/49","id":120486898,"number":49,"title":"Does Azure HDInsights have livy and sparkmagic working in the jupyter notebook?","user":{"login":"jlamcanopy","id":13050904,"avatar_url":"https://avatars.githubusercontent.com/u/13050904?v=3","gravatar_id":"","url":"https://api.github.com/users/jlamcanopy","html_url":"https://github.com/jlamcanopy","followers_url":"https://api.github.com/users/jlamcanopy/followers","following_url":"https://api.github.com/users/jlamcanopy/following{/other_user}","gists_url":"https://api.github.com/users/jlamcanopy/gists{/gist_id}","starred_url":"https://api.github.com/users/jlamcanopy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jlamcanopy/subscriptions","organizations_url":"https://api.github.com/users/jlamcanopy/orgs","repos_url":"https://api.github.com/users/jlamcanopy/repos","events_url":"https://api.github.com/users/jlamcanopy/events{/privacy}","received_events_url":"https://api.github.com/users/jlamcanopy/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/labels/question","name":"question","color":"cc317c"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2015-12-04T21:10:52Z","updated_at":"2015-12-08T00:39:00Z","closed_at":null,"body":"Hi there,\r\n\r\nI'm looking for a solution that works with jupyter notebook via livy to use Spark. It sesm that sparkmagic is a good fit that it. I wonder if Azure HDInsights have this service build-in?\r\n\r\nBest Regards,\r\n\r\nJerry"},"comment":{"url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/comments/162716300","html_url":"https://github.com/jupyter-incubator/sparkmagic/issues/49#issuecomment-162716300","issue_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/49","id":162716300,"user":{"login":"aggFTW","id":654204,"avatar_url":"https://avatars.githubusercontent.com/u/654204?v=3","gravatar_id":"","url":"https://api.github.com/users/aggFTW","html_url":"https://github.com/aggFTW","followers_url":"https://api.github.com/users/aggFTW/followers","following_url":"https://api.github.com/users/aggFTW/following{/other_user}","gists_url":"https://api.github.com/users/aggFTW/gists{/gist_id}","starred_url":"https://api.github.com/users/aggFTW/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aggFTW/subscriptions","organizations_url":"https://api.github.com/users/aggFTW/orgs","repos_url":"https://api.github.com/users/aggFTW/repos","events_url":"https://api.github.com/users/aggFTW/events{/privacy}","received_events_url":"https://api.github.com/users/aggFTW/received_events","type":"User","site_admin":false},"created_at":"2015-12-08T00:39:00Z","updated_at":"2015-12-08T00:39:00Z","body":"Thanks, that makes sense. I think that for now, it might be easier to install that library in the cluster and do the computation there, since creating a feature like the one being suggested would require a Scala parser, as well as having the Spark libraries installed.\r\n\r\nThe only feature that is in the roadmap is to be able to return the result of SparkSQL queries as pandas dataframes back to the user. That's detailed in #54."}}