{"action":"created","issue":{"url":"https://api.github.com/repos/cloudera/spark-timeseries/issues/52","labels_url":"https://api.github.com/repos/cloudera/spark-timeseries/issues/52/labels{/name}","comments_url":"https://api.github.com/repos/cloudera/spark-timeseries/issues/52/comments","events_url":"https://api.github.com/repos/cloudera/spark-timeseries/issues/52/events","html_url":"https://github.com/cloudera/spark-timeseries/pull/52","id":102266959,"number":52,"title":"#20: Add timeSeriesRDD#toInstantsDataFrame","user":{"login":"cdalzell","id":305079,"avatar_url":"https://avatars.githubusercontent.com/u/305079?v=3","gravatar_id":"","url":"https://api.github.com/users/cdalzell","html_url":"https://github.com/cdalzell","followers_url":"https://api.github.com/users/cdalzell/followers","following_url":"https://api.github.com/users/cdalzell/following{/other_user}","gists_url":"https://api.github.com/users/cdalzell/gists{/gist_id}","starred_url":"https://api.github.com/users/cdalzell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cdalzell/subscriptions","organizations_url":"https://api.github.com/users/cdalzell/orgs","repos_url":"https://api.github.com/users/cdalzell/repos","events_url":"https://api.github.com/users/cdalzell/events{/privacy}","received_events_url":"https://api.github.com/users/cdalzell/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-08-21T00:21:15Z","updated_at":"2015-08-21T00:51:50Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/cloudera/spark-timeseries/pulls/52","html_url":"https://github.com/cloudera/spark-timeseries/pull/52","diff_url":"https://github.com/cloudera/spark-timeseries/pull/52.diff","patch_url":"https://github.com/cloudera/spark-timeseries/pull/52.patch"},"body":"Implements timeSeriesRDD#toInstantsDataFrame, essentially a wrapper around toInstants.\r\n\r\nThe schema of the DataFrame returned will be a java.sql.Timestamp column named \"instant\" and double columns named \"v0\", \"v1\", \"v2\", ... \"vN\".\r\n\r\nThis (technically) satisfies #20, but I'm wondering what other nifty things others had in mind for the use of DataFrames in this library. Most of the thoughts I've had are things like allowing the user to provide an ordered list of column names they would like the numeric data mapped to other than \"vN\" so they could avoid calling selectExpr or withColumnRenamed more than needed.\r\n\r\nNot that the Spark SQL planner can't optimize around that, it just might make the user's life easier. :)"},"comment":{"url":"https://api.github.com/repos/cloudera/spark-timeseries/issues/comments/133231354","html_url":"https://github.com/cloudera/spark-timeseries/pull/52#issuecomment-133231354","issue_url":"https://api.github.com/repos/cloudera/spark-timeseries/issues/52","id":133231354,"user":{"login":"cdalzell","id":305079,"avatar_url":"https://avatars.githubusercontent.com/u/305079?v=3","gravatar_id":"","url":"https://api.github.com/users/cdalzell","html_url":"https://github.com/cdalzell","followers_url":"https://api.github.com/users/cdalzell/followers","following_url":"https://api.github.com/users/cdalzell/following{/other_user}","gists_url":"https://api.github.com/users/cdalzell/gists{/gist_id}","starred_url":"https://api.github.com/users/cdalzell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cdalzell/subscriptions","organizations_url":"https://api.github.com/users/cdalzell/orgs","repos_url":"https://api.github.com/users/cdalzell/repos","events_url":"https://api.github.com/users/cdalzell/events{/privacy}","received_events_url":"https://api.github.com/users/cdalzell/received_events","type":"User","site_admin":false},"created_at":"2015-08-21T00:51:50Z","updated_at":"2015-08-21T00:51:50Z","body":"I think that would be helpful, I'm not incredibly familiar with the nuances of RDD's as I almost entirely work with DataFrames. Spark 1.3 came to the scene about the same time I did. :)"}}