{"action":"created","issue":{"url":"https://api.github.com/repos/TresAmigosSD/SMV/issues/103","labels_url":"https://api.github.com/repos/TresAmigosSD/SMV/issues/103/labels{/name}","comments_url":"https://api.github.com/repos/TresAmigosSD/SMV/issues/103/comments","events_url":"https://api.github.com/repos/TresAmigosSD/SMV/issues/103/events","html_url":"https://github.com/TresAmigosSD/SMV/issues/103","id":50300918,"number":103,"title":"Add SrddWithMeta wrapper to support meta data in short term","user":{"login":"ninjapapa","id":8062822,"avatar_url":"https://avatars.githubusercontent.com/u/8062822?v=3","gravatar_id":"","url":"https://api.github.com/users/ninjapapa","html_url":"https://github.com/ninjapapa","followers_url":"https://api.github.com/users/ninjapapa/followers","following_url":"https://api.github.com/users/ninjapapa/following{/other_user}","gists_url":"https://api.github.com/users/ninjapapa/gists{/gist_id}","starred_url":"https://api.github.com/users/ninjapapa/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ninjapapa/subscriptions","organizations_url":"https://api.github.com/users/ninjapapa/orgs","repos_url":"https://api.github.com/users/ninjapapa/repos","events_url":"https://api.github.com/users/ninjapapa/events{/privacy}","received_events_url":"https://api.github.com/users/ninjapapa/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2014-11-27T15:13:17Z","updated_at":"2015-11-25T06:54:38Z","closed_at":"2015-11-25T06:54:38Z","body":"Variables to be shared across different teams need to \r\n* follow some project specific naming convention, and \r\n* have some meta data to describe the variables in more details\r\n\r\nIdeal case the meta data should be captured within the code. In the long run, we will implement meta support on NamedExpression level. For  the short term, need to implement a SRDD wrapper to carry meta data.\r\n\r\nThe client code will look like,\r\n```scala\r\nsrdd.renameWithMeta(\r\n  'a -> ('new_name_a, \"desc of a\"),\r\n  'b -> ('new_name_b, \"desc of b\")\r\n)\r\n```\r\nand\r\n```scala\r\nsrdd.saveAsCsvWithMetaSchema(pathToFile)\r\n```\r\n\r\nFor short term, when save file, will put meta data as comments in schema file."},"comment":{"url":"https://api.github.com/repos/TresAmigosSD/SMV/issues/comments/159516144","html_url":"https://github.com/TresAmigosSD/SMV/issues/103#issuecomment-159516144","issue_url":"https://api.github.com/repos/TresAmigosSD/SMV/issues/103","id":159516144,"user":{"login":"ninjapapa","id":8062822,"avatar_url":"https://avatars.githubusercontent.com/u/8062822?v=3","gravatar_id":"","url":"https://api.github.com/users/ninjapapa","html_url":"https://github.com/ninjapapa","followers_url":"https://api.github.com/users/ninjapapa/followers","following_url":"https://api.github.com/users/ninjapapa/following{/other_user}","gists_url":"https://api.github.com/users/ninjapapa/gists{/gist_id}","starred_url":"https://api.github.com/users/ninjapapa/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ninjapapa/subscriptions","organizations_url":"https://api.github.com/users/ninjapapa/orgs","repos_url":"https://api.github.com/users/ninjapapa/repos","events_url":"https://api.github.com/users/ninjapapa/events{/privacy}","received_events_url":"https://api.github.com/users/ninjapapa/received_events","type":"User","site_admin":false},"created_at":"2015-11-25T06:54:38Z","updated_at":"2015-11-25T06:54:38Z","body":"1be9af3e382e36a9172d9dce89f94dbb633888ba\r\nand\r\ncccca049200fcd85a50de32b5fd37e7df6b33fe4\r\n\r\ndone"}}