{"action":"created","issue":{"url":"https://api.github.com/repos/sparklingpandas/sparklingpandas/issues/121","labels_url":"https://api.github.com/repos/sparklingpandas/sparklingpandas/issues/121/labels{/name}","comments_url":"https://api.github.com/repos/sparklingpandas/sparklingpandas/issues/121/comments","events_url":"https://api.github.com/repos/sparklingpandas/sparklingpandas/issues/121/events","html_url":"https://github.com/sparklingpandas/sparklingpandas/issues/121","id":98087394,"number":121,"title":"Add joins to sparklingpandas","user":{"login":"michalmonselise","id":7342857,"avatar_url":"https://avatars.githubusercontent.com/u/7342857?v=3","gravatar_id":"","url":"https://api.github.com/users/michalmonselise","html_url":"https://github.com/michalmonselise","followers_url":"https://api.github.com/users/michalmonselise/followers","following_url":"https://api.github.com/users/michalmonselise/following{/other_user}","gists_url":"https://api.github.com/users/michalmonselise/gists{/gist_id}","starred_url":"https://api.github.com/users/michalmonselise/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/michalmonselise/subscriptions","organizations_url":"https://api.github.com/users/michalmonselise/orgs","repos_url":"https://api.github.com/users/michalmonselise/repos","events_url":"https://api.github.com/users/michalmonselise/events{/privacy}","received_events_url":"https://api.github.com/users/michalmonselise/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"michalmonselise","id":7342857,"avatar_url":"https://avatars.githubusercontent.com/u/7342857?v=3","gravatar_id":"","url":"https://api.github.com/users/michalmonselise","html_url":"https://github.com/michalmonselise","followers_url":"https://api.github.com/users/michalmonselise/followers","following_url":"https://api.github.com/users/michalmonselise/following{/other_user}","gists_url":"https://api.github.com/users/michalmonselise/gists{/gist_id}","starred_url":"https://api.github.com/users/michalmonselise/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/michalmonselise/subscriptions","organizations_url":"https://api.github.com/users/michalmonselise/orgs","repos_url":"https://api.github.com/users/michalmonselise/repos","events_url":"https://api.github.com/users/michalmonselise/events{/privacy}","received_events_url":"https://api.github.com/users/michalmonselise/received_events","type":"User","site_admin":false},"milestone":null,"comments":4,"created_at":"2015-07-30T05:19:56Z","updated_at":"2015-08-05T22:33:48Z","closed_at":null,"body":""},"comment":{"url":"https://api.github.com/repos/sparklingpandas/sparklingpandas/issues/comments/128171182","html_url":"https://github.com/sparklingpandas/sparklingpandas/issues/121#issuecomment-128171182","issue_url":"https://api.github.com/repos/sparklingpandas/sparklingpandas/issues/121","id":128171182,"user":{"login":"michalmonselise","id":7342857,"avatar_url":"https://avatars.githubusercontent.com/u/7342857?v=3","gravatar_id":"","url":"https://api.github.com/users/michalmonselise","html_url":"https://github.com/michalmonselise","followers_url":"https://api.github.com/users/michalmonselise/followers","following_url":"https://api.github.com/users/michalmonselise/following{/other_user}","gists_url":"https://api.github.com/users/michalmonselise/gists{/gist_id}","starred_url":"https://api.github.com/users/michalmonselise/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/michalmonselise/subscriptions","organizations_url":"https://api.github.com/users/michalmonselise/orgs","repos_url":"https://api.github.com/users/michalmonselise/repos","events_url":"https://api.github.com/users/michalmonselise/events{/privacy}","received_events_url":"https://api.github.com/users/michalmonselise/received_events","type":"User","site_admin":false},"created_at":"2015-08-05T22:33:48Z","updated_at":"2015-08-05T22:33:48Z","body":"Thanks :)\r\n\r\nI'll be done soon but I had a question:\r\nWhen we join 2 pandas dataframes and they share a column name (but not the column we are joining on), pandas adds a '_x' and '_y' to the column name to distinguish between the two. Spark does not distinguish between the columns and preserves the original names. How should we handle this? Spark dataframes are immutable so column name changes would require making a copy. \r\nShould the column names be consistent with spark or pandas and if they are consistent with pandas, would it be ok if I made a copy of the dataframe in order to rename the columns?"}}