{"action":"created","comment":{"url":"https://api.github.com/repos/harsha2010/magellan/pulls/comments/41601176","id":41601176,"diff_hunk":"@@ -1,27 +1,42 @@\n name := \"magellan\"\n \n-version := \"1.0.3\"\n+version := \"1.0.3-SNAPSHOT\"\n \n organization := \"harsha2010\"\n \n scalaVersion := \"2.10.4\"\n \n-parallelExecution in Test := false\n+crossScalaVersions := Seq(\"2.10.5\", \"2.11.7\")\n+\n+sparkVersion := \"1.4.1\"","path":"build.sbt","position":13,"original_position":13,"commit_id":"64d95c862d951890c17e6e1af74c60f344cf5e72","original_commit_id":"64d95c862d951890c17e6e1af74c60f344cf5e72","user":{"login":"JoshRosen","id":50748,"avatar_url":"https://avatars.githubusercontent.com/u/50748?v=3","gravatar_id":"","url":"https://api.github.com/users/JoshRosen","html_url":"https://github.com/JoshRosen","followers_url":"https://api.github.com/users/JoshRosen/followers","following_url":"https://api.github.com/users/JoshRosen/following{/other_user}","gists_url":"https://api.github.com/users/JoshRosen/gists{/gist_id}","starred_url":"https://api.github.com/users/JoshRosen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JoshRosen/subscriptions","organizations_url":"https://api.github.com/users/JoshRosen/orgs","repos_url":"https://api.github.com/users/JoshRosen/repos","events_url":"https://api.github.com/users/JoshRosen/events{/privacy}","received_events_url":"https://api.github.com/users/JoshRosen/received_events","type":"User","site_admin":false},"body":"Note that bumping the build Spark version from 1.4.0 to 1.4.1 is necessary for the 2.11 tests to work in Travis, for some reason.","created_at":"2015-10-09T06:36:54Z","updated_at":"2015-10-09T06:36:54Z","html_url":"https://github.com/harsha2010/magellan/pull/25#discussion_r41601176","pull_request_url":"https://api.github.com/repos/harsha2010/magellan/pulls/25","_links":{"self":{"href":"https://api.github.com/repos/harsha2010/magellan/pulls/comments/41601176"},"html":{"href":"https://github.com/harsha2010/magellan/pull/25#discussion_r41601176"},"pull_request":{"href":"https://api.github.com/repos/harsha2010/magellan/pulls/25"}}},"pull_request":{"url":"https://api.github.com/repos/harsha2010/magellan/pulls/25","id":47238539,"html_url":"https://github.com/harsha2010/magellan/pull/25","diff_url":"https://github.com/harsha2010/magellan/pull/25.diff","patch_url":"https://github.com/harsha2010/magellan/pull/25.patch","issue_url":"https://api.github.com/repos/harsha2010/magellan/issues/25","number":25,"state":"open","locked":false,"title":"Test against multiple Spark and Hadoop versions in Travis; fix Hadoop 1.x incompatibility","user":{"login":"JoshRosen","id":50748,"avatar_url":"https://avatars.githubusercontent.com/u/50748?v=3","gravatar_id":"","url":"https://api.github.com/users/JoshRosen","html_url":"https://github.com/JoshRosen","followers_url":"https://api.github.com/users/JoshRosen/followers","following_url":"https://api.github.com/users/JoshRosen/following{/other_user}","gists_url":"https://api.github.com/users/JoshRosen/gists{/gist_id}","starred_url":"https://api.github.com/users/JoshRosen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JoshRosen/subscriptions","organizations_url":"https://api.github.com/users/JoshRosen/orgs","repos_url":"https://api.github.com/users/JoshRosen/repos","events_url":"https://api.github.com/users/JoshRosen/events{/privacy}","received_events_url":"https://api.github.com/users/JoshRosen/received_events","type":"User","site_admin":false},"body":"This patch modifies Magellan's build and Travis configuration in order to compile against a fixed set of Spark and Hadoop versions, then test those compiled artifacts against a range of different runtime Spark and Hadoop dependencies. This style of testing simulates how users will interact with the published Magellan binaries.\r\n\r\nThese changes are similar to ones that I've made in Databricks' own libraries: https://github.com/databricks/spark-redshift/pull/58, https://github.com/databricks/spark-csv/pull/138, https://github.com/databricks/spark-avro/pull/79.\r\n\r\nThis testing revealed a binary incompatibility when running against Hadoop 1.x, which is caused by changes in Hadoop's TaskAttemptContext class. I fixed this using reflection, similar to the fix employed in https://github.com/apache/spark/pull/6599.\r\n\r\nI also tried testing the 1.4.1-compiled artifacts against Spark 1.5.1, but ran into the problems described in #18 and decided to remove those test configurations for now.","created_at":"2015-10-09T06:35:45Z","updated_at":"2015-10-09T06:36:54Z","closed_at":null,"merged_at":null,"merge_commit_sha":"a2cd70db76ef65e0dd7fa0d8bcbc2e08ffdfce9f","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/harsha2010/magellan/pulls/25/commits","review_comments_url":"https://api.github.com/repos/harsha2010/magellan/pulls/25/comments","review_comment_url":"https://api.github.com/repos/harsha2010/magellan/pulls/comments{/number}","comments_url":"https://api.github.com/repos/harsha2010/magellan/issues/25/comments","statuses_url":"https://api.github.com/repos/harsha2010/magellan/statuses/64d95c862d951890c17e6e1af74c60f344cf5e72","head":{"label":"JoshRosen:test-against-multiple-spark-and-hadoop-versions","ref":"test-against-multiple-spark-and-hadoop-versions","sha":"64d95c862d951890c17e6e1af74c60f344cf5e72","user":{"login":"JoshRosen","id":50748,"avatar_url":"https://avatars.githubusercontent.com/u/50748?v=3","gravatar_id":"","url":"https://api.github.com/users/JoshRosen","html_url":"https://github.com/JoshRosen","followers_url":"https://api.github.com/users/JoshRosen/followers","following_url":"https://api.github.com/users/JoshRosen/following{/other_user}","gists_url":"https://api.github.com/users/JoshRosen/gists{/gist_id}","starred_url":"https://api.github.com/users/JoshRosen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JoshRosen/subscriptions","organizations_url":"https://api.github.com/users/JoshRosen/orgs","repos_url":"https://api.github.com/users/JoshRosen/repos","events_url":"https://api.github.com/users/JoshRosen/events{/privacy}","received_events_url":"https://api.github.com/users/JoshRosen/received_events","type":"User","site_admin":false},"repo":{"id":43922522,"name":"magellan","full_name":"JoshRosen/magellan","owner":{"login":"JoshRosen","id":50748,"avatar_url":"https://avatars.githubusercontent.com/u/50748?v=3","gravatar_id":"","url":"https://api.github.com/users/JoshRosen","html_url":"https://github.com/JoshRosen","followers_url":"https://api.github.com/users/JoshRosen/followers","following_url":"https://api.github.com/users/JoshRosen/following{/other_user}","gists_url":"https://api.github.com/users/JoshRosen/gists{/gist_id}","starred_url":"https://api.github.com/users/JoshRosen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JoshRosen/subscriptions","organizations_url":"https://api.github.com/users/JoshRosen/orgs","repos_url":"https://api.github.com/users/JoshRosen/repos","events_url":"https://api.github.com/users/JoshRosen/events{/privacy}","received_events_url":"https://api.github.com/users/JoshRosen/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/JoshRosen/magellan","description":"Geo Spatial Data Analytics on Spark","fork":true,"url":"https://api.github.com/repos/JoshRosen/magellan","forks_url":"https://api.github.com/repos/JoshRosen/magellan/forks","keys_url":"https://api.github.com/repos/JoshRosen/magellan/keys{/key_id}","collaborators_url":"https://api.github.com/repos/JoshRosen/magellan/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/JoshRosen/magellan/teams","hooks_url":"https://api.github.com/repos/JoshRosen/magellan/hooks","issue_events_url":"https://api.github.com/repos/JoshRosen/magellan/issues/events{/number}","events_url":"https://api.github.com/repos/JoshRosen/magellan/events","assignees_url":"https://api.github.com/repos/JoshRosen/magellan/assignees{/user}","branches_url":"https://api.github.com/repos/JoshRosen/magellan/branches{/branch}","tags_url":"https://api.github.com/repos/JoshRosen/magellan/tags","blobs_url":"https://api.github.com/repos/JoshRosen/magellan/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/JoshRosen/magellan/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/JoshRosen/magellan/git/refs{/sha}","trees_url":"https://api.github.com/repos/JoshRosen/magellan/git/trees{/sha}","statuses_url":"https://api.github.com/repos/JoshRosen/magellan/statuses/{sha}","languages_url":"https://api.github.com/repos/JoshRosen/magellan/languages","stargazers_url":"https://api.github.com/repos/JoshRosen/magellan/stargazers","contributors_url":"https://api.github.com/repos/JoshRosen/magellan/contributors","subscribers_url":"https://api.github.com/repos/JoshRosen/magellan/subscribers","subscription_url":"https://api.github.com/repos/JoshRosen/magellan/subscription","commits_url":"https://api.github.com/repos/JoshRosen/magellan/commits{/sha}","git_commits_url":"https://api.github.com/repos/JoshRosen/magellan/git/commits{/sha}","comments_url":"https://api.github.com/repos/JoshRosen/magellan/comments{/number}","issue_comment_url":"https://api.github.com/repos/JoshRosen/magellan/issues/comments{/number}","contents_url":"https://api.github.com/repos/JoshRosen/magellan/contents/{+path}","compare_url":"https://api.github.com/repos/JoshRosen/magellan/compare/{base}...{head}","merges_url":"https://api.github.com/repos/JoshRosen/magellan/merges","archive_url":"https://api.github.com/repos/JoshRosen/magellan/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/JoshRosen/magellan/downloads","issues_url":"https://api.github.com/repos/JoshRosen/magellan/issues{/number}","pulls_url":"https://api.github.com/repos/JoshRosen/magellan/pulls{/number}","milestones_url":"https://api.github.com/repos/JoshRosen/magellan/milestones{/number}","notifications_url":"https://api.github.com/repos/JoshRosen/magellan/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/JoshRosen/magellan/labels{/name}","releases_url":"https://api.github.com/repos/JoshRosen/magellan/releases{/id}","created_at":"2015-10-08T23:54:13Z","updated_at":"2015-10-08T23:54:14Z","pushed_at":"2015-10-09T06:18:43Z","git_url":"git://github.com/JoshRosen/magellan.git","ssh_url":"git@github.com:JoshRosen/magellan.git","clone_url":"https://github.com/JoshRosen/magellan.git","svn_url":"https://github.com/JoshRosen/magellan","homepage":null,"size":3725,"stargazers_count":0,"watchers_count":0,"language":"Scala","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"harsha2010:master","ref":"master","sha":"4bee634f5e1dbc880dfa212eeff2de19bc9a90b4","user":{"login":"harsha2010","id":271956,"avatar_url":"https://avatars.githubusercontent.com/u/271956?v=3","gravatar_id":"","url":"https://api.github.com/users/harsha2010","html_url":"https://github.com/harsha2010","followers_url":"https://api.github.com/users/harsha2010/followers","following_url":"https://api.github.com/users/harsha2010/following{/other_user}","gists_url":"https://api.github.com/users/harsha2010/gists{/gist_id}","starred_url":"https://api.github.com/users/harsha2010/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/harsha2010/subscriptions","organizations_url":"https://api.github.com/users/harsha2010/orgs","repos_url":"https://api.github.com/users/harsha2010/repos","events_url":"https://api.github.com/users/harsha2010/events{/privacy}","received_events_url":"https://api.github.com/users/harsha2010/received_events","type":"User","site_admin":false},"repo":{"id":36629888,"name":"magellan","full_name":"harsha2010/magellan","owner":{"login":"harsha2010","id":271956,"avatar_url":"https://avatars.githubusercontent.com/u/271956?v=3","gravatar_id":"","url":"https://api.github.com/users/harsha2010","html_url":"https://github.com/harsha2010","followers_url":"https://api.github.com/users/harsha2010/followers","following_url":"https://api.github.com/users/harsha2010/following{/other_user}","gists_url":"https://api.github.com/users/harsha2010/gists{/gist_id}","starred_url":"https://api.github.com/users/harsha2010/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/harsha2010/subscriptions","organizations_url":"https://api.github.com/users/harsha2010/orgs","repos_url":"https://api.github.com/users/harsha2010/repos","events_url":"https://api.github.com/users/harsha2010/events{/privacy}","received_events_url":"https://api.github.com/users/harsha2010/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/harsha2010/magellan","description":"Geo Spatial Data Analytics on Spark","fork":false,"url":"https://api.github.com/repos/harsha2010/magellan","forks_url":"https://api.github.com/repos/harsha2010/magellan/forks","keys_url":"https://api.github.com/repos/harsha2010/magellan/keys{/key_id}","collaborators_url":"https://api.github.com/repos/harsha2010/magellan/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/harsha2010/magellan/teams","hooks_url":"https://api.github.com/repos/harsha2010/magellan/hooks","issue_events_url":"https://api.github.com/repos/harsha2010/magellan/issues/events{/number}","events_url":"https://api.github.com/repos/harsha2010/magellan/events","assignees_url":"https://api.github.com/repos/harsha2010/magellan/assignees{/user}","branches_url":"https://api.github.com/repos/harsha2010/magellan/branches{/branch}","tags_url":"https://api.github.com/repos/harsha2010/magellan/tags","blobs_url":"https://api.github.com/repos/harsha2010/magellan/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/harsha2010/magellan/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/harsha2010/magellan/git/refs{/sha}","trees_url":"https://api.github.com/repos/harsha2010/magellan/git/trees{/sha}","statuses_url":"https://api.github.com/repos/harsha2010/magellan/statuses/{sha}","languages_url":"https://api.github.com/repos/harsha2010/magellan/languages","stargazers_url":"https://api.github.com/repos/harsha2010/magellan/stargazers","contributors_url":"https://api.github.com/repos/harsha2010/magellan/contributors","subscribers_url":"https://api.github.com/repos/harsha2010/magellan/subscribers","subscription_url":"https://api.github.com/repos/harsha2010/magellan/subscription","commits_url":"https://api.github.com/repos/harsha2010/magellan/commits{/sha}","git_commits_url":"https://api.github.com/repos/harsha2010/magellan/git/commits{/sha}","comments_url":"https://api.github.com/repos/harsha2010/magellan/comments{/number}","issue_comment_url":"https://api.github.com/repos/harsha2010/magellan/issues/comments{/number}","contents_url":"https://api.github.com/repos/harsha2010/magellan/contents/{+path}","compare_url":"https://api.github.com/repos/harsha2010/magellan/compare/{base}...{head}","merges_url":"https://api.github.com/repos/harsha2010/magellan/merges","archive_url":"https://api.github.com/repos/harsha2010/magellan/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/harsha2010/magellan/downloads","issues_url":"https://api.github.com/repos/harsha2010/magellan/issues{/number}","pulls_url":"https://api.github.com/repos/harsha2010/magellan/pulls{/number}","milestones_url":"https://api.github.com/repos/harsha2010/magellan/milestones{/number}","notifications_url":"https://api.github.com/repos/harsha2010/magellan/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/harsha2010/magellan/labels{/name}","releases_url":"https://api.github.com/repos/harsha2010/magellan/releases{/id}","created_at":"2015-06-01T01:06:52Z","updated_at":"2015-10-07T01:29:05Z","pushed_at":"2015-10-09T06:35:46Z","git_url":"git://github.com/harsha2010/magellan.git","ssh_url":"git@github.com:harsha2010/magellan.git","clone_url":"https://github.com/harsha2010/magellan.git","svn_url":"https://github.com/harsha2010/magellan","homepage":null,"size":4040,"stargazers_count":30,"watchers_count":30,"language":"Scala","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":5,"mirror_url":null,"open_issues_count":7,"forks":5,"open_issues":7,"watchers":30,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/harsha2010/magellan/pulls/25"},"html":{"href":"https://github.com/harsha2010/magellan/pull/25"},"issue":{"href":"https://api.github.com/repos/harsha2010/magellan/issues/25"},"comments":{"href":"https://api.github.com/repos/harsha2010/magellan/issues/25/comments"},"review_comments":{"href":"https://api.github.com/repos/harsha2010/magellan/pulls/25/comments"},"review_comment":{"href":"https://api.github.com/repos/harsha2010/magellan/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/harsha2010/magellan/pulls/25/commits"},"statuses":{"href":"https://api.github.com/repos/harsha2010/magellan/statuses/64d95c862d951890c17e6e1af74c60f344cf5e72"}}}}