{"action":"created","comment":{"url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/comments/33425237","id":33425237,"diff_hunk":"@@ -0,0 +1,985 @@\n+:author: Randy Paffenroth\n+:email: rcpaffenroth@wpi.edu\n+:institution: Worcester Polytechnic Institute, Mathematical Sciences Department and Data Science Program\n+\n+:author: Xiangnan Kong\n+:email: xkong@wpi.edu\n+:institution: Worcester Polytechnic Institute, Computer Science Department and Data Science Program\n+\n+\n+------------------------------------------------\n+Python in Data Science Research and Education\n+------------------------------------------------\n+\n+.. class:: abstract\n+\n+  In this paper we demonstrate how Python can be used throughout the\n+  entire life cycle of a graduate program in Data Science.  In\n+  interdisciplinary fields, such as Data Science, the students often\n+  come from a variety of different backgrounds where, for example,\n+  some students may have strong mathematical training but less\n+  experience in programming.  Python’s ease of use, open source\n+  license, and access to a vast array of libraries make it\n+  particularly suited for such students.  In particular, we will\n+  discuss how Python, IPython notebooks, scikit-learn, NumPy, SciPy,\n+  and pandas can be used in several phases of graduate Data Science\n+  education, starting from introductory classes (covering topics such\n+  as data gathering, data cleaning, statistics, regression,\n+  classification, machine learning, etc.) and culminating in degree\n+  capstone research projects using more advanced ideas such as convex\n+  optimization, non-linear dimension reduction, and compressed\n+  sensing.  One particular item of note is the scikit-learn library,\n+  which provides numerous routines for machine learning.  Having\n+  access to such a library allows interesting problems to be addressed\n+  early in the educational process and the experience gained with such\n+  “black box” routines provides a firm foundation for the students own\n+  software development, analysis, and research later in their academic\n+  experience.\n+\n+.. class:: keywords\n+\n+   data science, education, machine learning\n+\n+Introduction\n+------------\n+\n+Data Science is a burgeoning field of study that lays at the\n+intersection of statistics, computer science, and numerous applied\n+scientific domains.  As is common within such *interdisciplinary*\n+domains of study, Data Science education, mentoring, and research\n+draws ideas from, and is inspired by, several other domains such as\n+the mathematical sciences, computer science, and various business and\n+application domains.  Perhaps just as importantly, student who wish to\n+pursue education and careers in Data Science come from similarly\n+diverse backgrounds.  Accordingly, the challenges and opportunities of\n+being an educator in such a domain requires one to reflect on\n+appropriate tools and approaches that promote educational success.  It\n+is the authors' view, and experience, that the Python scripting\n+language can be an effective part of the Data Science curriculum for\n+several reasons such as its ease of use, its open source license,\n+and its access to a vast array of libraries covering many topics of\n+interest to Data Science.\n+\n+Worcester Polytechnic Institute (WPI) has recently (fall 2014) begun\n+admitting students into its new Data Science Master's degree program\n+and, as of spring 2015, has also initiated a Data Science\n+Ph.D. program.  Even at this early stage, the program has been quite\n+fortunate to receive many more applications from students then it can\n+reasonably admit.  The authors have the pleasure of being faculty\n+members in the program and have the honor of teaching a number of the\n+courses on offer.  In addition, as a long time Python users (for one\n+of them since 1997 in fact [Paf99]_), the authors were intrigued by\n+the possibility of leveraging Python in the graduate Data Science\n+curriculum and this monograph describes some of the experiences, both\n+successes and challenges, gained from that effort.  Of course, it is\n+much too early to make any comments on the sustained effect of using\n+Python for graduate Data Science education, however, perhaps the\n+gentle reader will find some value in the authors' experiences, even\n+at this early date.\n+\n+Of course, we are not the first to suggest Python's effectiveness in\n+an education and research environment.  In fact, the Python\n+programming language is quite popular in numerous problem domains and\n+Python has seen wide used in education, see e.g., [Mye07]_ and\n+[Sta00]_.  In fact, it ranks quite highly in many surveys of\n+programming language popularity [OGr14]_, it is seeing substantial\n+growth within the Data Science community [Sin14]_, and is generally\n+speaking quite easy to learn [Lut13]_.\n+\n+However, it is not our purpose here to focus on Python in the large,","path":"papers/randy_paffenroth/00_paffenroth.rst","position":89,"original_position":89,"commit_id":"e1d1c16bf7914698fc3500304b05764ae5bfc6fd","original_commit_id":"e1d1c16bf7914698fc3500304b05764ae5bfc6fd","user":{"login":"minrk","id":151929,"avatar_url":"https://avatars.githubusercontent.com/u/151929?v=3","gravatar_id":"","url":"https://api.github.com/users/minrk","html_url":"https://github.com/minrk","followers_url":"https://api.github.com/users/minrk/followers","following_url":"https://api.github.com/users/minrk/following{/other_user}","gists_url":"https://api.github.com/users/minrk/gists{/gist_id}","starred_url":"https://api.github.com/users/minrk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/minrk/subscriptions","organizations_url":"https://api.github.com/users/minrk/orgs","repos_url":"https://api.github.com/users/minrk/repos","events_url":"https://api.github.com/users/minrk/events{/privacy}","received_events_url":"https://api.github.com/users/minrk/received_events","type":"User","site_admin":false},"body":"\"in the large\" -> \"in general\"","created_at":"2015-06-28T18:09:14Z","updated_at":"2015-06-28T18:09:14Z","html_url":"https://github.com/scipy-conference/scipy_proceedings/pull/142#discussion_r33425237","pull_request_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142","_links":{"self":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/comments/33425237"},"html":{"href":"https://github.com/scipy-conference/scipy_proceedings/pull/142#discussion_r33425237"},"pull_request":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142"}}},"pull_request":{"url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142","id":37737568,"html_url":"https://github.com/scipy-conference/scipy_proceedings/pull/142","diff_url":"https://github.com/scipy-conference/scipy_proceedings/pull/142.diff","patch_url":"https://github.com/scipy-conference/scipy_proceedings/pull/142.patch","issue_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/issues/142","number":142,"state":"open","locked":false,"title":"Paper: Python in Data Science Research and Education (Paffenroth)","user":{"login":"rcpaffenroth","id":12465586,"avatar_url":"https://avatars.githubusercontent.com/u/12465586?v=3","gravatar_id":"","url":"https://api.github.com/users/rcpaffenroth","html_url":"https://github.com/rcpaffenroth","followers_url":"https://api.github.com/users/rcpaffenroth/followers","following_url":"https://api.github.com/users/rcpaffenroth/following{/other_user}","gists_url":"https://api.github.com/users/rcpaffenroth/gists{/gist_id}","starred_url":"https://api.github.com/users/rcpaffenroth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rcpaffenroth/subscriptions","organizations_url":"https://api.github.com/users/rcpaffenroth/orgs","repos_url":"https://api.github.com/users/rcpaffenroth/repos","events_url":"https://api.github.com/users/rcpaffenroth/events{/privacy}","received_events_url":"https://api.github.com/users/rcpaffenroth/received_events","type":"User","site_admin":false},"body":"Good evening,\r\n\r\n  Please find my submission for the SciPy2015 conference in this pull request.  Note, the date in the copyright notice and the page headers is incorrect.  It refers to an earlier version of the conference I believe.   In the README.md file is was requested:\r\n\r\n- Please do not modify any files outside of your paper directory.\r\n\r\nI followed that request and did not fix the error above.\r\n\r\n   Thank you very much,\r\n\r\n      Randy Paffenroth\r\n\r\nAssociate Professor\r\nMathematical Sciences Department\r\nData Science Program\r\nWorcester Polytechnic Institute\r\n\r\n[Edit by jaberg] http://nipy.bic.berkeley.edu:5000/download/15","created_at":"2015-06-15T21:28:36Z","updated_at":"2015-06-28T18:09:14Z","closed_at":null,"merged_at":null,"merge_commit_sha":"6eda735e621834d8b37cce4edbd481bcac3445c1","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142/commits","review_comments_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142/comments","review_comment_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/comments{/number}","comments_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/issues/142/comments","statuses_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/statuses/e1d1c16bf7914698fc3500304b05764ae5bfc6fd","head":{"label":"rcpaffenroth:2015","ref":"2015","sha":"e1d1c16bf7914698fc3500304b05764ae5bfc6fd","user":{"login":"rcpaffenroth","id":12465586,"avatar_url":"https://avatars.githubusercontent.com/u/12465586?v=3","gravatar_id":"","url":"https://api.github.com/users/rcpaffenroth","html_url":"https://github.com/rcpaffenroth","followers_url":"https://api.github.com/users/rcpaffenroth/followers","following_url":"https://api.github.com/users/rcpaffenroth/following{/other_user}","gists_url":"https://api.github.com/users/rcpaffenroth/gists{/gist_id}","starred_url":"https://api.github.com/users/rcpaffenroth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rcpaffenroth/subscriptions","organizations_url":"https://api.github.com/users/rcpaffenroth/orgs","repos_url":"https://api.github.com/users/rcpaffenroth/repos","events_url":"https://api.github.com/users/rcpaffenroth/events{/privacy}","received_events_url":"https://api.github.com/users/rcpaffenroth/received_events","type":"User","site_admin":false},"repo":{"id":35694868,"name":"scipy_proceedings","full_name":"rcpaffenroth/scipy_proceedings","owner":{"login":"rcpaffenroth","id":12465586,"avatar_url":"https://avatars.githubusercontent.com/u/12465586?v=3","gravatar_id":"","url":"https://api.github.com/users/rcpaffenroth","html_url":"https://github.com/rcpaffenroth","followers_url":"https://api.github.com/users/rcpaffenroth/followers","following_url":"https://api.github.com/users/rcpaffenroth/following{/other_user}","gists_url":"https://api.github.com/users/rcpaffenroth/gists{/gist_id}","starred_url":"https://api.github.com/users/rcpaffenroth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rcpaffenroth/subscriptions","organizations_url":"https://api.github.com/users/rcpaffenroth/orgs","repos_url":"https://api.github.com/users/rcpaffenroth/repos","events_url":"https://api.github.com/users/rcpaffenroth/events{/privacy}","received_events_url":"https://api.github.com/users/rcpaffenroth/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/rcpaffenroth/scipy_proceedings","description":"Tools used to generate the SciPy conference proceedings","fork":true,"url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings","forks_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/forks","keys_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/keys{/key_id}","collaborators_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/teams","hooks_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/hooks","issue_events_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/issues/events{/number}","events_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/events","assignees_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/assignees{/user}","branches_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/branches{/branch}","tags_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/tags","blobs_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/git/refs{/sha}","trees_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/git/trees{/sha}","statuses_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/statuses/{sha}","languages_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/languages","stargazers_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/stargazers","contributors_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/contributors","subscribers_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/subscribers","subscription_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/subscription","commits_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/commits{/sha}","git_commits_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/git/commits{/sha}","comments_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/comments{/number}","issue_comment_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/issues/comments{/number}","contents_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/contents/{+path}","compare_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/compare/{base}...{head}","merges_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/merges","archive_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/downloads","issues_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/issues{/number}","pulls_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/pulls{/number}","milestones_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/milestones{/number}","notifications_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/labels{/name}","releases_url":"https://api.github.com/repos/rcpaffenroth/scipy_proceedings/releases{/id}","created_at":"2015-05-15T20:23:51Z","updated_at":"2015-05-15T20:23:51Z","pushed_at":"2015-06-24T15:47:31Z","git_url":"git://github.com/rcpaffenroth/scipy_proceedings.git","ssh_url":"git@github.com:rcpaffenroth/scipy_proceedings.git","clone_url":"https://github.com/rcpaffenroth/scipy_proceedings.git","svn_url":"https://github.com/rcpaffenroth/scipy_proceedings","homepage":"","size":894,"stargazers_count":0,"watchers_count":0,"language":"Python","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"scipy-conference:2015","ref":"2015","sha":"e3df71a5659ce32396b7c520b89109716a3210fa","user":{"login":"scipy-conference","id":4884274,"avatar_url":"https://avatars.githubusercontent.com/u/4884274?v=3","gravatar_id":"","url":"https://api.github.com/users/scipy-conference","html_url":"https://github.com/scipy-conference","followers_url":"https://api.github.com/users/scipy-conference/followers","following_url":"https://api.github.com/users/scipy-conference/following{/other_user}","gists_url":"https://api.github.com/users/scipy-conference/gists{/gist_id}","starred_url":"https://api.github.com/users/scipy-conference/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/scipy-conference/subscriptions","organizations_url":"https://api.github.com/users/scipy-conference/orgs","repos_url":"https://api.github.com/users/scipy-conference/repos","events_url":"https://api.github.com/users/scipy-conference/events{/privacy}","received_events_url":"https://api.github.com/users/scipy-conference/received_events","type":"Organization","site_admin":false},"repo":{"id":1825629,"name":"scipy_proceedings","full_name":"scipy-conference/scipy_proceedings","owner":{"login":"scipy-conference","id":4884274,"avatar_url":"https://avatars.githubusercontent.com/u/4884274?v=3","gravatar_id":"","url":"https://api.github.com/users/scipy-conference","html_url":"https://github.com/scipy-conference","followers_url":"https://api.github.com/users/scipy-conference/followers","following_url":"https://api.github.com/users/scipy-conference/following{/other_user}","gists_url":"https://api.github.com/users/scipy-conference/gists{/gist_id}","starred_url":"https://api.github.com/users/scipy-conference/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/scipy-conference/subscriptions","organizations_url":"https://api.github.com/users/scipy-conference/orgs","repos_url":"https://api.github.com/users/scipy-conference/repos","events_url":"https://api.github.com/users/scipy-conference/events{/privacy}","received_events_url":"https://api.github.com/users/scipy-conference/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/scipy-conference/scipy_proceedings","description":"Tools used to generate the SciPy conference proceedings","fork":false,"url":"https://api.github.com/repos/scipy-conference/scipy_proceedings","forks_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/forks","keys_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/keys{/key_id}","collaborators_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/teams","hooks_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/hooks","issue_events_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/issues/events{/number}","events_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/events","assignees_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/assignees{/user}","branches_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/branches{/branch}","tags_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/tags","blobs_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/git/refs{/sha}","trees_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/git/trees{/sha}","statuses_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/statuses/{sha}","languages_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/languages","stargazers_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/stargazers","contributors_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/contributors","subscribers_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/subscribers","subscription_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/subscription","commits_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/commits{/sha}","git_commits_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/git/commits{/sha}","comments_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/comments{/number}","issue_comment_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/issues/comments{/number}","contents_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/contents/{+path}","compare_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/compare/{base}...{head}","merges_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/merges","archive_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/downloads","issues_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/issues{/number}","pulls_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls{/number}","milestones_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/milestones{/number}","notifications_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/labels{/name}","releases_url":"https://api.github.com/repos/scipy-conference/scipy_proceedings/releases{/id}","created_at":"2011-05-31T10:26:48Z","updated_at":"2015-06-22T07:22:47Z","pushed_at":"2015-06-28T15:59:09Z","git_url":"git://github.com/scipy-conference/scipy_proceedings.git","ssh_url":"git@github.com:scipy-conference/scipy_proceedings.git","clone_url":"https://github.com/scipy-conference/scipy_proceedings.git","svn_url":"https://github.com/scipy-conference/scipy_proceedings","homepage":"","size":153983,"stargazers_count":76,"watchers_count":76,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":142,"mirror_url":null,"open_issues_count":38,"forks":142,"open_issues":38,"watchers":76,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142"},"html":{"href":"https://github.com/scipy-conference/scipy_proceedings/pull/142"},"issue":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/issues/142"},"comments":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/issues/142/comments"},"review_comments":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142/comments"},"review_comment":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/pulls/142/commits"},"statuses":{"href":"https://api.github.com/repos/scipy-conference/scipy_proceedings/statuses/e1d1c16bf7914698fc3500304b05764ae5bfc6fd"}}}}