{"action":"created","issue":{"url":"https://api.github.com/repos/edx/edx-analytics-pipeline/issues/154","labels_url":"https://api.github.com/repos/edx/edx-analytics-pipeline/issues/154/labels{/name}","comments_url":"https://api.github.com/repos/edx/edx-analytics-pipeline/issues/154/comments","events_url":"https://api.github.com/repos/edx/edx-analytics-pipeline/issues/154/events","html_url":"https://github.com/edx/edx-analytics-pipeline/pull/154","id":104785667,"number":154,"title":"Modify the student engagement tasks to ingest forum vote events.","user":{"login":"smarnach","id":249196,"avatar_url":"https://avatars.githubusercontent.com/u/249196?v=3","gravatar_id":"","url":"https://api.github.com/users/smarnach","html_url":"https://github.com/smarnach","followers_url":"https://api.github.com/users/smarnach/followers","following_url":"https://api.github.com/users/smarnach/following{/other_user}","gists_url":"https://api.github.com/users/smarnach/gists{/gist_id}","starred_url":"https://api.github.com/users/smarnach/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/smarnach/subscriptions","organizations_url":"https://api.github.com/users/smarnach/orgs","repos_url":"https://api.github.com/users/smarnach/repos","events_url":"https://api.github.com/users/smarnach/events{/privacy}","received_events_url":"https://api.github.com/users/smarnach/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-09-03T21:29:28Z","updated_at":"2015-09-14T10:21:49Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/edx/edx-analytics-pipeline/pulls/154","html_url":"https://github.com/edx/edx-analytics-pipeline/pull/154","diff_url":"https://github.com/edx/edx-analytics-pipeline/pull/154.diff","patch_url":"https://github.com/edx/edx-analytics-pipeline/pull/154.patch"},"body":"Include the forum vote events added to edx-platform in [PR #9616](https://github.com/edx/edx-platform/pull/9616) in the student engagement analysis pipeline.  Copy all columns that are related to forum engagement to a new MySQL table for consumption from Insights.\r\n\r\n**Dependencies**\r\n* [edx-platform PR #9616](https://github.com/edx/edx-platform/pull/9616)\r\n\r\n**Testing**\r\nGo to the Discussion tab in a random course in edx-platform and add a few posts.  Log in as one or more other users and add responses, vote and undo votes.  You can vote on anonymous posts as well.  When done, runn the pipeline with\r\n\r\n    export WHEEL_URL=http://edx-wheelhouse.s3-website-us-east-1.amazonaws.com/Ubuntu/precise\r\n    remote-task --vagrant-path ../ --remote-name forum_events --override-config $PWD/config/devstack.cfg --wheel-url $WHEEL_URL --repo https://github.com/open-craft/edx-analytics-pipeline.git --branch smarnach/forum-vote-events --wait StudentForumEngagementToMysqlTask --local-scheduler --interval=2015-08-31-2015-09-07 --n-reduce-tasks 1\r\n\r\nCheck the results in MySQL by running `mysql -u root reports` on the devstack and looking at the `student_forum_engagement` table.  To make sure undoing votes works as expected, you can then delete the data tables from Hive \r\n\r\n    drop table student_engagement_joined_daily;\r\n    drop table student_engagement_raw_daily;\r\n\r\nand from HDFS\r\n\r\n    hdfs dfs -rm /edx-analytics-pipeline/warehouse/student_engagement*\r\n\r\nUndo one of your votes in the LMS and run the pipeline again.  Compare the results in MySQL to the previous result."},"comment":{"url":"https://api.github.com/repos/edx/edx-analytics-pipeline/issues/comments/140029437","html_url":"https://github.com/edx/edx-analytics-pipeline/pull/154#issuecomment-140029437","issue_url":"https://api.github.com/repos/edx/edx-analytics-pipeline/issues/154","id":140029437,"user":{"login":"smarnach","id":249196,"avatar_url":"https://avatars.githubusercontent.com/u/249196?v=3","gravatar_id":"","url":"https://api.github.com/users/smarnach","html_url":"https://github.com/smarnach","followers_url":"https://api.github.com/users/smarnach/followers","following_url":"https://api.github.com/users/smarnach/following{/other_user}","gists_url":"https://api.github.com/users/smarnach/gists{/gist_id}","starred_url":"https://api.github.com/users/smarnach/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/smarnach/subscriptions","organizations_url":"https://api.github.com/users/smarnach/orgs","repos_url":"https://api.github.com/users/smarnach/repos","events_url":"https://api.github.com/users/smarnach/events{/privacy}","received_events_url":"https://api.github.com/users/smarnach/received_events","type":"User","site_admin":false},"created_at":"2015-09-14T10:21:49Z","updated_at":"2015-09-14T10:21:49Z","body":"@bradenmacdonald Thanks a lot for taking this over!  I've looked through the code and added a few minor comments.  :+1: On sending this upstream to actually run the test."}}