{"action":"created","comment":{"url":"https://api.github.com/repos/amplab/tachyon/pulls/comments/42079386","id":42079386,"diff_hunk":"@@ -0,0 +1,201 @@\n+---\n+layout: global\n+title: Running Tachyon with Yarn on EC2\n+nickname: Tachyon on EC2 with Yarn\n+group: User Guide\n+priority: 5\n+---\n+\n+Tachyon can be started and managed by Apache Yarn. This guide demonstrates how to launch Tachyon\n+with Yarn on EC2 machines using the\n+[Vagrant scripts](https://github.com/amplab/tachyon/tree/master/deploy/vagrant) that come with\n+Tachyon.\n+\n+# Prerequisites\n+\n+**Install Vagrant and the AWS plugins**\n+\n+Download [Vagrant](https://www.vagrantup.com/downloads.html)\n+\n+Install AWS Vagrant plugin:\n+\n+```bash\n+$ vagrant plugin install vagrant-aws\n+$ vagrant box add dummy https://github.com/mitchellh/vagrant-aws/raw/master/dummy.box\n+```\n+\n+**Install Tachyon**\n+\n+Download Tachyon to your local machine, and unzip it:\n+\n+```bash\n+$ wget http://tachyon-project.org/downloads/files/{{site.TACHYON_RELEASED_VERSION}}/tachyon-{{site.TACHYON_RELEASED_VERSION}}-bin.tar.gz\n+$ tar xvfz tachyon-{{site.TACHYON_RELEASED_VERSION}}-bin.tar.gz\n+```\n+\n+**Install python library dependencies**\n+\n+Install [python>=2.7](https://www.python.org/), not python3.\n+\n+Under `deploy/vagrant` directory in your home directory, run:\n+\n+```bash\n+$ sudo bash bin/install.sh\n+```\n+\n+Alternatively, you can manually install [pip](https://pip.pypa.io/en/latest/installing/), and then\n+in `deploy/vagrant` run:\n+\n+```bash\n+$ sudo pip install -r pip-req.txt\n+```\n+\n+# Launch a Cluster\n+\n+To run a Tachyon cluster on EC2, first sign up for an Amazon EC2 account\n+on the [Amazon Web Services site](http://aws.amazon.com/).\n+\n+Then create [access keys](https://aws.amazon.com/developers/access-keys/) and set shell environment\n+variables `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` by:\n+\n+```bash\n+$ export AWS_ACCESS_KEY_ID=<your access key>\n+$ export AWS_SECRET_ACCESS_KEY=<your secret access key>\n+```\n+\n+Next generate your EC2\n+[Key Pairs](http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-key-pairs.html). Make sure to set\n+the permissions of your private key file that only you can read it:\n+\n+```bash\n+$ chmod 400 <your key pair>.pem\n+```\n+\n+In the configuration file `deploy/vagrant/conf/ec2.yml`, set the value of `Keypair` to your keypair\n+name and `Key_Path` to the path to the pem key.\n+\n+By default, the Vagrant script creates a\n+[Security Group](http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-network-security.html)\n+named *tachyon-vagrant-test* at\n+[Region(**us-east-1**) and Availability Zone(**us-east-1a**)](http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-regions-availability-zones.html).\n+The security group will be set up automatically in the region with all inbound/outbound network\n+traffic opened. You can change the security group, region and availability zone in `ec2.yml`.\n+\n+Now you can launch the Tachyon cluster with Hadoop2.4.1 as under filesystem in us-east-1a by running\n+the script under `deploy/vagrant`:\n+\n+```bash\n+$ ./create <number of machines> aws\n+```\n+\n+# Access the cluster\n+\n+**Access through Web UI**\n+\n+After command `./create <number of machines> aws` succeeds, you can see two green lines like below\n+shown at the end of the shell output:\n+\n+    >>> TachyonMaster public IP is xxx <<<","path":"docs/Running-Tachyon-on-EC2-Yarn.md","position":98,"original_position":98,"commit_id":"c65d24607cad88047bf15ae4e76cc3af4a42afe6","original_commit_id":"c65d24607cad88047bf15ae4e76cc3af4a42afe6","user":{"login":"uronce-cc","id":3663941,"avatar_url":"https://avatars.githubusercontent.com/u/3663941?v=3","gravatar_id":"","url":"https://api.github.com/users/uronce-cc","html_url":"https://github.com/uronce-cc","followers_url":"https://api.github.com/users/uronce-cc/followers","following_url":"https://api.github.com/users/uronce-cc/following{/other_user}","gists_url":"https://api.github.com/users/uronce-cc/gists{/gist_id}","starred_url":"https://api.github.com/users/uronce-cc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/uronce-cc/subscriptions","organizations_url":"https://api.github.com/users/uronce-cc/orgs","repos_url":"https://api.github.com/users/uronce-cc/repos","events_url":"https://api.github.com/users/uronce-cc/events{/privacy}","received_events_url":"https://api.github.com/users/uronce-cc/received_events","type":"User","site_admin":false},"body":"These two lines have been changed, please refer to: https://github.com/amplab/tachyon/pull/1770/files#diff-1c8a2140e6601cebfefd4c9505a8b0d3R106","created_at":"2015-10-15T03:06:04Z","updated_at":"2015-10-15T03:06:04Z","html_url":"https://github.com/amplab/tachyon/pull/1770#discussion_r42079386","pull_request_url":"https://api.github.com/repos/amplab/tachyon/pulls/1770","_links":{"self":{"href":"https://api.github.com/repos/amplab/tachyon/pulls/comments/42079386"},"html":{"href":"https://github.com/amplab/tachyon/pull/1770#discussion_r42079386"},"pull_request":{"href":"https://api.github.com/repos/amplab/tachyon/pulls/1770"}}},"pull_request":{"url":"https://api.github.com/repos/amplab/tachyon/pulls/1770","id":47399841,"html_url":"https://github.com/amplab/tachyon/pull/1770","diff_url":"https://github.com/amplab/tachyon/pull/1770.diff","patch_url":"https://github.com/amplab/tachyon/pull/1770.patch","issue_url":"https://api.github.com/repos/amplab/tachyon/issues/1770","number":1770,"state":"open","locked":false,"title":"[TACHYON-1115] Update docs to reflect latest setup/features","user":{"login":"calvinjia","id":2223813,"avatar_url":"https://avatars.githubusercontent.com/u/2223813?v=3","gravatar_id":"","url":"https://api.github.com/users/calvinjia","html_url":"https://github.com/calvinjia","followers_url":"https://api.github.com/users/calvinjia/followers","following_url":"https://api.github.com/users/calvinjia/following{/other_user}","gists_url":"https://api.github.com/users/calvinjia/gists{/gist_id}","starred_url":"https://api.github.com/users/calvinjia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/calvinjia/subscriptions","organizations_url":"https://api.github.com/users/calvinjia/orgs","repos_url":"https://api.github.com/users/calvinjia/repos","events_url":"https://api.github.com/users/calvinjia/events{/privacy}","received_events_url":"https://api.github.com/users/calvinjia/received_events","type":"User","site_admin":false},"body":"https://tachyon.atlassian.net/browse/TACHYON-1115","created_at":"2015-10-12T09:30:46Z","updated_at":"2015-10-15T03:06:04Z","closed_at":null,"merged_at":null,"merge_commit_sha":"7491fbe0a1c13ccef89a2cad49113faa9b9434e5","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/amplab/tachyon/pulls/1770/commits","review_comments_url":"https://api.github.com/repos/amplab/tachyon/pulls/1770/comments","review_comment_url":"https://api.github.com/repos/amplab/tachyon/pulls/comments{/number}","comments_url":"https://api.github.com/repos/amplab/tachyon/issues/1770/comments","statuses_url":"https://api.github.com/repos/amplab/tachyon/statuses/c65d24607cad88047bf15ae4e76cc3af4a42afe6","head":{"label":"amplab:0.8-docs","ref":"0.8-docs","sha":"c65d24607cad88047bf15ae4e76cc3af4a42afe6","user":{"login":"amplab","id":1438454,"avatar_url":"https://avatars.githubusercontent.com/u/1438454?v=3","gravatar_id":"","url":"https://api.github.com/users/amplab","html_url":"https://github.com/amplab","followers_url":"https://api.github.com/users/amplab/followers","following_url":"https://api.github.com/users/amplab/following{/other_user}","gists_url":"https://api.github.com/users/amplab/gists{/gist_id}","starred_url":"https://api.github.com/users/amplab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amplab/subscriptions","organizations_url":"https://api.github.com/users/amplab/orgs","repos_url":"https://api.github.com/users/amplab/repos","events_url":"https://api.github.com/users/amplab/events{/privacy}","received_events_url":"https://api.github.com/users/amplab/received_events","type":"Organization","site_admin":false},"repo":{"id":7276954,"name":"tachyon","full_name":"amplab/tachyon","owner":{"login":"amplab","id":1438454,"avatar_url":"https://avatars.githubusercontent.com/u/1438454?v=3","gravatar_id":"","url":"https://api.github.com/users/amplab","html_url":"https://github.com/amplab","followers_url":"https://api.github.com/users/amplab/followers","following_url":"https://api.github.com/users/amplab/following{/other_user}","gists_url":"https://api.github.com/users/amplab/gists{/gist_id}","starred_url":"https://api.github.com/users/amplab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amplab/subscriptions","organizations_url":"https://api.github.com/users/amplab/orgs","repos_url":"https://api.github.com/users/amplab/repos","events_url":"https://api.github.com/users/amplab/events{/privacy}","received_events_url":"https://api.github.com/users/amplab/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/amplab/tachyon","description":"Memory Centric Reliable Distributed Storage","fork":false,"url":"https://api.github.com/repos/amplab/tachyon","forks_url":"https://api.github.com/repos/amplab/tachyon/forks","keys_url":"https://api.github.com/repos/amplab/tachyon/keys{/key_id}","collaborators_url":"https://api.github.com/repos/amplab/tachyon/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/amplab/tachyon/teams","hooks_url":"https://api.github.com/repos/amplab/tachyon/hooks","issue_events_url":"https://api.github.com/repos/amplab/tachyon/issues/events{/number}","events_url":"https://api.github.com/repos/amplab/tachyon/events","assignees_url":"https://api.github.com/repos/amplab/tachyon/assignees{/user}","branches_url":"https://api.github.com/repos/amplab/tachyon/branches{/branch}","tags_url":"https://api.github.com/repos/amplab/tachyon/tags","blobs_url":"https://api.github.com/repos/amplab/tachyon/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/amplab/tachyon/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/amplab/tachyon/git/refs{/sha}","trees_url":"https://api.github.com/repos/amplab/tachyon/git/trees{/sha}","statuses_url":"https://api.github.com/repos/amplab/tachyon/statuses/{sha}","languages_url":"https://api.github.com/repos/amplab/tachyon/languages","stargazers_url":"https://api.github.com/repos/amplab/tachyon/stargazers","contributors_url":"https://api.github.com/repos/amplab/tachyon/contributors","subscribers_url":"https://api.github.com/repos/amplab/tachyon/subscribers","subscription_url":"https://api.github.com/repos/amplab/tachyon/subscription","commits_url":"https://api.github.com/repos/amplab/tachyon/commits{/sha}","git_commits_url":"https://api.github.com/repos/amplab/tachyon/git/commits{/sha}","comments_url":"https://api.github.com/repos/amplab/tachyon/comments{/number}","issue_comment_url":"https://api.github.com/repos/amplab/tachyon/issues/comments{/number}","contents_url":"https://api.github.com/repos/amplab/tachyon/contents/{+path}","compare_url":"https://api.github.com/repos/amplab/tachyon/compare/{base}...{head}","merges_url":"https://api.github.com/repos/amplab/tachyon/merges","archive_url":"https://api.github.com/repos/amplab/tachyon/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/amplab/tachyon/downloads","issues_url":"https://api.github.com/repos/amplab/tachyon/issues{/number}","pulls_url":"https://api.github.com/repos/amplab/tachyon/pulls{/number}","milestones_url":"https://api.github.com/repos/amplab/tachyon/milestones{/number}","notifications_url":"https://api.github.com/repos/amplab/tachyon/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/amplab/tachyon/labels{/name}","releases_url":"https://api.github.com/repos/amplab/tachyon/releases{/id}","created_at":"2012-12-21T17:43:46Z","updated_at":"2015-10-15T01:16:52Z","pushed_at":"2015-10-15T01:46:27Z","git_url":"git://github.com/amplab/tachyon.git","ssh_url":"git@github.com:amplab/tachyon.git","clone_url":"https://github.com/amplab/tachyon.git","svn_url":"https://github.com/amplab/tachyon","homepage":"http://tachyon-project.org","size":55418,"stargazers_count":1634,"watchers_count":1634,"language":"Java","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":651,"mirror_url":null,"open_issues_count":29,"forks":651,"open_issues":29,"watchers":1634,"default_branch":"master"}},"base":{"label":"amplab:master","ref":"master","sha":"cbe873c8222a18d6e334cfa30c0454d58035fa2f","user":{"login":"amplab","id":1438454,"avatar_url":"https://avatars.githubusercontent.com/u/1438454?v=3","gravatar_id":"","url":"https://api.github.com/users/amplab","html_url":"https://github.com/amplab","followers_url":"https://api.github.com/users/amplab/followers","following_url":"https://api.github.com/users/amplab/following{/other_user}","gists_url":"https://api.github.com/users/amplab/gists{/gist_id}","starred_url":"https://api.github.com/users/amplab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amplab/subscriptions","organizations_url":"https://api.github.com/users/amplab/orgs","repos_url":"https://api.github.com/users/amplab/repos","events_url":"https://api.github.com/users/amplab/events{/privacy}","received_events_url":"https://api.github.com/users/amplab/received_events","type":"Organization","site_admin":false},"repo":{"id":7276954,"name":"tachyon","full_name":"amplab/tachyon","owner":{"login":"amplab","id":1438454,"avatar_url":"https://avatars.githubusercontent.com/u/1438454?v=3","gravatar_id":"","url":"https://api.github.com/users/amplab","html_url":"https://github.com/amplab","followers_url":"https://api.github.com/users/amplab/followers","following_url":"https://api.github.com/users/amplab/following{/other_user}","gists_url":"https://api.github.com/users/amplab/gists{/gist_id}","starred_url":"https://api.github.com/users/amplab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amplab/subscriptions","organizations_url":"https://api.github.com/users/amplab/orgs","repos_url":"https://api.github.com/users/amplab/repos","events_url":"https://api.github.com/users/amplab/events{/privacy}","received_events_url":"https://api.github.com/users/amplab/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/amplab/tachyon","description":"Memory Centric Reliable Distributed Storage","fork":false,"url":"https://api.github.com/repos/amplab/tachyon","forks_url":"https://api.github.com/repos/amplab/tachyon/forks","keys_url":"https://api.github.com/repos/amplab/tachyon/keys{/key_id}","collaborators_url":"https://api.github.com/repos/amplab/tachyon/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/amplab/tachyon/teams","hooks_url":"https://api.github.com/repos/amplab/tachyon/hooks","issue_events_url":"https://api.github.com/repos/amplab/tachyon/issues/events{/number}","events_url":"https://api.github.com/repos/amplab/tachyon/events","assignees_url":"https://api.github.com/repos/amplab/tachyon/assignees{/user}","branches_url":"https://api.github.com/repos/amplab/tachyon/branches{/branch}","tags_url":"https://api.github.com/repos/amplab/tachyon/tags","blobs_url":"https://api.github.com/repos/amplab/tachyon/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/amplab/tachyon/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/amplab/tachyon/git/refs{/sha}","trees_url":"https://api.github.com/repos/amplab/tachyon/git/trees{/sha}","statuses_url":"https://api.github.com/repos/amplab/tachyon/statuses/{sha}","languages_url":"https://api.github.com/repos/amplab/tachyon/languages","stargazers_url":"https://api.github.com/repos/amplab/tachyon/stargazers","contributors_url":"https://api.github.com/repos/amplab/tachyon/contributors","subscribers_url":"https://api.github.com/repos/amplab/tachyon/subscribers","subscription_url":"https://api.github.com/repos/amplab/tachyon/subscription","commits_url":"https://api.github.com/repos/amplab/tachyon/commits{/sha}","git_commits_url":"https://api.github.com/repos/amplab/tachyon/git/commits{/sha}","comments_url":"https://api.github.com/repos/amplab/tachyon/comments{/number}","issue_comment_url":"https://api.github.com/repos/amplab/tachyon/issues/comments{/number}","contents_url":"https://api.github.com/repos/amplab/tachyon/contents/{+path}","compare_url":"https://api.github.com/repos/amplab/tachyon/compare/{base}...{head}","merges_url":"https://api.github.com/repos/amplab/tachyon/merges","archive_url":"https://api.github.com/repos/amplab/tachyon/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/amplab/tachyon/downloads","issues_url":"https://api.github.com/repos/amplab/tachyon/issues{/number}","pulls_url":"https://api.github.com/repos/amplab/tachyon/pulls{/number}","milestones_url":"https://api.github.com/repos/amplab/tachyon/milestones{/number}","notifications_url":"https://api.github.com/repos/amplab/tachyon/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/amplab/tachyon/labels{/name}","releases_url":"https://api.github.com/repos/amplab/tachyon/releases{/id}","created_at":"2012-12-21T17:43:46Z","updated_at":"2015-10-15T01:16:52Z","pushed_at":"2015-10-15T01:46:27Z","git_url":"git://github.com/amplab/tachyon.git","ssh_url":"git@github.com:amplab/tachyon.git","clone_url":"https://github.com/amplab/tachyon.git","svn_url":"https://github.com/amplab/tachyon","homepage":"http://tachyon-project.org","size":55418,"stargazers_count":1634,"watchers_count":1634,"language":"Java","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":651,"mirror_url":null,"open_issues_count":29,"forks":651,"open_issues":29,"watchers":1634,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/amplab/tachyon/pulls/1770"},"html":{"href":"https://github.com/amplab/tachyon/pull/1770"},"issue":{"href":"https://api.github.com/repos/amplab/tachyon/issues/1770"},"comments":{"href":"https://api.github.com/repos/amplab/tachyon/issues/1770/comments"},"review_comments":{"href":"https://api.github.com/repos/amplab/tachyon/pulls/1770/comments"},"review_comment":{"href":"https://api.github.com/repos/amplab/tachyon/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/amplab/tachyon/pulls/1770/commits"},"statuses":{"href":"https://api.github.com/repos/amplab/tachyon/statuses/c65d24607cad88047bf15ae4e76cc3af4a42afe6"}}}}