{"action":"created","comment":{"url":"https://api.github.com/repos/caskdata/cdap/pulls/comments/43173843","id":43173843,"diff_hunk":"@@ -0,0 +1,280 @@\n+.. meta::\n+    :author: Cask Data, Inc.\n+    :copyright: Copyright © 2015 Cask Data, Inc.\n+\n+.. _ambari-configuring:\n+\n+============================================\n+Configuring and Installing CDAP using Ambari\n+============================================\n+\n+\n+Overview\n+========\n+\n+.. highlight:: console\n+\n+This section will familiarize you with CDAP's integration with `Apache Ambari\n+<https://ambari.apache.org/>`__, the open source provisioning system for `HDP (Hortonworks\n+Data Platform) <http://hortonworks.com/>`__.\n+\n+You can use `Ambari <https://ambari.apache.org>`__ to integrate CDAP into a Hadoop cluster\n+by adding the `CDAP Ambari Services <https://github.com/caskdata/cdap-ambari-service>`__\n+to your Ambari server. Once you have restarted your server, you will able to\n+use the Ambari UI (Ambari Dashboard) to install, start and manage CDAP on Hadoop clusters.\n+\n+These instructions cover the steps to integrate CDAP using Apache Ambari:\n+\n+- **Prerequisites:** Adding the CDAP Service to Ambari.\n+- **Adding CDAP:** Adding CDAP to Your Cluster.\n+- **Installing CDAP:** Installing CDAP by running the *Add Service* Wizard, and starting CDAP.\n+- **Roadmap and Future Features:** Confirming that CDAP was installed and configured successfully.\n+\n+\n+Adding the CDAP Service to Ambari\n+=================================\n+To install CDAP on a cluster managed by Ambari, we have provided packages for\n+RHEL-compatible and Ubuntu systems, which are installed onto the Ambari management server.\n+These packages add CDAP to the list of available services which Ambari can install. \n+\n+To install the ``cdap-ambari-service`` package, first add the appropriate CDAP repository\n+to your system’s package manager by following :ref:`this procedure for installing a Cask\n+repository <install-preparing-the-cluster>` on your Ambari server.\n+\n+The *repository version* must match the *CDAP version* which you’d like installed on your\n+cluster. To get the *CDAP 3.0 series,* you would install the *CDAP 3.0 repository.* The\n+default is to use CDAP 3.2, which has the widest compatibility with Ambari-supported\n+Hadoop distributions.\n+\n++---------------------------------------------------------+\n+| Supported Hortonworks Data Platform (HDP) Distributions |\n++----------------+----------------------------------------+\n+| CDAP Version   | Hadoop Distributions                   |\n++================+========================================+\n+| CDAP 3.0.x     | HDP 2.0, HDP 2.1                       |\n++----------------+----------------------------------------+\n+| CDAP 3.1.x     | HDP 2.0, HDP 2.1, HDP 2.2              |\n++----------------+----------------------------------------+\n+| CDAP 3.2.x     | HDP 2.0, HDP 2.1, HDP 2.2, HDP 2.3     |\n++----------------+----------------------------------------+\n+\n+**Note:** The CDAP Ambari service has been tested on Ambari Server 2.0 and 2.1, as\n+supplied from Hortonworks.\n+\n+\n+.. rubric:: Installing via APT\n+\n+::\n+\n+  $ sudo apt-get install -y cdap-ambari-service\n+  $ sudo ambari-server restart\n+\n+.. rubric:: Installing via YUM\n+\n+::\n+\n+  $ sudo yum install -y cdap-ambari-service\n+  $ sudo ambari-server restart\n+\n+\n+Adding CDAP to Your Cluster\n+===========================\n+\n+.. rubric:: Dependencies\n+\n+CDAP depends on certain services being present on the cluster. There are **core\n+dependencies,** which must be running for CDAP system services to operate correctly, and\n+**optional dependencies,** which may be required for certain functionality or program types.\n+\n+The host running the CDAP Master service must have the HDFS, YARN, and HBase clients\n+installed, as CDAP uses the command line clients of these for initialization and their\n+connectivity information for external service dependencies. Also, CDAP currently requires\n+Internet access on the CDAP service nodes until the issues `CDAP-3957\n+<https://issues.cask.co/browse/CDAP-3957>`__ or `AMBARI-13456\n+<https://issues.apache.org/jira/browse/AMBARI-13456>`__ are resolved.\n+\n+.. rubric:: Core Dependencies\n+\n+- **HDFS:** used as the backing file system for distributed storage\n+- **MapReduce2:** used for batch operations in workflows and data exploration\n+- **YARN:** used for running system services in containers on cluster NodeManagers\n+- **HBase:** used for system runtime storage and queues\n+- **ZooKeeper:** used for service discovery and leader election\n+\n+.. rubric:: Optional Dependencies\n+\n+- **Hive:** used for data exploration using SQL queries via CDAP Explore system service\n+- **Spark:** used for running Spark programs within CDAP applications","path":"cdap-docs/integrations/source/ambari/index.rst","position":107,"original_position":107,"commit_id":"ff7efd9f51a16e8089202414b446921074f7e769","original_commit_id":"ff7efd9f51a16e8089202414b446921074f7e769","user":{"login":"wolf31o2","id":380021,"avatar_url":"https://avatars.githubusercontent.com/u/380021?v=3","gravatar_id":"","url":"https://api.github.com/users/wolf31o2","html_url":"https://github.com/wolf31o2","followers_url":"https://api.github.com/users/wolf31o2/followers","following_url":"https://api.github.com/users/wolf31o2/following{/other_user}","gists_url":"https://api.github.com/users/wolf31o2/gists{/gist_id}","starred_url":"https://api.github.com/users/wolf31o2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wolf31o2/subscriptions","organizations_url":"https://api.github.com/users/wolf31o2/orgs","repos_url":"https://api.github.com/users/wolf31o2/repos","events_url":"https://api.github.com/users/wolf31o2/events{/privacy}","received_events_url":"https://api.github.com/users/wolf31o2/received_events","type":"User","site_admin":false},"body":"Should we add `(on HDP 2.2+)` to Spark, since it's not available on previous versions?","created_at":"2015-10-27T19:30:10Z","updated_at":"2015-10-27T19:30:10Z","html_url":"https://github.com/caskdata/cdap/pull/4409#discussion_r43173843","pull_request_url":"https://api.github.com/repos/caskdata/cdap/pulls/4409","_links":{"self":{"href":"https://api.github.com/repos/caskdata/cdap/pulls/comments/43173843"},"html":{"href":"https://github.com/caskdata/cdap/pull/4409#discussion_r43173843"},"pull_request":{"href":"https://api.github.com/repos/caskdata/cdap/pulls/4409"}}},"pull_request":{"url":"https://api.github.com/repos/caskdata/cdap/pulls/4409","id":48906486,"html_url":"https://github.com/caskdata/cdap/pull/4409","diff_url":"https://github.com/caskdata/cdap/pull/4409.diff","patch_url":"https://github.com/caskdata/cdap/pull/4409.patch","issue_url":"https://api.github.com/repos/caskdata/cdap/issues/4409","number":4409,"state":"open","locked":false,"title":"Ambari documentation","user":{"login":"awholegunch","id":6394794,"avatar_url":"https://avatars.githubusercontent.com/u/6394794?v=3","gravatar_id":"","url":"https://api.github.com/users/awholegunch","html_url":"https://github.com/awholegunch","followers_url":"https://api.github.com/users/awholegunch/followers","following_url":"https://api.github.com/users/awholegunch/following{/other_user}","gists_url":"https://api.github.com/users/awholegunch/gists{/gist_id}","starred_url":"https://api.github.com/users/awholegunch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/awholegunch/subscriptions","organizations_url":"https://api.github.com/users/awholegunch/orgs","repos_url":"https://api.github.com/users/awholegunch/repos","events_url":"https://api.github.com/users/awholegunch/events{/privacy}","received_events_url":"https://api.github.com/users/awholegunch/received_events","type":"User","site_admin":false},"body":"Passes [Quick Build](http://builds.cask.co/browse/CDAP-DOB27-1)","created_at":"2015-10-27T17:44:24Z","updated_at":"2015-10-27T19:30:10Z","closed_at":null,"merged_at":null,"merge_commit_sha":"c9c64cc88f0e3025a4be853a242093ff0b9a410f","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/caskdata/cdap/pulls/4409/commits","review_comments_url":"https://api.github.com/repos/caskdata/cdap/pulls/4409/comments","review_comment_url":"https://api.github.com/repos/caskdata/cdap/pulls/comments{/number}","comments_url":"https://api.github.com/repos/caskdata/cdap/issues/4409/comments","statuses_url":"https://api.github.com/repos/caskdata/cdap/statuses/ff7efd9f51a16e8089202414b446921074f7e769","head":{"label":"caskdata:feature/r3.1_Ambari","ref":"feature/r3.1_Ambari","sha":"ff7efd9f51a16e8089202414b446921074f7e769","user":{"login":"caskdata","id":8123023,"avatar_url":"https://avatars.githubusercontent.com/u/8123023?v=3","gravatar_id":"","url":"https://api.github.com/users/caskdata","html_url":"https://github.com/caskdata","followers_url":"https://api.github.com/users/caskdata/followers","following_url":"https://api.github.com/users/caskdata/following{/other_user}","gists_url":"https://api.github.com/users/caskdata/gists{/gist_id}","starred_url":"https://api.github.com/users/caskdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caskdata/subscriptions","organizations_url":"https://api.github.com/users/caskdata/orgs","repos_url":"https://api.github.com/users/caskdata/repos","events_url":"https://api.github.com/users/caskdata/events{/privacy}","received_events_url":"https://api.github.com/users/caskdata/received_events","type":"Organization","site_admin":false},"repo":{"id":22542759,"name":"cdap","full_name":"caskdata/cdap","owner":{"login":"caskdata","id":8123023,"avatar_url":"https://avatars.githubusercontent.com/u/8123023?v=3","gravatar_id":"","url":"https://api.github.com/users/caskdata","html_url":"https://github.com/caskdata","followers_url":"https://api.github.com/users/caskdata/followers","following_url":"https://api.github.com/users/caskdata/following{/other_user}","gists_url":"https://api.github.com/users/caskdata/gists{/gist_id}","starred_url":"https://api.github.com/users/caskdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caskdata/subscriptions","organizations_url":"https://api.github.com/users/caskdata/orgs","repos_url":"https://api.github.com/users/caskdata/repos","events_url":"https://api.github.com/users/caskdata/events{/privacy}","received_events_url":"https://api.github.com/users/caskdata/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/caskdata/cdap","description":"Cask Data Application Platform (CDAP)","fork":false,"url":"https://api.github.com/repos/caskdata/cdap","forks_url":"https://api.github.com/repos/caskdata/cdap/forks","keys_url":"https://api.github.com/repos/caskdata/cdap/keys{/key_id}","collaborators_url":"https://api.github.com/repos/caskdata/cdap/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/caskdata/cdap/teams","hooks_url":"https://api.github.com/repos/caskdata/cdap/hooks","issue_events_url":"https://api.github.com/repos/caskdata/cdap/issues/events{/number}","events_url":"https://api.github.com/repos/caskdata/cdap/events","assignees_url":"https://api.github.com/repos/caskdata/cdap/assignees{/user}","branches_url":"https://api.github.com/repos/caskdata/cdap/branches{/branch}","tags_url":"https://api.github.com/repos/caskdata/cdap/tags","blobs_url":"https://api.github.com/repos/caskdata/cdap/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/caskdata/cdap/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/caskdata/cdap/git/refs{/sha}","trees_url":"https://api.github.com/repos/caskdata/cdap/git/trees{/sha}","statuses_url":"https://api.github.com/repos/caskdata/cdap/statuses/{sha}","languages_url":"https://api.github.com/repos/caskdata/cdap/languages","stargazers_url":"https://api.github.com/repos/caskdata/cdap/stargazers","contributors_url":"https://api.github.com/repos/caskdata/cdap/contributors","subscribers_url":"https://api.github.com/repos/caskdata/cdap/subscribers","subscription_url":"https://api.github.com/repos/caskdata/cdap/subscription","commits_url":"https://api.github.com/repos/caskdata/cdap/commits{/sha}","git_commits_url":"https://api.github.com/repos/caskdata/cdap/git/commits{/sha}","comments_url":"https://api.github.com/repos/caskdata/cdap/comments{/number}","issue_comment_url":"https://api.github.com/repos/caskdata/cdap/issues/comments{/number}","contents_url":"https://api.github.com/repos/caskdata/cdap/contents/{+path}","compare_url":"https://api.github.com/repos/caskdata/cdap/compare/{base}...{head}","merges_url":"https://api.github.com/repos/caskdata/cdap/merges","archive_url":"https://api.github.com/repos/caskdata/cdap/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/caskdata/cdap/downloads","issues_url":"https://api.github.com/repos/caskdata/cdap/issues{/number}","pulls_url":"https://api.github.com/repos/caskdata/cdap/pulls{/number}","milestones_url":"https://api.github.com/repos/caskdata/cdap/milestones{/number}","notifications_url":"https://api.github.com/repos/caskdata/cdap/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/caskdata/cdap/labels{/name}","releases_url":"https://api.github.com/repos/caskdata/cdap/releases{/id}","created_at":"2014-08-02T09:00:10Z","updated_at":"2015-10-15T21:51:26Z","pushed_at":"2015-10-27T19:18:46Z","git_url":"git://github.com/caskdata/cdap.git","ssh_url":"git@github.com:caskdata/cdap.git","clone_url":"https://github.com/caskdata/cdap.git","svn_url":"https://github.com/caskdata/cdap","homepage":"http://cdap.io","size":876075,"stargazers_count":76,"watchers_count":76,"language":"Java","has_issues":false,"has_downloads":true,"has_wiki":false,"has_pages":true,"forks_count":23,"mirror_url":null,"open_issues_count":18,"forks":23,"open_issues":18,"watchers":76,"default_branch":"develop"}},"base":{"label":"caskdata:release/3.1","ref":"release/3.1","sha":"7f1ff2569e8f2dbd0b8cd32923d597529aacb337","user":{"login":"caskdata","id":8123023,"avatar_url":"https://avatars.githubusercontent.com/u/8123023?v=3","gravatar_id":"","url":"https://api.github.com/users/caskdata","html_url":"https://github.com/caskdata","followers_url":"https://api.github.com/users/caskdata/followers","following_url":"https://api.github.com/users/caskdata/following{/other_user}","gists_url":"https://api.github.com/users/caskdata/gists{/gist_id}","starred_url":"https://api.github.com/users/caskdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caskdata/subscriptions","organizations_url":"https://api.github.com/users/caskdata/orgs","repos_url":"https://api.github.com/users/caskdata/repos","events_url":"https://api.github.com/users/caskdata/events{/privacy}","received_events_url":"https://api.github.com/users/caskdata/received_events","type":"Organization","site_admin":false},"repo":{"id":22542759,"name":"cdap","full_name":"caskdata/cdap","owner":{"login":"caskdata","id":8123023,"avatar_url":"https://avatars.githubusercontent.com/u/8123023?v=3","gravatar_id":"","url":"https://api.github.com/users/caskdata","html_url":"https://github.com/caskdata","followers_url":"https://api.github.com/users/caskdata/followers","following_url":"https://api.github.com/users/caskdata/following{/other_user}","gists_url":"https://api.github.com/users/caskdata/gists{/gist_id}","starred_url":"https://api.github.com/users/caskdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caskdata/subscriptions","organizations_url":"https://api.github.com/users/caskdata/orgs","repos_url":"https://api.github.com/users/caskdata/repos","events_url":"https://api.github.com/users/caskdata/events{/privacy}","received_events_url":"https://api.github.com/users/caskdata/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/caskdata/cdap","description":"Cask Data Application Platform (CDAP)","fork":false,"url":"https://api.github.com/repos/caskdata/cdap","forks_url":"https://api.github.com/repos/caskdata/cdap/forks","keys_url":"https://api.github.com/repos/caskdata/cdap/keys{/key_id}","collaborators_url":"https://api.github.com/repos/caskdata/cdap/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/caskdata/cdap/teams","hooks_url":"https://api.github.com/repos/caskdata/cdap/hooks","issue_events_url":"https://api.github.com/repos/caskdata/cdap/issues/events{/number}","events_url":"https://api.github.com/repos/caskdata/cdap/events","assignees_url":"https://api.github.com/repos/caskdata/cdap/assignees{/user}","branches_url":"https://api.github.com/repos/caskdata/cdap/branches{/branch}","tags_url":"https://api.github.com/repos/caskdata/cdap/tags","blobs_url":"https://api.github.com/repos/caskdata/cdap/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/caskdata/cdap/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/caskdata/cdap/git/refs{/sha}","trees_url":"https://api.github.com/repos/caskdata/cdap/git/trees{/sha}","statuses_url":"https://api.github.com/repos/caskdata/cdap/statuses/{sha}","languages_url":"https://api.github.com/repos/caskdata/cdap/languages","stargazers_url":"https://api.github.com/repos/caskdata/cdap/stargazers","contributors_url":"https://api.github.com/repos/caskdata/cdap/contributors","subscribers_url":"https://api.github.com/repos/caskdata/cdap/subscribers","subscription_url":"https://api.github.com/repos/caskdata/cdap/subscription","commits_url":"https://api.github.com/repos/caskdata/cdap/commits{/sha}","git_commits_url":"https://api.github.com/repos/caskdata/cdap/git/commits{/sha}","comments_url":"https://api.github.com/repos/caskdata/cdap/comments{/number}","issue_comment_url":"https://api.github.com/repos/caskdata/cdap/issues/comments{/number}","contents_url":"https://api.github.com/repos/caskdata/cdap/contents/{+path}","compare_url":"https://api.github.com/repos/caskdata/cdap/compare/{base}...{head}","merges_url":"https://api.github.com/repos/caskdata/cdap/merges","archive_url":"https://api.github.com/repos/caskdata/cdap/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/caskdata/cdap/downloads","issues_url":"https://api.github.com/repos/caskdata/cdap/issues{/number}","pulls_url":"https://api.github.com/repos/caskdata/cdap/pulls{/number}","milestones_url":"https://api.github.com/repos/caskdata/cdap/milestones{/number}","notifications_url":"https://api.github.com/repos/caskdata/cdap/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/caskdata/cdap/labels{/name}","releases_url":"https://api.github.com/repos/caskdata/cdap/releases{/id}","created_at":"2014-08-02T09:00:10Z","updated_at":"2015-10-15T21:51:26Z","pushed_at":"2015-10-27T19:18:46Z","git_url":"git://github.com/caskdata/cdap.git","ssh_url":"git@github.com:caskdata/cdap.git","clone_url":"https://github.com/caskdata/cdap.git","svn_url":"https://github.com/caskdata/cdap","homepage":"http://cdap.io","size":876075,"stargazers_count":76,"watchers_count":76,"language":"Java","has_issues":false,"has_downloads":true,"has_wiki":false,"has_pages":true,"forks_count":23,"mirror_url":null,"open_issues_count":18,"forks":23,"open_issues":18,"watchers":76,"default_branch":"develop"}},"_links":{"self":{"href":"https://api.github.com/repos/caskdata/cdap/pulls/4409"},"html":{"href":"https://github.com/caskdata/cdap/pull/4409"},"issue":{"href":"https://api.github.com/repos/caskdata/cdap/issues/4409"},"comments":{"href":"https://api.github.com/repos/caskdata/cdap/issues/4409/comments"},"review_comments":{"href":"https://api.github.com/repos/caskdata/cdap/pulls/4409/comments"},"review_comment":{"href":"https://api.github.com/repos/caskdata/cdap/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/caskdata/cdap/pulls/4409/commits"},"statuses":{"href":"https://api.github.com/repos/caskdata/cdap/statuses/ff7efd9f51a16e8089202414b446921074f7e769"}}}}