{"action":"created","comment":{"url":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/comments/32708604","id":32708604,"diff_hunk":"@@ -0,0 +1,77 @@\n+The configuration of hanythingondemand starts with the ``hod.conf`` file. This is an ``ini`` style configuration file with at least two sections: ``Meta`` and ``Config``. Here is an example taken from the Hadoop 2.3 configs::\n+\n+    [Meta]\n+    version=1\n+\n+    [Config]\n+    modules=Hadoop/2.3.0-cdh5.0.0\n+    master_env=HADOOP_HOME,EBROOTHADOOP,JAVA_HOME\n+    services=resourcemanager.conf,nodemanager.conf,screen.conf\n+    config_writer=hod.config.writer.hadoop_xml\n+    workdir=/tmp\n+    directories=$localworkdir/dfs/name,$localworkdir/dfs/data\n+    autogen=hadoop\n+\n+Here we have the Meta section with version set to 1. Version refers to the hanythingondemand configuration version. This is a placeholder in case we change thhe configurations around. That's all the Meta is needed for at the moment.\n+\n+* ``modules`` - modules that must be loaded when the cluster begins.\n+* ``master_env`` - environment variables to pass from the master node to the slave nodes. This is used because MPI slaves don't have an environment.\n+* ``services`` - a list of service files containing start and stop script information.\n+* ``config_writer`` - a reference to the python code that will output the configuration used by the services.\n+* ``workdir`` - place where logs and temporary data is written. Configuration files will be copies here as well. ``localworkdir`` is a subdirectory of ``workdir`` and is useful for when ``workdir`` is on a shared file system.\n+* ``directories`` - directories to create. If the service would fail without some directories being created, they should be entered here.\n+* ``autogen`` - Configuration files to autogenerate. This can be `hadoop`, `hadoop_on_lustre2`, or left blank. If it is set then hanythingondemand will create a basic configuration for you. This is particularly useful since it will calculate values for memory settings.You can then override any settings you feel necessary.\n+\n+===================\n+Template parameters\n+===================\n+There are some templating variables that can be entered into the configuration files. These use a dollar sign (``$``) prefix. \n+* ``masterhostname`` - hostname for the master node.","path":"docs/Configuration.rst","position":29,"original_position":29,"commit_id":"de90f0d7eb91507ee969c9ff3d8df70d097df612","original_commit_id":"de90f0d7eb91507ee969c9ff3d8df70d097df612","user":{"login":"boegel","id":620876,"avatar_url":"https://avatars.githubusercontent.com/u/620876?v=3","gravatar_id":"","url":"https://api.github.com/users/boegel","html_url":"https://github.com/boegel","followers_url":"https://api.github.com/users/boegel/followers","following_url":"https://api.github.com/users/boegel/following{/other_user}","gists_url":"https://api.github.com/users/boegel/gists{/gist_id}","starred_url":"https://api.github.com/users/boegel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/boegel/subscriptions","organizations_url":"https://api.github.com/users/boegel/orgs","repos_url":"https://api.github.com/users/boegel/repos","events_url":"https://api.github.com/users/boegel/events{/privacy}","received_events_url":"https://api.github.com/users/boegel/received_events","type":"User","site_admin":false},"body":"syntax issue: missing empty line to make sure the list is rendered correctly\r\n\r\npro tip: use http://rst.ninjs.org/ to check for syntax issues","created_at":"2015-06-18T08:34:07Z","updated_at":"2015-06-18T08:34:07Z","html_url":"https://github.com/hpcugent/hanythingondemand/pull/28#discussion_r32708604","pull_request_url":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28","_links":{"self":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/comments/32708604"},"html":{"href":"https://github.com/hpcugent/hanythingondemand/pull/28#discussion_r32708604"},"pull_request":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28"}}},"pull_request":{"url":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28","id":37357344,"html_url":"https://github.com/hpcugent/hanythingondemand/pull/28","diff_url":"https://github.com/hpcugent/hanythingondemand/pull/28.diff","patch_url":"https://github.com/hpcugent/hanythingondemand/pull/28.patch","issue_url":"https://api.github.com/repos/hpcugent/hanythingondemand/issues/28","number":28,"state":"open","locked":false,"title":"Migrate hod wiki from github to our new sphinx pages.","user":{"login":"ehiggs","id":28823,"avatar_url":"https://avatars.githubusercontent.com/u/28823?v=3","gravatar_id":"","url":"https://api.github.com/users/ehiggs","html_url":"https://github.com/ehiggs","followers_url":"https://api.github.com/users/ehiggs/followers","following_url":"https://api.github.com/users/ehiggs/following{/other_user}","gists_url":"https://api.github.com/users/ehiggs/gists{/gist_id}","starred_url":"https://api.github.com/users/ehiggs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ehiggs/subscriptions","organizations_url":"https://api.github.com/users/ehiggs/orgs","repos_url":"https://api.github.com/users/ehiggs/repos","events_url":"https://api.github.com/users/ehiggs/events{/privacy}","received_events_url":"https://api.github.com/users/ehiggs/received_events","type":"User","site_admin":false},"body":"`sphinx-build docs html` to build the docs into a directory named `html`.","created_at":"2015-06-10T13:19:50Z","updated_at":"2015-06-18T08:34:07Z","closed_at":null,"merged_at":null,"merge_commit_sha":"839facef7cedcb1f946baa8fc56cf7f02841d6d8","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28/commits","review_comments_url":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28/comments","review_comment_url":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/comments{/number}","comments_url":"https://api.github.com/repos/hpcugent/hanythingondemand/issues/28/comments","statuses_url":"https://api.github.com/repos/hpcugent/hanythingondemand/statuses/de90f0d7eb91507ee969c9ff3d8df70d097df612","head":{"label":"ehiggs:document-basic-use","ref":"document-basic-use","sha":"de90f0d7eb91507ee969c9ff3d8df70d097df612","user":{"login":"ehiggs","id":28823,"avatar_url":"https://avatars.githubusercontent.com/u/28823?v=3","gravatar_id":"","url":"https://api.github.com/users/ehiggs","html_url":"https://github.com/ehiggs","followers_url":"https://api.github.com/users/ehiggs/followers","following_url":"https://api.github.com/users/ehiggs/following{/other_user}","gists_url":"https://api.github.com/users/ehiggs/gists{/gist_id}","starred_url":"https://api.github.com/users/ehiggs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ehiggs/subscriptions","organizations_url":"https://api.github.com/users/ehiggs/orgs","repos_url":"https://api.github.com/users/ehiggs/repos","events_url":"https://api.github.com/users/ehiggs/events{/privacy}","received_events_url":"https://api.github.com/users/ehiggs/received_events","type":"User","site_admin":false},"repo":{"id":17957270,"name":"hanythingondemand","full_name":"ehiggs/hanythingondemand","owner":{"login":"ehiggs","id":28823,"avatar_url":"https://avatars.githubusercontent.com/u/28823?v=3","gravatar_id":"","url":"https://api.github.com/users/ehiggs","html_url":"https://github.com/ehiggs","followers_url":"https://api.github.com/users/ehiggs/followers","following_url":"https://api.github.com/users/ehiggs/following{/other_user}","gists_url":"https://api.github.com/users/ehiggs/gists{/gist_id}","starred_url":"https://api.github.com/users/ehiggs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ehiggs/subscriptions","organizations_url":"https://api.github.com/users/ehiggs/orgs","repos_url":"https://api.github.com/users/ehiggs/repos","events_url":"https://api.github.com/users/ehiggs/events{/privacy}","received_events_url":"https://api.github.com/users/ehiggs/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/ehiggs/hanythingondemand","description":"hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs ","fork":true,"url":"https://api.github.com/repos/ehiggs/hanythingondemand","forks_url":"https://api.github.com/repos/ehiggs/hanythingondemand/forks","keys_url":"https://api.github.com/repos/ehiggs/hanythingondemand/keys{/key_id}","collaborators_url":"https://api.github.com/repos/ehiggs/hanythingondemand/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/ehiggs/hanythingondemand/teams","hooks_url":"https://api.github.com/repos/ehiggs/hanythingondemand/hooks","issue_events_url":"https://api.github.com/repos/ehiggs/hanythingondemand/issues/events{/number}","events_url":"https://api.github.com/repos/ehiggs/hanythingondemand/events","assignees_url":"https://api.github.com/repos/ehiggs/hanythingondemand/assignees{/user}","branches_url":"https://api.github.com/repos/ehiggs/hanythingondemand/branches{/branch}","tags_url":"https://api.github.com/repos/ehiggs/hanythingondemand/tags","blobs_url":"https://api.github.com/repos/ehiggs/hanythingondemand/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/ehiggs/hanythingondemand/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/ehiggs/hanythingondemand/git/refs{/sha}","trees_url":"https://api.github.com/repos/ehiggs/hanythingondemand/git/trees{/sha}","statuses_url":"https://api.github.com/repos/ehiggs/hanythingondemand/statuses/{sha}","languages_url":"https://api.github.com/repos/ehiggs/hanythingondemand/languages","stargazers_url":"https://api.github.com/repos/ehiggs/hanythingondemand/stargazers","contributors_url":"https://api.github.com/repos/ehiggs/hanythingondemand/contributors","subscribers_url":"https://api.github.com/repos/ehiggs/hanythingondemand/subscribers","subscription_url":"https://api.github.com/repos/ehiggs/hanythingondemand/subscription","commits_url":"https://api.github.com/repos/ehiggs/hanythingondemand/commits{/sha}","git_commits_url":"https://api.github.com/repos/ehiggs/hanythingondemand/git/commits{/sha}","comments_url":"https://api.github.com/repos/ehiggs/hanythingondemand/comments{/number}","issue_comment_url":"https://api.github.com/repos/ehiggs/hanythingondemand/issues/comments{/number}","contents_url":"https://api.github.com/repos/ehiggs/hanythingondemand/contents/{+path}","compare_url":"https://api.github.com/repos/ehiggs/hanythingondemand/compare/{base}...{head}","merges_url":"https://api.github.com/repos/ehiggs/hanythingondemand/merges","archive_url":"https://api.github.com/repos/ehiggs/hanythingondemand/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/ehiggs/hanythingondemand/downloads","issues_url":"https://api.github.com/repos/ehiggs/hanythingondemand/issues{/number}","pulls_url":"https://api.github.com/repos/ehiggs/hanythingondemand/pulls{/number}","milestones_url":"https://api.github.com/repos/ehiggs/hanythingondemand/milestones{/number}","notifications_url":"https://api.github.com/repos/ehiggs/hanythingondemand/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/ehiggs/hanythingondemand/labels{/name}","releases_url":"https://api.github.com/repos/ehiggs/hanythingondemand/releases{/id}","created_at":"2014-03-20T20:22:21Z","updated_at":"2015-05-06T14:36:28Z","pushed_at":"2015-06-15T09:59:30Z","git_url":"git://github.com/ehiggs/hanythingondemand.git","ssh_url":"git@github.com:ehiggs/hanythingondemand.git","clone_url":"https://github.com/ehiggs/hanythingondemand.git","svn_url":"https://github.com/ehiggs/hanythingondemand","homepage":null,"size":966,"stargazers_count":0,"watchers_count":0,"language":"Python","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"hpcugent:master","ref":"master","sha":"e444ca48d919b122214dd26492b4434b73c5e32b","user":{"login":"hpcugent","id":1515263,"avatar_url":"https://avatars.githubusercontent.com/u/1515263?v=3","gravatar_id":"","url":"https://api.github.com/users/hpcugent","html_url":"https://github.com/hpcugent","followers_url":"https://api.github.com/users/hpcugent/followers","following_url":"https://api.github.com/users/hpcugent/following{/other_user}","gists_url":"https://api.github.com/users/hpcugent/gists{/gist_id}","starred_url":"https://api.github.com/users/hpcugent/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hpcugent/subscriptions","organizations_url":"https://api.github.com/users/hpcugent/orgs","repos_url":"https://api.github.com/users/hpcugent/repos","events_url":"https://api.github.com/users/hpcugent/events{/privacy}","received_events_url":"https://api.github.com/users/hpcugent/received_events","type":"Organization","site_admin":false},"repo":{"id":17631938,"name":"hanythingondemand","full_name":"hpcugent/hanythingondemand","owner":{"login":"hpcugent","id":1515263,"avatar_url":"https://avatars.githubusercontent.com/u/1515263?v=3","gravatar_id":"","url":"https://api.github.com/users/hpcugent","html_url":"https://github.com/hpcugent","followers_url":"https://api.github.com/users/hpcugent/followers","following_url":"https://api.github.com/users/hpcugent/following{/other_user}","gists_url":"https://api.github.com/users/hpcugent/gists{/gist_id}","starred_url":"https://api.github.com/users/hpcugent/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hpcugent/subscriptions","organizations_url":"https://api.github.com/users/hpcugent/orgs","repos_url":"https://api.github.com/users/hpcugent/repos","events_url":"https://api.github.com/users/hpcugent/events{/privacy}","received_events_url":"https://api.github.com/users/hpcugent/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/hpcugent/hanythingondemand","description":"hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs ","fork":false,"url":"https://api.github.com/repos/hpcugent/hanythingondemand","forks_url":"https://api.github.com/repos/hpcugent/hanythingondemand/forks","keys_url":"https://api.github.com/repos/hpcugent/hanythingondemand/keys{/key_id}","collaborators_url":"https://api.github.com/repos/hpcugent/hanythingondemand/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/hpcugent/hanythingondemand/teams","hooks_url":"https://api.github.com/repos/hpcugent/hanythingondemand/hooks","issue_events_url":"https://api.github.com/repos/hpcugent/hanythingondemand/issues/events{/number}","events_url":"https://api.github.com/repos/hpcugent/hanythingondemand/events","assignees_url":"https://api.github.com/repos/hpcugent/hanythingondemand/assignees{/user}","branches_url":"https://api.github.com/repos/hpcugent/hanythingondemand/branches{/branch}","tags_url":"https://api.github.com/repos/hpcugent/hanythingondemand/tags","blobs_url":"https://api.github.com/repos/hpcugent/hanythingondemand/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/hpcugent/hanythingondemand/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/hpcugent/hanythingondemand/git/refs{/sha}","trees_url":"https://api.github.com/repos/hpcugent/hanythingondemand/git/trees{/sha}","statuses_url":"https://api.github.com/repos/hpcugent/hanythingondemand/statuses/{sha}","languages_url":"https://api.github.com/repos/hpcugent/hanythingondemand/languages","stargazers_url":"https://api.github.com/repos/hpcugent/hanythingondemand/stargazers","contributors_url":"https://api.github.com/repos/hpcugent/hanythingondemand/contributors","subscribers_url":"https://api.github.com/repos/hpcugent/hanythingondemand/subscribers","subscription_url":"https://api.github.com/repos/hpcugent/hanythingondemand/subscription","commits_url":"https://api.github.com/repos/hpcugent/hanythingondemand/commits{/sha}","git_commits_url":"https://api.github.com/repos/hpcugent/hanythingondemand/git/commits{/sha}","comments_url":"https://api.github.com/repos/hpcugent/hanythingondemand/comments{/number}","issue_comment_url":"https://api.github.com/repos/hpcugent/hanythingondemand/issues/comments{/number}","contents_url":"https://api.github.com/repos/hpcugent/hanythingondemand/contents/{+path}","compare_url":"https://api.github.com/repos/hpcugent/hanythingondemand/compare/{base}...{head}","merges_url":"https://api.github.com/repos/hpcugent/hanythingondemand/merges","archive_url":"https://api.github.com/repos/hpcugent/hanythingondemand/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/hpcugent/hanythingondemand/downloads","issues_url":"https://api.github.com/repos/hpcugent/hanythingondemand/issues{/number}","pulls_url":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls{/number}","milestones_url":"https://api.github.com/repos/hpcugent/hanythingondemand/milestones{/number}","notifications_url":"https://api.github.com/repos/hpcugent/hanythingondemand/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/hpcugent/hanythingondemand/labels{/name}","releases_url":"https://api.github.com/repos/hpcugent/hanythingondemand/releases{/id}","created_at":"2014-03-11T13:48:31Z","updated_at":"2015-05-06T14:38:30Z","pushed_at":"2015-06-15T10:00:47Z","git_url":"git://github.com/hpcugent/hanythingondemand.git","ssh_url":"git@github.com:hpcugent/hanythingondemand.git","clone_url":"https://github.com/hpcugent/hanythingondemand.git","svn_url":"https://github.com/hpcugent/hanythingondemand","homepage":null,"size":1061,"stargazers_count":1,"watchers_count":1,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":3,"mirror_url":null,"open_issues_count":13,"forks":3,"open_issues":13,"watchers":1,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28"},"html":{"href":"https://github.com/hpcugent/hanythingondemand/pull/28"},"issue":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/issues/28"},"comments":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/issues/28/comments"},"review_comments":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28/comments"},"review_comment":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/pulls/28/commits"},"statuses":{"href":"https://api.github.com/repos/hpcugent/hanythingondemand/statuses/de90f0d7eb91507ee969c9ff3d8df70d097df612"}}}}