{"action":"created","issue":{"url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/137","labels_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/137/labels{/name}","comments_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/137/comments","events_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/137/events","html_url":"https://github.com/intel-hadoop/HiBench/issues/137","id":110768290,"number":137,"title":"Regular expression issues on yarn-site.xml","user":{"login":"lee212","id":1359020,"avatar_url":"https://avatars.githubusercontent.com/u/1359020?v=3","gravatar_id":"","url":"https://api.github.com/users/lee212","html_url":"https://github.com/lee212","followers_url":"https://api.github.com/users/lee212/followers","following_url":"https://api.github.com/users/lee212/following{/other_user}","gists_url":"https://api.github.com/users/lee212/gists{/gist_id}","starred_url":"https://api.github.com/users/lee212/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lee212/subscriptions","organizations_url":"https://api.github.com/users/lee212/orgs","repos_url":"https://api.github.com/users/lee212/repos","events_url":"https://api.github.com/users/lee212/events{/privacy}","received_events_url":"https://api.github.com/users/lee212/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-10-10T04:48:13Z","updated_at":"2015-10-14T17:23:13Z","closed_at":null,"body":"Hi,\r\n\r\nMy yarn-site.xml looks like:\r\n```\r\n<configuration>\r\n<property>\r\n<name>yarn.resourcemanager.hostname</name>\r\n<value>master</value>\r\n<description>The hostname of the ResourceManager</description>\r\n</property>\r\n<property>\r\n<name>yarn.nodemanager.aux-services</name>\r\n<value>mapreduce_shuffle</value>\r\n<description>shuffle service for MapReduce</description>\r\n</property>\r\n</configuration>\r\n```\r\n\r\nIt is not parsed when I run \"run-all.sh\". the error messages:\r\n\r\n```\r\n# ./run-all.sh\r\nPrepare aggregation ...\r\nExec script: /HiBench/workloads/aggregation/prepare/prepare.sh\r\nParsing conf: /HiBench/conf/00-default-properties.conf\r\nParsing conf: /HiBench/conf/10-data-scale-profile.conf\r\nParsing conf: /HiBench/conf/99-user_defined_properties.conf\r\nParsing conf: /HiBench/workloads/aggregation/conf/00-aggregation-default.conf\r\nParsing conf: /HiBench/workloads/aggregation/conf/10-aggregation-userdefine.conf\r\nTraceback (most recent call last):\r\n  File \"/HiBench/bin/functions/load-config.py\", line 448, in <module>\r\n    load_config(conf_root, workload_root, workload_folder)\r\n  File \"/HiBench/bin/functions/load-config.py\", line 154, in load_config\r\n    generate_optional_value()\r\n  File \"/HiBench/bin/functions/load-config.py\", line 366, in generate_optional_value\r\n    assert 0, \"Get workers from yarn web UI page failed, reason:%s\\nplease set `hibench.masters.hostnames` and `hibench.slaves.hostnames` manually\" % e\r\nAssertionError: Get workers from yarn web UI page failed, reason:Unknown resourcemanager, please check `hibench.hadoop.configure.dir` and \"yarn-site.xml\" file\r\nplease set `hibench.masters.hostnames` and `hibench.slaves.hostnames` manually\r\n/HiBench/bin/functions/workload-functions.sh: line 33: .: filename argument required\r\n.: usage: . filename [arguments]\r\nstart HadoopPrepareAggregation bench\r\n/HiBench/workloads/aggregation/prepare/prepare.sh: line 25: INPUT_HDFS: unbound variable\r\nERROR: aggregation prepare failed!\r\n```\r\n\r\nI looked the ```HiBench/bin/functions/load-config.py``` file and your regular expression for yarn.resourcemanager.hostname (line 359, 360) requires port number along with a hostname like localhost:8032 which mine doesn't have.\r\n\r\nShould I place a port number like yarn.resourcemanager.address? I'm afraid it breaks running YARN if I add a port number. Also, I'd like to run HiBench with ResourceManagers (HA) but I am not sure the yarn-site.xml can be parsed because the configuration has different properties according to https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html"},"comment":{"url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/comments/148124746","html_url":"https://github.com/intel-hadoop/HiBench/issues/137#issuecomment-148124746","issue_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/137","id":148124746,"user":{"login":"GayathriMurali","id":7002441,"avatar_url":"https://avatars.githubusercontent.com/u/7002441?v=3","gravatar_id":"","url":"https://api.github.com/users/GayathriMurali","html_url":"https://github.com/GayathriMurali","followers_url":"https://api.github.com/users/GayathriMurali/followers","following_url":"https://api.github.com/users/GayathriMurali/following{/other_user}","gists_url":"https://api.github.com/users/GayathriMurali/gists{/gist_id}","starred_url":"https://api.github.com/users/GayathriMurali/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/GayathriMurali/subscriptions","organizations_url":"https://api.github.com/users/GayathriMurali/orgs","repos_url":"https://api.github.com/users/GayathriMurali/repos","events_url":"https://api.github.com/users/GayathriMurali/events{/privacy}","received_events_url":"https://api.github.com/users/GayathriMurali/received_events","type":"User","site_admin":false},"created_at":"2015-10-14T17:23:13Z","updated_at":"2015-10-14T17:23:13Z","body":"can you please post your HDFS master and Spark master setting?"}}