{"action":"created","issue":{"url":"https://api.github.com/repos/Netflix/inviso/issues/3","labels_url":"https://api.github.com/repos/Netflix/inviso/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/Netflix/inviso/issues/3/comments","events_url":"https://api.github.com/repos/Netflix/inviso/issues/3/events","html_url":"https://github.com/Netflix/inviso/issues/3","id":46586068,"number":3,"title":"Error with index_cluster_stats.py ","user":{"login":"taoran34","id":9361046,"avatar_url":"https://avatars.githubusercontent.com/u/9361046?v=3","gravatar_id":"","url":"https://api.github.com/users/taoran34","html_url":"https://github.com/taoran34","followers_url":"https://api.github.com/users/taoran34/followers","following_url":"https://api.github.com/users/taoran34/following{/other_user}","gists_url":"https://api.github.com/users/taoran34/gists{/gist_id}","starred_url":"https://api.github.com/users/taoran34/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/taoran34/subscriptions","organizations_url":"https://api.github.com/users/taoran34/orgs","repos_url":"https://api.github.com/users/taoran34/repos","events_url":"https://api.github.com/users/taoran34/events{/privacy}","received_events_url":"https://api.github.com/users/taoran34/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":14,"created_at":"2014-10-23T03:48:34Z","updated_at":"2015-02-05T21:23:50Z","closed_at":null,"body":"I'm following the instructions for the QuickStart.\r\n\r\nWhen it comes to step 6 with the command \" python index_cluster_stats.py \", it fails with the following. I am confused with the port 9026, it just shows up suddenly, I do not know when it get configured. Should I change the port?\r\n\r\nERROR:inviso.cluster:Error processing: cluster_1\r\nERROR:inviso.cluster:HTTPConnectionPool(host='taoran1', port=9026): Max retries exceeded with url: /ws/v1/cluster/apps?state=RUNNING (Caused by <class 'socket.error'>: [Errno 111] Connection refused)\r\nTraceback (most recent call last):\r\n  File \"index_cluster_stats.py\", line 90, in index_stats\r\n    index_apps(es, cluster, info)\r\n  File \"index_cluster_stats.py\", line 17, in index_apps\r\n    apps = requests.get('http://%s:%s/ws/v1/cluster/apps?state=RUNNING' % (cluster.host, '9026'), headers = {'ACCEPT':'application/json'}).json().get('apps')\r\n  File \"/home/venv/lib/python2.6/site-packages/requests/api.py\", line 55, in get\r\n    return request('get', url, **kwargs)\r\n  File \"/home/venv/lib/python2.6/site-packages/requests/api.py\", line 44, in request\r\n    return session.request(method=method, url=url, **kwargs)\r\n  File \"/home/venv/lib/python2.6/site-packages/requests/sessions.py\", line 456, in request\r\n    resp = self.send(prep, **send_kwargs)\r\n  File \"/home/venv/lib/python2.6/site-packages/requests/sessions.py\", line 559, in send\r\n    r = adapter.send(request, **kwargs)\r\n  File \"/home/venv/lib/python2.6/site-packages/requests/adapters.py\", line 375, in send\r\n    raise ConnectionError(e, request=request)\r\nConnectionError: HTTPConnectionPool(host='taoran1', port=9026): Max retries exceeded with url: /ws/v1/cluster/apps?state=RUNNING (Caused by <class 'socket.error'>: [Errno 111] Connection refused)\r\n\r\n\r\nAlso, when conducted the command \"python jes.py\",  it came up with the followings, I do not know whether it matters for the Error above.\r\n\r\nINFO:inviso-monitor:Publishing event: (cluster_1) job_1413958950234_0008 2014-10-23T02:37:35+00:00\r\nINFO:inviso-handler:Processing 1 events\r\nWARNING:inviso-handler:No trace info available for hdfs://taoran1:9000/tmp/hadoop-yarn/staging/history/done/2014/10/23/000000/job_1413958950234_0008-1414031808636-hadoop-QuasiMonteCarlo-1414031855566-4-1-SUCCEEDED-default-1414031818339.jhist\r\nINFO:inviso-handler:Indexing 1 documents\r\nINFO:inviso-handler:Events complete."},"comment":{"url":"https://api.github.com/repos/Netflix/inviso/issues/comments/73131729","html_url":"https://github.com/Netflix/inviso/issues/3#issuecomment-73131729","issue_url":"https://api.github.com/repos/Netflix/inviso/issues/3","id":73131729,"user":{"login":"danielcweeks","id":4925077,"avatar_url":"https://avatars.githubusercontent.com/u/4925077?v=3","gravatar_id":"","url":"https://api.github.com/users/danielcweeks","html_url":"https://github.com/danielcweeks","followers_url":"https://api.github.com/users/danielcweeks/followers","following_url":"https://api.github.com/users/danielcweeks/following{/other_user}","gists_url":"https://api.github.com/users/danielcweeks/gists{/gist_id}","starred_url":"https://api.github.com/users/danielcweeks/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danielcweeks/subscriptions","organizations_url":"https://api.github.com/users/danielcweeks/orgs","repos_url":"https://api.github.com/users/danielcweeks/repos","events_url":"https://api.github.com/users/danielcweeks/events{/privacy}","received_events_url":"https://api.github.com/users/danielcweeks/received_events","type":"User","site_admin":false},"created_at":"2015-02-05T21:23:50Z","updated_at":"2015-02-05T21:23:50Z","body":"@Slouis61 I just pulled down the HDP 2.2 Sandbox and was able to get it all running with the following mods:\r\n\r\njes.py\r\n\r\n```\r\n--- a/jes/jes.py\r\n+++ b/jes/jes.py\r\n@@ -27,6 +27,7 @@ def main():\r\n                                           cluster_id=cluster.id,\r\n                                           cluster_name=cluster.name,\r\n                                           host=cluster.host,\r\n+                                          port=8020,\r\n                                           publisher=publisher,\r\n                                           elasticsearch=settings.elasticsearch))\r\n\r\n--- a/jes/inviso/monitor.py\r\n+++ b/jes/inviso/monitor.py\r\n@@ -277,7 +277,7 @@ class HdfsMr2LogMonitor(ElasticSearchMonitor):\r\n                  cluster_name,\r\n                  host='localhost',\r\n                  port=9000,\r\n-                 log_path='/tmp/hadoop-yarn/staging/history/done', **kwargs):\r\n+                 log_path='/mr-history/done', **kwargs):\r\n         super(HdfsMr2LogMonitor, self).__init__(**kwargs)\r\n\r\n\r\n--- a/jes/index_cluster_stats.py\r\n+++ b/jes/index_cluster_stats.py\r\n@@ -14,7 +14,7 @@ log = get_logger('inviso.cluster')\r\n es_index = 'inviso-cluster'\r\n\r\n def index_apps(es, cluster, info):\r\n-    apps = requests.get('http://%s:%s/ws/v1/cluster/apps?state=RUNNING' % (cluster.host, '9026'), headers = {'ACCEPT':'application/json'}).jso\r\n+    apps = requests.get('http://%s:%s/ws/v1/cluster/apps?state=RUNNING' % (cluster.host, '8088'), headers = {'ACCEPT':'application/json'}).jso\r\n\r\n     if not apps:\r\n         log.info(cluster.name + ': no applications running.')\r\n@@ -51,7 +51,7 @@ def index_apps(es, cluster, info):\r\n     log.debug(bulk(es, documents, stats_only=True));\r\n\r\n def index_metrics(es, cluster, info):\r\n-    metrics = requests.get('http://%s:%s/ws/v1/cluster/metrics' % (cluster.host, '9026'), headers = {'ACCEPT':'application/json'}).json()['clu\r\n+    metrics = requests.get('http://%s:%s/ws/v1/cluster/metrics' % (cluster.host, '8088'), headers = {'ACCEPT':'application/json'}).json()['clu\r\n     metrics.update(info)\r\n\r\n     r = es.index(index=es_index,\r\n@@ -63,7 +63,7 @@ def index_metrics(es, cluster, info):\r\n     log.debug(r)\r\n\r\n def index_scheduler(es, cluster, info):\r\n-    scheduler = requests.get('http://%s:%s/ws/v1/cluster/scheduler' % (cluster.host, '9026'), headers = {'ACCEPT':'application/json'}).json()[\r\n+    scheduler = requests.get('http://%s:%s/ws/v1/cluster/scheduler' % (cluster.host, '8088'), headers = {'ACCEPT':'application/json'}).json()[\r\n     scheduler.update(info)\r\n```\r\n\r\n"}}