{"action":"created","issue":{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/issues/77","labels_url":"https://api.github.com/repos/slipstream/SlipStreamClient/issues/77/labels{/name}","comments_url":"https://api.github.com/repos/slipstream/SlipStreamClient/issues/77/comments","events_url":"https://api.github.com/repos/slipstream/SlipStreamClient/issues/77/events","html_url":"https://github.com/slipstream/SlipStreamClient/issues/77","id":60518601,"number":77,"title":"'maximum recursion depth exceeded' on mutable run in MachineExecutor._execute()","user":{"login":"konstan","id":353767,"avatar_url":"https://avatars.githubusercontent.com/u/353767?v=3","gravatar_id":"","url":"https://api.github.com/users/konstan","html_url":"https://github.com/konstan","followers_url":"https://api.github.com/users/konstan/followers","following_url":"https://api.github.com/users/konstan/following{/other_user}","gists_url":"https://api.github.com/users/konstan/gists{/gist_id}","starred_url":"https://api.github.com/users/konstan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/konstan/subscriptions","organizations_url":"https://api.github.com/users/konstan/orgs","repos_url":"https://api.github.com/users/konstan/repos","events_url":"https://api.github.com/users/konstan/events{/privacy}","received_events_url":"https://api.github.com/users/konstan/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/labels/!!!","name":"!!!","color":"e11d21"},{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/labels/2","name":"2","color":"444444"},{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/labels/S00%20Backlog","name":"S00 Backlog","color":"eeeeee"},{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/labels/T5%20Bug","name":"T5 Bug","color":"fc2929"},{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/labels/%E2%98%85%E2%98%85%E2%98%85","name":"★★★","color":"fbca04"}],"state":"open","locked":false,"assignee":{"login":"konstan","id":353767,"avatar_url":"https://avatars.githubusercontent.com/u/353767?v=3","gravatar_id":"","url":"https://api.github.com/users/konstan","html_url":"https://github.com/konstan","followers_url":"https://api.github.com/users/konstan/followers","following_url":"https://api.github.com/users/konstan/following{/other_user}","gists_url":"https://api.github.com/users/konstan/gists{/gist_id}","starred_url":"https://api.github.com/users/konstan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/konstan/subscriptions","organizations_url":"https://api.github.com/users/konstan/orgs","repos_url":"https://api.github.com/users/konstan/repos","events_url":"https://api.github.com/users/konstan/events{/privacy}","received_events_url":"https://api.github.com/users/konstan/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/milestones/3","html_url":"https://github.com/slipstream/SlipStreamClient/milestones/v2.6.0","labels_url":"https://api.github.com/repos/slipstream/SlipStreamClient/milestones/3/labels","id":1001803,"number":3,"title":"v2.6.0","description":"Milestone for sprint with target version 2.6.0 (weeks 12 and 13)","creator":{"login":"rbf","id":807084,"avatar_url":"https://avatars.githubusercontent.com/u/807084?v=3","gravatar_id":"","url":"https://api.github.com/users/rbf","html_url":"https://github.com/rbf","followers_url":"https://api.github.com/users/rbf/followers","following_url":"https://api.github.com/users/rbf/following{/other_user}","gists_url":"https://api.github.com/users/rbf/gists{/gist_id}","starred_url":"https://api.github.com/users/rbf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rbf/subscriptions","organizations_url":"https://api.github.com/users/rbf/orgs","repos_url":"https://api.github.com/users/rbf/repos","events_url":"https://api.github.com/users/rbf/events{/privacy}","received_events_url":"https://api.github.com/users/rbf/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":0,"state":"open","created_at":"2015-03-02T13:15:46Z","updated_at":"2015-03-10T15:33:35Z","due_on":"2015-03-27T12:00:00Z","closed_at":null},"comments":2,"created_at":"2015-03-10T15:33:35Z","updated_at":"2015-03-10T15:35:35Z","closed_at":null,"body":"After running for a week in the mutual deployment NodeExecutors failed with `Error executing node, with detail: maximum recursion depth exceeded`.\r\n\r\nHere is the number of the state transitions \r\n```\r\n$ grep \"^==== \" wnrun.1.slipstream.log | sort | uniq -c | awk 'BEGIN {c=0} {c+=$1; print $0} END {print \"total:\", c}'\r\n 239 ==== Executing ====\r\n 240 ==== Provisioning ====\r\n 239 ==== Ready ====\r\n 239 ==== Sending report ====\r\ntotal: 957\r\n$ \r\n```\r\n\r\nExcerpt from the log with the stacktrace\r\n\r\n```\r\n: 2015-03-03T11:19:06Z :\r\n===============\r\n==== Ready ====\r\n===============\r\n\r\n: 2015-03-03T14:21:25Z :\r\n======================\r\n==== Provisioning ====\r\n======================\r\n...\r\n\r\n: 2015-03-10T15:10:01Z : \r\nERROR: Error executing node, with detail: maximum recursion depth exceeded\r\nTraceback (most recent call last):\r\n  File \"/opt/slipstream/client/lib/slipstream/executors/MachineExecutor.py\", line 58, in _execute\r\n    getattr(self, 'on' + state)()\r\n  File \"/opt/slipstream/client/lib/slipstream/util.py\", line 653, in overrided_func\r\n    return func(self, *args, **kwargs)\r\n  File \"/opt/slipstream/client/lib/slipstream/executors/node/NodeDeploymentExecutor.py\", line 62, in onProvisioning\r\n    if self.wrapper.is_scale_state_creating():\r\n  File \"/opt/slipstream/client/lib/slipstream/wrappers/BaseWrapper.py\", line 204, in is_scale_state_creating\r\n    return self.SCALE_STATE_CREATING == self.get_scale_state()\r\n  File \"/opt/slipstream/client/lib/slipstream/wrappers/BaseWrapper.py\", line 225, in get_scale_state\r\n    return self._get_runtime_parameter(key)\r\n  File \"/opt/slipstream/client/lib/slipstream/wrappers/BaseWrapper.py\", line 185, in _get_runtime_parameter\r\n    return self._ss_client.getRuntimeParameter(key, ignoreAbort=ignore_abort)\r\n  File \"/opt/slipstream/client/lib/slipstream/SlipStreamHttpClient.py\", line 219, in getRuntimeParameter\r\n    _, content = self._httpGet(url, accept='text/plain')\r\n  File \"/opt/slipstream/client/lib/slipstream/SlipStreamHttpClient.py\", line 244, in _httpGet\r\n    return self.httpClient.get(url, accept, retry_number=self.http_max_retries)\r\n  File \"/opt/slipstream/client/lib/slipstream/HttpClient.py\", line 55, in get\r\n    return self._call(url, 'GET', accept=accept, retry_number=retry_number)\r\n  File \"/opt/slipstream/client/lib/slipstream/HttpClient.py\", line 199, in _call\r\n    resp, content = _request(_buildHeaders())\r\n  File \"/opt/slipstream/client/lib/slipstream/HttpClient.py\", line 160, in _request\r\n    resp, content = h.request(url, method, body, headers=headers)\r\n  File \"/opt/slipstream/client/lib/httplib2/__init__.py\", line 1557, in request\r\n    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)\r\n  File \"/opt/slipstream/client/lib/httplib2/__init__.py\", line 1363, in _request\r\n    _updateCache(headers, response, content, self.cache, cachekey)\r\n  File \"/opt/slipstream/client/lib/httplib2/__init__.py\", line 444, in _updateCache\r\n    header_str = info.as_string()\r\n  File \"/usr/lib64/python2.6/email/message.py\", line 135, in as_string\r\n    g.flatten(self, unixfrom=unixfrom)\r\n  File \"/usr/lib64/python2.6/email/generator.py\", line 83, in flatten\r\n    self._write(msg)\r\n  File \"/usr/lib64/python2.6/email/generator.py\", line 115, in _write\r\n    self._write_headers(msg)\r\n  File \"/usr/lib64/python2.6/email/generator.py\", line 161, in _write_headers\r\n    header_name=h, continuation_ws='\\t').encode()\r\n  File \"/usr/lib64/python2.6/email/header.py\", line 176, in __init__\r\n    self.append(s, charset, errors)\r\n  File \"/usr/lib64/python2.6/email/header.py\", line 252, in append\r\n    if charset != '8bit':\r\n  File \"/usr/lib64/python2.6/email/charset.py\", line 241, in __ne__\r\n    return not self.__eq__(other)\r\n  File \"/usr/lib64/python2.6/email/charset.py\", line 238, in __eq__\r\n    return str(self) == str(other).lower()\r\nRuntimeError: maximum recursion depth exceeded\r\n```"},"comment":{"url":"https://api.github.com/repos/slipstream/SlipStreamClient/issues/comments/78079432","html_url":"https://github.com/slipstream/SlipStreamClient/issues/77#issuecomment-78079432","issue_url":"https://api.github.com/repos/slipstream/SlipStreamClient/issues/77","id":78079432,"user":{"login":"konstan","id":353767,"avatar_url":"https://avatars.githubusercontent.com/u/353767?v=3","gravatar_id":"","url":"https://api.github.com/users/konstan","html_url":"https://github.com/konstan","followers_url":"https://api.github.com/users/konstan/followers","following_url":"https://api.github.com/users/konstan/following{/other_user}","gists_url":"https://api.github.com/users/konstan/gists{/gist_id}","starred_url":"https://api.github.com/users/konstan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/konstan/subscriptions","organizations_url":"https://api.github.com/users/konstan/orgs","repos_url":"https://api.github.com/users/konstan/repos","events_url":"https://api.github.com/users/konstan/events{/privacy}","received_events_url":"https://api.github.com/users/konstan/received_events","type":"User","site_admin":false},"created_at":"2015-03-10T15:35:35Z","updated_at":"2015-03-10T15:35:35Z","body":"Indeed."}}