{"action":"created","issue":{"url":"https://api.github.com/repos/ipython/ipython/issues/8459","labels_url":"https://api.github.com/repos/ipython/ipython/issues/8459/labels{/name}","comments_url":"https://api.github.com/repos/ipython/ipython/issues/8459/comments","events_url":"https://api.github.com/repos/ipython/ipython/issues/8459/events","html_url":"https://github.com/ipython/ipython/issues/8459","id":79441176,"number":8459,"title":"ipengine registers only locally?","user":{"login":"dseuss","id":5870291,"avatar_url":"https://avatars.githubusercontent.com/u/5870291?v=3","gravatar_id":"","url":"https://api.github.com/users/dseuss","html_url":"https://github.com/dseuss","followers_url":"https://api.github.com/users/dseuss/followers","following_url":"https://api.github.com/users/dseuss/following{/other_user}","gists_url":"https://api.github.com/users/dseuss/gists{/gist_id}","starred_url":"https://api.github.com/users/dseuss/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dseuss/subscriptions","organizations_url":"https://api.github.com/users/dseuss/orgs","repos_url":"https://api.github.com/users/dseuss/repos","events_url":"https://api.github.com/users/dseuss/events{/privacy}","received_events_url":"https://api.github.com/users/dseuss/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":9,"created_at":"2015-05-22T12:42:37Z","updated_at":"2015-06-03T17:43:58Z","closed_at":null,"body":"I am trying to get the ipcluster to run on multiple machines using MPI. First, I register the controller using \r\n\r\n    > ipcontroller start --profile=mpi --ip='*'\r\n\r\nwhich seems to work, since the hub listens on all interfaces (<code>tcp://*:52662</code>). The profile_mpi does not contain any nonstandard configuration. Also, the correct ip address is written to the <code>ipcontroller-engine.json</code>. However, when I run\r\n\r\n    > ipengine start --profile=mpi --ip='*' --mpi=mpi4py\r\n\r\nfrom inside a script launched with mpiexec, the engine on the same machine as the controller connects fine, but the other ones don't. The log looks like this\r\n\r\n    [IPEngineApp] Registering with controller at tcp://127.0.0.1:54682\r\n    [IPEngineApp] CRITICAL | Registration timed out after 30.0 seconds\r\n\r\n(the increased timeout is the only configuration in the profile)."},"comment":{"url":"https://api.github.com/repos/ipython/ipython/issues/comments/108542958","html_url":"https://github.com/ipython/ipython/issues/8459#issuecomment-108542958","issue_url":"https://api.github.com/repos/ipython/ipython/issues/8459","id":108542958,"user":{"login":"dseuss","id":5870291,"avatar_url":"https://avatars.githubusercontent.com/u/5870291?v=3","gravatar_id":"","url":"https://api.github.com/users/dseuss","html_url":"https://github.com/dseuss","followers_url":"https://api.github.com/users/dseuss/followers","following_url":"https://api.github.com/users/dseuss/following{/other_user}","gists_url":"https://api.github.com/users/dseuss/gists{/gist_id}","starred_url":"https://api.github.com/users/dseuss/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dseuss/subscriptions","organizations_url":"https://api.github.com/users/dseuss/orgs","repos_url":"https://api.github.com/users/dseuss/repos","events_url":"https://api.github.com/users/dseuss/events{/privacy}","received_events_url":"https://api.github.com/users/dseuss/received_events","type":"User","site_admin":false},"created_at":"2015-06-03T17:43:58Z","updated_at":"2015-06-03T17:43:58Z","body":"Sorry for the long delay, but I wasn't in the office last week. Here is the complete output for <code>--ip=public_ip</code> and <code>ip -f inet addr</code>.\r\n\r\n    > ip -f inet addr | grep inet\r\n    # Node that runs ipcluster\r\n    inet 127.0.0.1/8 scope host lo\r\n    inet 10.16.1.142/16 scope global eth0\r\n    inet 10.12.1.142/16 brd 10.12.255.255 scope global ib0\r\n    inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0\r\n\r\n    # Remote node\r\n    inet 127.0.0.1/8 scope host lo\r\n    inet 10.16.1.141/16 scope global eth0\r\n    inet 10.12.1.141/16 brd 10.12.255.255 scope global ib0\r\n    inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0\r\n\r\n    > cat .ipython/profile_mpi/log/ipcontroller-1549.log\r\n    2015-06-03 19:27:54.964 [IPControllerApp] Hub listening on tcp://*:45756 for registration.\r\n    2015-06-03 19:27:54.966 [IPControllerApp] Hub using DB backend: 'NoDB'\r\n    2015-06-03 19:27:55.230 [IPControllerApp] hub::created hub\r\n    2015-06-03 19:27:55.230 [IPControllerApp] writing connection info to xxx.ipython/profile_mpi/security/ipcontroller-client.json\r\n    2015-06-03 19:27:55.232 [IPControllerApp] writing connection info to xxx.ipython/profile_mpi/security/ipcontroller-engine.json\r\n    2015-06-03 19:27:55.233 [IPControllerApp] task::using Python leastload Task scheduler\r\n    2015-06-03 19:27:55.233 [IPControllerApp] Heartmonitor started\r\n    2015-06-03 19:27:55.238 [IPControllerApp] Creating pid file: xxx.ipython/profile_mpi/pid/ipcontroller.pid\r\n    2015-06-03 19:27:55.255 [IPControllerApp] client::client '\\x00\\xe98@\\xa8' requested u'connection_request'\r\n    2015-06-03 19:27:55.255 [IPControllerApp] client::client ['\\x00\\xe98@\\xa8'] connected\r\n    2015-06-03 19:28:35.480 [IPControllerApp] client::client '0de21428-8a22-416b-8492-7e32db6ec40d' requested u'registration_request'\r\n    2015-06-03 19:28:40.236 [IPControllerApp] registration::finished registering engine 0:0de21428-8a22-416b-8492-7e32db6ec40d\r\n    2015-06-03 19:28:40.237 [IPControllerApp] engine::Engine Connected: 0\r\n\r\n    > cat .ipython/profile_mpi/log/ipengine-1587.log\r\n    2015-06-03 19:28:35.467 [IPEngineApp] Initializing MPI:\r\n    2015-06-03 19:28:35.468 [IPEngineApp] from mpi4py import MPI as mpi\r\n    mpi.size = mpi.COMM_WORLD.Get_size()\r\n    mpi.rank = mpi.COMM_WORLD.Get_rank()\r\n\r\n    2015-06-03 19:28:35.469 [IPEngineApp] Loading url_file u'xxx.ipython/profile_mpi/security/ipcontroller-engine.json'\r\n    2015-06-03 19:28:35.478 [IPEngineApp] Registering with controller at tcp://127.0.0.1:45756\r\n    2015-06-03 19:28:35.547 [IPEngineApp] Starting to monitor the heartbeat signal from the hub every 3010 ms.\r\n    2015-06-03 19:28:35.551 [IPEngineApp] Running file in user namespace: xxx.ipython/profile_default/startup/10-magic.ipy\r\n    2015-06-03 19:28:35.870 [IPEngineApp] Running file in user namespace: xxx.ipython/profile_default/startup/20-imports.py\r\n    2015-06-03 19:28:36.395 [IPEngineApp] Completed registration with id 0\r\n\r\n    > cat .ipython/profile_mpi/log/ipengine-1966.log\r\n    2015-06-03 19:28:35.639 [IPEngineApp] Initializing MPI:\r\n    2015-06-03 19:28:35.639 [IPEngineApp] from mpi4py import MPI as mpi\r\n    mpi.size = mpi.COMM_WORLD.Get_size()\r\n    mpi.rank = mpi.COMM_WORLD.Get_rank()\r\n\r\n    2015-06-03 19:28:35.641 [IPEngineApp] Loading url_file u'xxx.ipython/profile_mpi/security/ipcontroller-engine.json'\r\n    2015-06-03 19:28:35.651 [IPEngineApp] Registering with controller at tcp://127.0.0.1:45756\r\n    2015-06-03 19:29:05.682 [IPEngineApp] CRITICAL | Registration timed out after 30.0 seconds\r\n\r\n    > cat .ipython/profile_mpi/security/ipcontroller-engine.json\r\n    {\r\n      \"control\": 46244,\r\n      \"task\": 47408,\r\n      \"hb_ping\": 51534,\r\n      \"mux\": 57636,\r\n      \"pack\": \"json\",\r\n      \"hb_pong\": 52690,\r\n      \"ssh\": \"\",\r\n      \"key\": \"77aeede5-0d4b-4e8e-8660-0b7f78d85d60\",\r\n      \"registration\": 45756,\r\n      \"interface\": \"tcp://*\",\r\n      \"iopub\": 45561,\r\n      \"signature_scheme\": \"hmac-sha256\",\r\n      \"unpack\": \"json\",\r\n      \"location\": \"192.168.122.1\"\r\n    }\r\n\r\nIt's a remotely operated cluster, so I can't tell you more on its connectivity graph, but to me it looks like the ipcluster/ipengines are using the <code>vibr0</code> interface where they should be using the <code>eth0</code> interface."}}