{"action":"created","issue":{"url":"https://api.github.com/repos/open-mpi/ompi/issues/1043","labels_url":"https://api.github.com/repos/open-mpi/ompi/issues/1043/labels{/name}","comments_url":"https://api.github.com/repos/open-mpi/ompi/issues/1043/comments","events_url":"https://api.github.com/repos/open-mpi/ompi/issues/1043/events","html_url":"https://github.com/open-mpi/ompi/issues/1043","id":112432546,"number":1043,"title":"ibm/dynamic/spawn does not work with openib in 2.x and master","user":{"login":"rolfv","id":4553668,"avatar_url":"https://avatars.githubusercontent.com/u/4553668?v=3","gravatar_id":"","url":"https://api.github.com/users/rolfv","html_url":"https://github.com/rolfv","followers_url":"https://api.github.com/users/rolfv/followers","following_url":"https://api.github.com/users/rolfv/following{/other_user}","gists_url":"https://api.github.com/users/rolfv/gists{/gist_id}","starred_url":"https://api.github.com/users/rolfv/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rolfv/subscriptions","organizations_url":"https://api.github.com/users/rolfv/orgs","repos_url":"https://api.github.com/users/rolfv/repos","events_url":"https://api.github.com/users/rolfv/events{/privacy}","received_events_url":"https://api.github.com/users/rolfv/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/open-mpi/ompi/labels/blocker","name":"blocker","color":"e11d21"},{"url":"https://api.github.com/repos/open-mpi/ompi/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":{"login":"hjelmn","id":1226817,"avatar_url":"https://avatars.githubusercontent.com/u/1226817?v=3","gravatar_id":"","url":"https://api.github.com/users/hjelmn","html_url":"https://github.com/hjelmn","followers_url":"https://api.github.com/users/hjelmn/followers","following_url":"https://api.github.com/users/hjelmn/following{/other_user}","gists_url":"https://api.github.com/users/hjelmn/gists{/gist_id}","starred_url":"https://api.github.com/users/hjelmn/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hjelmn/subscriptions","organizations_url":"https://api.github.com/users/hjelmn/orgs","repos_url":"https://api.github.com/users/hjelmn/repos","events_url":"https://api.github.com/users/hjelmn/events{/privacy}","received_events_url":"https://api.github.com/users/hjelmn/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/open-mpi/ompi/milestones/4","html_url":"https://github.com/open-mpi/ompi/milestones/Open%20MPI%20v2.0.0","labels_url":"https://api.github.com/repos/open-mpi/ompi/milestones/4/labels","id":810131,"number":4,"title":"Open MPI v2.0.0","description":"","creator":{"login":"ompiteam","id":2165735,"avatar_url":"https://avatars.githubusercontent.com/u/2165735?v=3","gravatar_id":"","url":"https://api.github.com/users/ompiteam","html_url":"https://github.com/ompiteam","followers_url":"https://api.github.com/users/ompiteam/followers","following_url":"https://api.github.com/users/ompiteam/following{/other_user}","gists_url":"https://api.github.com/users/ompiteam/gists{/gist_id}","starred_url":"https://api.github.com/users/ompiteam/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ompiteam/subscriptions","organizations_url":"https://api.github.com/users/ompiteam/orgs","repos_url":"https://api.github.com/users/ompiteam/repos","events_url":"https://api.github.com/users/ompiteam/events{/privacy}","received_events_url":"https://api.github.com/users/ompiteam/received_events","type":"User","site_admin":false},"open_issues":27,"closed_issues":153,"state":"open","created_at":"2014-10-01T15:58:55Z","updated_at":"2015-11-02T18:27:40Z","due_on":null,"closed_at":null},"comments":6,"created_at":"2015-10-20T18:39:37Z","updated_at":"2015-11-02T18:31:16Z","closed_at":null,"body":"It seems that openib is the key to things not working with spawn. I see them same errors with intercomm_create and spawn_multiple. I see this on 2.x and master but not 1.10. A few examples:\r\n```\r\n[rvandevaart@drossetti-ivy4 dynamic]$ mpirun -np 2 --mca btl self,sm,openib spawn\r\n--------------------------------------------------------------------------\r\nmpirun noticed that process rank 0 with PID 0 on node drossetti-ivy4 exited on signal 11 (Segmentation fault).\r\n--------------------------------------------------------------------------\r\n[rvandevaart@drossetti-ivy4 dynamic]$ \r\n```\r\n```\r\n(gdb) where\r\n#0  0x00007f290c81a1d0 in ?? ()\r\n#1  <signal handler called>\r\n#2  0x00007f29130fe910 in opal_memory_ptmalloc2_free (mem=0x7f2913f4ca08)\r\n    at ../../../../../opal/mca/memory/linux/malloc.c:3502\r\n#3  0x00007f29130fd679 in opal_memory_linux_free_hook (__ptr=0x7f2913f4ca08, caller=0x7f2913c341bc)\r\n    at ../../../../../opal/mca/memory/linux/hooks.c:708\r\n#4  0x00007f2913c341bc in ompi_proc_destruct (proc=0x1cfe0f0) at ../../ompi/proc/proc.c:85\r\n#5  0x00007f2913c33a65 in opal_obj_run_destructors (object=0x1cfe0f0) at ../../opal/class/opal_object.h:455\r\n#6  0x00007f2913c35571 in ompi_proc_finalize () at ../../ompi/proc/proc.c:391\r\n#7  0x00007f2913c3b0cc in ompi_mpi_finalize () at ../../ompi/runtime/ompi_mpi_finalize.c:429\r\n#8  0x00007f2913c64195 in PMPI_Finalize () at pfinalize.c:44\r\n#9  0x000000000040157b in main (argc=1, argv=0x7fffcbb5ab88) at spawn.c:57\r\n(gdb) \r\n```\r\nWorks with TCP\r\n```\r\n[rvandevaart@drossetti-ivy4 dynamic]$ mpirun -np 2 -mca btl self,sm,tcp spawn\r\n[rvandevaart@drossetti-ivy4 dynamic]$ echo $?\r\n0\r\n[rvandevaart@drossetti-ivy4 dynamic]$ mpirun -np 4 -mca btl self,sm,tcp spawn\r\n[rvandevaart@drossetti-ivy4 dynamic]$ echo $?\r\n0\r\n[rvandevaart@drossetti-ivy4 dynamic]$ \r\n```\r\n\r\nAnd different when we go to np=4.\r\n```\r\nrvandevaart@drossetti-ivy4 dynamic]$ mpirun -np 4 -mca btl self,sm,openib spawn\r\n[warn] opal_libevent2022_event_base_loop: reentrant invocation.  Only one event_base_loop can run on each event_base at once.\r\n[warn] opal_libevent2022_event_base_loop: reentrant invocation.  Only one event_base_loop can run on each event_base at once.\r\n[warn] opal_libevent2022_event_base_loop: reentrant invocation.  Only one event_base_loop can run on each event_base at once.\r\n[warn] opal_libevent2022_event_base_loop: reentrant invocation.  Only one event_base_loop can run on each event_base at once.\r\n[warn] opal_libevent2022_event_base_loop: reentrant invocation.  Only one event_base_loop can run on each event_base at once.\r\netc....\r\n```"},"comment":{"url":"https://api.github.com/repos/open-mpi/ompi/issues/comments/153117599","html_url":"https://github.com/open-mpi/ompi/issues/1043#issuecomment-153117599","issue_url":"https://api.github.com/repos/open-mpi/ompi/issues/1043","id":153117599,"user":{"login":"jsquyres","id":617316,"avatar_url":"https://avatars.githubusercontent.com/u/617316?v=3","gravatar_id":"","url":"https://api.github.com/users/jsquyres","html_url":"https://github.com/jsquyres","followers_url":"https://api.github.com/users/jsquyres/followers","following_url":"https://api.github.com/users/jsquyres/following{/other_user}","gists_url":"https://api.github.com/users/jsquyres/gists{/gist_id}","starred_url":"https://api.github.com/users/jsquyres/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jsquyres/subscriptions","organizations_url":"https://api.github.com/users/jsquyres/orgs","repos_url":"https://api.github.com/users/jsquyres/repos","events_url":"https://api.github.com/users/jsquyres/events{/privacy}","received_events_url":"https://api.github.com/users/jsquyres/received_events","type":"User","site_admin":false},"created_at":"2015-11-02T18:31:16Z","updated_at":"2015-11-02T18:31:16Z","body":"Looks like the 2nd problem (the libevent messages) is also reported in #1081.  I.e., the libevent issue is not specific to the openib spawn segv problem."}}