{"action":"opened","issue":{"url":"https://api.github.com/repos/idaholab/moose/issues/5995","labels_url":"https://api.github.com/repos/idaholab/moose/issues/5995/labels{/name}","comments_url":"https://api.github.com/repos/idaholab/moose/issues/5995/comments","events_url":"https://api.github.com/repos/idaholab/moose/issues/5995/events","html_url":"https://github.com/idaholab/moose/issues/5995","id":118136427,"number":5995,"title":"DTK Transfer tests failing in parallel","user":{"login":"permcody","id":3036960,"avatar_url":"https://avatars.githubusercontent.com/u/3036960?v=3","gravatar_id":"","url":"https://api.github.com/users/permcody","html_url":"https://github.com/permcody","followers_url":"https://api.github.com/users/permcody/followers","following_url":"https://api.github.com/users/permcody/following{/other_user}","gists_url":"https://api.github.com/users/permcody/gists{/gist_id}","starred_url":"https://api.github.com/users/permcody/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/permcody/subscriptions","organizations_url":"https://api.github.com/users/permcody/orgs","repos_url":"https://api.github.com/users/permcody/repos","events_url":"https://api.github.com/users/permcody/events{/privacy}","received_events_url":"https://api.github.com/users/permcody/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/idaholab/moose/labels/C:%20MOOSE","name":"C: MOOSE","color":"0052cc"},{"url":"https://api.github.com/repos/idaholab/moose/labels/P:%20normal","name":"P: normal","color":"ededed"},{"url":"https://api.github.com/repos/idaholab/moose/labels/T:%20defect","name":"T: defect","color":"e11d21"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-11-20T22:06:52Z","updated_at":"2015-11-20T22:06:52Z","closed_at":null,"body":"@rppawlo - We started running our DTK tests in parallel and the interpolation transfers are failing (seg fault).  I just fired one of them up and they are way down in the Trilinos code base. The DTK code at the MOOSE level is fairly straight forward so I waited to touch base before we try to dig into this. All of our other Multiapp and Transfer tests pass in parallel including the other DTK tests.\r\n\r\nAnyway, maybe another set of eyes can help out here.\r\n\r\nHere's a stack track from one of our tests run on two processors:\r\nhttps://github.com/permcody/moose/blob/devel/test/tests/transfers/multiapp_dtk_interpolation_transfer/master.i\r\n\r\n```\r\n(lldb) bt\r\n* thread #1: tid = 0xb93566, 0x0000000108ae1446 libmoose-oprof.0.dylib`DataTransferKit::SharedDomainMap<DataTransferKit::MeshContainer<unsigned long>, DataTransferKit::MeshContainer<unsigned long> >::setup(Teuchos::RCP<DataTransferKit::MeshManager<DataTransferKit::MeshContainer<unsigned long> > > const&, Teuchos::RCP<DataTransferKit::FieldManager<DataTransferKit::MeshContainer<unsigned long> > > const&, double) [inlined] Teuchos::ArrayRCP<Teuchos::RCP<DataTransferKit::MeshContainer<unsigned long> > >::size() const at Teuchos_ArrayRCP.hpp:732, queue = 'com.apple.main-thread', stop reason = EXC_BAD_ACCESS (code=1, address=0x20)\r\n  * frame #0: 0x0000000108ae1446 libmoose-oprof.0.dylib`DataTransferKit::SharedDomainMap<DataTransferKit::MeshContainer<unsigned long>, DataTransferKit::MeshContainer<unsigned long> >::setup(Teuchos::RCP<DataTransferKit::MeshManager<DataTransferKit::MeshContainer<unsigned long> > > const&, Teuchos::RCP<DataTransferKit::FieldManager<DataTransferKit::MeshContainer<unsigned long> > > const&, double) [inlined] Teuchos::ArrayRCP<Teuchos::RCP<DataTransferKit::MeshContainer<unsigned long> > >::size() const at Teuchos_ArrayRCP.hpp:732\r\n    frame #1: 0x0000000108ae1446 libmoose-oprof.0.dylib`DataTransferKit::SharedDomainMap<DataTransferKit::MeshContainer<unsigned long>, DataTransferKit::MeshContainer<unsigned long> >::setup(Teuchos::RCP<DataTransferKit::MeshManager<DataTransferKit::MeshContainer<unsigned long> > > const&, Teuchos::RCP<DataTransferKit::FieldManager<DataTransferKit::MeshContainer<unsigned long> > > const&, double) [inlined] DataTransferKit::MeshManager<DataTransferKit::MeshContainer<unsigned long> >::getNumBlocks(this=0x0000000000000000) const at DTK_MeshManager.hpp:111\r\n    frame #2: 0x0000000108ae1446 libmoose-oprof.0.dylib`DataTransferKit::SharedDomainMap<DataTransferKit::MeshContainer<unsigned long>, DataTransferKit::MeshContainer<unsigned long> >::setup(Teuchos::RCP<DataTransferKit::MeshManager<DataTransferKit::MeshContainer<unsigned long> > > const&, Teuchos::RCP<DataTransferKit::FieldManager<DataTransferKit::MeshContainer<unsigned long> > > const&, double) [inlined] DataTransferKit::ClassicMesh<DataTransferKit::MeshContainer<unsigned long> >::getNumBlocks(this=0x00007f99faa00c00) const + 4 at DTK_ClassicMesh.hpp:83\r\n    frame #3: 0x0000000108ae1442 libmoose-oprof.0.dylib`DataTransferKit::SharedDomainMap<DataTransferKit::MeshContainer<unsigned long>, DataTransferKit::MeshContainer<unsigned long> >::setup(this=0x00007f99faa00a20, source_mesh_manager=<unavailable>, target_coord_manager=0x00007fff57906060, tolerance=<unavailable>) + 1650 at DTK_SharedDomainMap_def.hpp:164\r\n    frame #4: 0x0000000108adf652 libmoose-oprof.0.dylib`libMesh::DTKInterpolationHelper::transferWithOffset(this=<unavailable>, from=0, to=0, from_var=0x0000000000000000, to_var=0x00007f99f8db1660, from_offset=0x00007fff57906518, to_offset=<unavailable>, from_mpi_comm=<unavailable>, to_mpi_comm=<unavailable>) + 3842 at DTKInterpolationHelper.C:142\r\n    frame #5: 0x0000000108b4a342 libmoose-oprof.0.dylib`MultiAppDTKInterpolationTransfer::execute(this=0x00007f99f8dab5c0) + 402 at MultiAppDTKInterpolationTransfer.C:74\r\n    frame #6: 0x00000001087864d1 libmoose-oprof.0.dylib`FEProblem::execMultiApps(this=0x00007f99fa01ce00, type=<unavailable>, auto_advance=true) + 1393 at FEProblem.C:2809\r\n    frame #7: 0x00000001088c9edb libmoose-oprof.0.dylib`Transient::solveStep(this=0x00007f99f8dae610, input_dt=<unavailable>) + 187 at Transient.C:378\r\n    frame #8: 0x00000001088c9cfb libmoose-oprof.0.dylib`Transient::takeStep(this=0x00007f99f8dae610, input_dt=-1) + 411 at Transient.C:330\r\n    frame #9: 0x00000001088c99b9 libmoose-oprof.0.dylib`Transient::execute(this=0x00007f99f8dae610) + 89 at Transient.C:250\r\n    frame #10: 0x00000001082fa502 moose_test-oprof`main(argc=<unavailable>, argv=<unavailable>) + 114 at main.C:34\r\n    frame #11: 0x00007fff941445ad libdyld.dylib`start + 1\r\n```"}}