{"action":"created","issue":{"url":"https://api.github.com/repos/h5py/h5py/issues/648","labels_url":"https://api.github.com/repos/h5py/h5py/issues/648/labels{/name}","comments_url":"https://api.github.com/repos/h5py/h5py/issues/648/comments","events_url":"https://api.github.com/repos/h5py/h5py/issues/648/events","html_url":"https://github.com/h5py/h5py/pull/648","id":117436002,"number":648,"title":"Added MPI collective I/O support","user":{"login":"valiantljk","id":1396867,"avatar_url":"https://avatars.githubusercontent.com/u/1396867?v=3","gravatar_id":"","url":"https://api.github.com/users/valiantljk","html_url":"https://github.com/valiantljk","followers_url":"https://api.github.com/users/valiantljk/followers","following_url":"https://api.github.com/users/valiantljk/following{/other_user}","gists_url":"https://api.github.com/users/valiantljk/gists{/gist_id}","starred_url":"https://api.github.com/users/valiantljk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/valiantljk/subscriptions","organizations_url":"https://api.github.com/users/valiantljk/orgs","repos_url":"https://api.github.com/users/valiantljk/repos","events_url":"https://api.github.com/users/valiantljk/events{/privacy}","received_events_url":"https://api.github.com/users/valiantljk/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-11-17T19:53:21Z","updated_at":"2015-12-02T21:02:09Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/h5py/h5py/pulls/648","html_url":"https://github.com/h5py/h5py/pull/648","diff_url":"https://github.com/h5py/h5py/pull/648.diff","patch_url":"https://github.com/h5py/h5py/pull/648.patch"},"body":"Added collective I/O in h5py2.5.0. The changes basically followed Andrew's previous branch 'h5py-mpi_collective_24', which were developed in 2013-2014, and updated in May 2015, but then not maintained, nor merged to h5py master. \r\nThe changes modified the related files to provide the collective io property, and fixed the function name errors and also conducted tests with 3200 processes.\r\nTo use the collective I/O: \r\n```\r\nwith dset.collective:\r\n                dset[start:end,:] = temp\r\n```\r\nA test code is available in examples/collective_io.py, \r\n\r\nA sample test result on [Cori](http://www.nersc.gov/users/computational-systems/cori/):\r\n* Data size x: 6553600 y: 1024\r\n* File size: ~50 GB\r\n* Number of processes: 3200\r\n* Independent write time: 10.32 s\r\n* Collective write time: 4.49 s\r\n"},"comment":{"url":"https://api.github.com/repos/h5py/h5py/issues/comments/161432944","html_url":"https://github.com/h5py/h5py/pull/648#issuecomment-161432944","issue_url":"https://api.github.com/repos/h5py/h5py/issues/648","id":161432944,"user":{"login":"jakirkham","id":3019665,"avatar_url":"https://avatars.githubusercontent.com/u/3019665?v=3","gravatar_id":"","url":"https://api.github.com/users/jakirkham","html_url":"https://github.com/jakirkham","followers_url":"https://api.github.com/users/jakirkham/followers","following_url":"https://api.github.com/users/jakirkham/following{/other_user}","gists_url":"https://api.github.com/users/jakirkham/gists{/gist_id}","starred_url":"https://api.github.com/users/jakirkham/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jakirkham/subscriptions","organizations_url":"https://api.github.com/users/jakirkham/orgs","repos_url":"https://api.github.com/users/jakirkham/repos","events_url":"https://api.github.com/users/jakirkham/events{/privacy}","received_events_url":"https://api.github.com/users/jakirkham/received_events","type":"User","site_admin":false},"created_at":"2015-12-02T21:02:09Z","updated_at":"2015-12-02T21:02:09Z","body":"@valiantljk @andrewcollette \r\n\r\nThe pylint noise appears to be caused by some changes in pylint 1.5.x and astroid 1.4.x. This happens on master too. See issue here ( https://github.com/h5py/h5py/issues/655 ).\r\n\r\nI propose that these pinned at present as I am doing in this PR ( https://github.com/h5py/h5py/pull/656 )."}}