{"action":"created","issue":{"url":"https://api.github.com/repos/lattice/quda/issues/223","labels_url":"https://api.github.com/repos/lattice/quda/issues/223/labels{/name}","comments_url":"https://api.github.com/repos/lattice/quda/issues/223/comments","events_url":"https://api.github.com/repos/lattice/quda/issues/223/events","html_url":"https://github.com/lattice/quda/issues/223","id":68764209,"number":223,"title":"numa_affinity broken ?","user":{"login":"mathiaswagner","id":4508207,"avatar_url":"https://avatars.githubusercontent.com/u/4508207?v=3","gravatar_id":"","url":"https://api.github.com/users/mathiaswagner","html_url":"https://github.com/mathiaswagner","followers_url":"https://api.github.com/users/mathiaswagner/followers","following_url":"https://api.github.com/users/mathiaswagner/following{/other_user}","gists_url":"https://api.github.com/users/mathiaswagner/gists{/gist_id}","starred_url":"https://api.github.com/users/mathiaswagner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mathiaswagner/subscriptions","organizations_url":"https://api.github.com/users/mathiaswagner/orgs","repos_url":"https://api.github.com/users/mathiaswagner/repos","events_url":"https://api.github.com/users/mathiaswagner/events{/privacy}","received_events_url":"https://api.github.com/users/mathiaswagner/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/lattice/quda/labels/bug","name":"bug","color":"e05555"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-04-15T19:07:52Z","updated_at":"2015-04-15T21:33:29Z","closed_at":null,"body":"I noticed getting the message:\r\n\r\n```Failed to determine NUMA affinity for device 0 (possibly not applicable)```\r\n\r\nquite often. When looking in the code it looks for something like\r\n\r\n```\"/proc/driver/nvidia/gpus/%d/information\", my_gpu```\r\n\r\nwith my_gpu being the device id (i.e. an integer).\r\n\r\nI checked on some machines and see\r\n```\r\n[mwagner@gdev1 ~]$ ls /proc/driver/nvidia/gpus/\r\n0000:02:00.0  0000:03:00.0  0000:83:00.0  0000:84:00.0\r\n...\r\n[mwagner@cream ~]$  ls /proc/driver/nvidia/gpus/\r\n0000:02:00.0  0000:03:00.0  0000:83:00.0  0000:84:00.0\r\n```\r\n\r\nIt looks like the directory names have changed from device-ids to Bus-Ids with the newer drivers. I don't know when that happened but we should update the numa_affinity.cpp to reflect this."},"comment":{"url":"https://api.github.com/repos/lattice/quda/issues/comments/93575451","html_url":"https://github.com/lattice/quda/issues/223#issuecomment-93575451","issue_url":"https://api.github.com/repos/lattice/quda/issues/223","id":93575451,"user":{"login":"mathiaswagner","id":4508207,"avatar_url":"https://avatars.githubusercontent.com/u/4508207?v=3","gravatar_id":"","url":"https://api.github.com/users/mathiaswagner","html_url":"https://github.com/mathiaswagner","followers_url":"https://api.github.com/users/mathiaswagner/followers","following_url":"https://api.github.com/users/mathiaswagner/following{/other_user}","gists_url":"https://api.github.com/users/mathiaswagner/gists{/gist_id}","starred_url":"https://api.github.com/users/mathiaswagner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mathiaswagner/subscriptions","organizations_url":"https://api.github.com/users/mathiaswagner/orgs","repos_url":"https://api.github.com/users/mathiaswagner/repos","events_url":"https://api.github.com/users/mathiaswagner/events{/privacy}","received_events_url":"https://api.github.com/users/mathiaswagner/received_events","type":"User","site_admin":false},"created_at":"2015-04-15T21:33:29Z","updated_at":"2015-04-15T21:33:29Z","body":"Can you create a branch with that patch?\n\nOn Apr 15, 2015, at 17:15, Alexei Strelchenko <notifications@github.com<mailto:notifications@github.com>> wrote:\n\n\nAlso, I have noted that the current implementation did not allow true multi-threading within an MPI process (e.g., all openmp threads will be launched on a single core). Don Holmgren wrote a patch to numa_affinity.cpp file to fix the issue, which I tried in my early versions of the eigcg solver. Need to revisit this stuff.\n\n—\nReply to this email directly or view it on GitHub<https://github.com/lattice/quda/issues/223#issuecomment-93571569>.\n"}}