{"action":"created","issue":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/5982","labels_url":"https://api.github.com/repos/dmwm/WMCore/issues/5982/labels{/name}","comments_url":"https://api.github.com/repos/dmwm/WMCore/issues/5982/comments","events_url":"https://api.github.com/repos/dmwm/WMCore/issues/5982/events","html_url":"https://github.com/dmwm/WMCore/issues/5982","id":87377918,"number":5982,"title":"taskchain subsequent step job location matching data location","user":{"login":"vlimant","id":4989875,"avatar_url":"https://avatars.githubusercontent.com/u/4989875?v=3","gravatar_id":"","url":"https://api.github.com/users/vlimant","html_url":"https://github.com/vlimant","followers_url":"https://api.github.com/users/vlimant/followers","following_url":"https://api.github.com/users/vlimant/following{/other_user}","gists_url":"https://api.github.com/users/vlimant/gists{/gist_id}","starred_url":"https://api.github.com/users/vlimant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vlimant/subscriptions","organizations_url":"https://api.github.com/users/vlimant/orgs","repos_url":"https://api.github.com/users/vlimant/repos","events_url":"https://api.github.com/users/vlimant/events{/privacy}","received_events_url":"https://api.github.com/users/vlimant/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-06-11T15:06:28Z","updated_at":"2015-06-12T07:59:39Z","closed_at":null,"body":"as discusssed during the workflow team meeting, it coud solve some limitation of using the taskchain if the TaskN(N>=2) could have job created to sites in the white list matching the output of step1 location.\r\nexample: A,B,C in whitelist.\r\nTask1 gets fully done at A, but output is replicated at B and therefore end up at A & B. Task2 would only try to read from A, ignoring that B is a possible job location."},"comment":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/comments/111400699","html_url":"https://github.com/dmwm/WMCore/issues/5982#issuecomment-111400699","issue_url":"https://api.github.com/repos/dmwm/WMCore/issues/5982","id":111400699,"user":{"login":"amaltaro","id":1798520,"avatar_url":"https://avatars.githubusercontent.com/u/1798520?v=3","gravatar_id":"","url":"https://api.github.com/users/amaltaro","html_url":"https://github.com/amaltaro","followers_url":"https://api.github.com/users/amaltaro/followers","following_url":"https://api.github.com/users/amaltaro/following{/other_user}","gists_url":"https://api.github.com/users/amaltaro/gists{/gist_id}","starred_url":"https://api.github.com/users/amaltaro/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amaltaro/subscriptions","organizations_url":"https://api.github.com/users/amaltaro/orgs","repos_url":"https://api.github.com/users/amaltaro/repos","events_url":"https://api.github.com/users/amaltaro/events{/privacy}","received_events_url":"https://api.github.com/users/amaltaro/received_events","type":"User","site_admin":false},"created_at":"2015-06-12T07:59:39Z","updated_at":"2015-06-12T07:59:39Z","body":"Subsequent tasks don't use DBS nor PhEDEx for data location, that's why we currently cannot replicate output from task1 and get this new location in for task2. It uses the information returned from the task1 jobs.\r\n\r\nAt the time we get task1 output replicated to other sites, we most likely would have all the task2 jobs running or pending. That means:\r\n - we would need to query dbs/phedex for all files produced from task1\r\n - locate jobs using file x\r\n - condor_qedit those jobs to add new location.\r\n\r\nIt's a reasonable issue, however, since one can play with a golden site whitelist, it may take some time to get this done."}}