{"action":"opened","issue":{"url":"https://api.github.com/repos/matz-e/lobster/issues/140","labels_url":"https://api.github.com/repos/matz-e/lobster/issues/140/labels{/name}","comments_url":"https://api.github.com/repos/matz-e/lobster/issues/140/comments","events_url":"https://api.github.com/repos/matz-e/lobster/issues/140/events","html_url":"https://github.com/matz-e/lobster/issues/140","id":94607095,"number":140,"title":"StorageElement.test() is broken","user":{"login":"annawoodard","id":5114833,"avatar_url":"https://avatars.githubusercontent.com/u/5114833?v=3","gravatar_id":"","url":"https://api.github.com/users/annawoodard","html_url":"https://github.com/annawoodard","followers_url":"https://api.github.com/users/annawoodard/followers","following_url":"https://api.github.com/users/annawoodard/following{/other_user}","gists_url":"https://api.github.com/users/annawoodard/gists{/gist_id}","starred_url":"https://api.github.com/users/annawoodard/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/annawoodard/subscriptions","organizations_url":"https://api.github.com/users/annawoodard/orgs","repos_url":"https://api.github.com/users/annawoodard/repos","events_url":"https://api.github.com/users/annawoodard/events{/privacy}","received_events_url":"https://api.github.com/users/annawoodard/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-07-12T22:51:35Z","updated_at":"2015-07-12T22:51:35Z","closed_at":null,"body":"[Testing](https://github.com/matz-e/lobster/blob/master/lobster/se.py#L78) the storage element is currently broken unless the stageout directory already exists because we call it [before](https://github.com/matz-e/lobster/blob/se-tweaks/lobster/job.py#L52) creating it. This is sort of a chicken-and-egg problem, since we are using the fs module to create the output directory itself. \r\n\r\nIt is also broken for Chirp stageout, consider this configuration:\r\n```\r\nstorage:\r\n    local: /hadoop/store/user/awoodard/LHE_v14/2d/a/AOD_v1\r\n    input: chirp://earth.crc.nd.edu:9026//\r\n    output: chirp://earth.crc.nd.edu:9026/2d/a/AOD_v1\r\n    base: /hadoop/store/user/awoodard/LHE_v14\r\n\r\ntasks:\r\n    - {label: 'ttH', files: '/hadoop/store/user/awoodard/LHE_v14/2d/a/*ttH*/*lhe*'}\r\n```\r\n\r\nfor which the function calls:\r\n```\r\nchirp earth.crc.nd.edu:9026 ls -la chirp://earth.crc.nd.edu:9026/2d/a/AOD_v1\r\n```"}}