{"action":"created","issue":{"url":"https://api.github.com/repos/blab/nextflu/issues/83","labels_url":"https://api.github.com/repos/blab/nextflu/issues/83/labels{/name}","comments_url":"https://api.github.com/repos/blab/nextflu/issues/83/comments","events_url":"https://api.github.com/repos/blab/nextflu/issues/83/events","html_url":"https://github.com/blab/nextflu/pull/83","id":67481000,"number":83,"title":"S3 integration","user":{"login":"trvrb","id":1176109,"avatar_url":"https://avatars.githubusercontent.com/u/1176109?v=3","gravatar_id":"","url":"https://api.github.com/users/trvrb","html_url":"https://github.com/trvrb","followers_url":"https://api.github.com/users/trvrb/followers","following_url":"https://api.github.com/users/trvrb/following{/other_user}","gists_url":"https://api.github.com/users/trvrb/gists{/gist_id}","starred_url":"https://api.github.com/users/trvrb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/trvrb/subscriptions","organizations_url":"https://api.github.com/users/trvrb/orgs","repos_url":"https://api.github.com/users/trvrb/repos","events_url":"https://api.github.com/users/trvrb/events{/privacy}","received_events_url":"https://api.github.com/users/trvrb/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-04-10T00:46:45Z","updated_at":"2015-04-11T03:48:15Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/blab/nextflu/pulls/83","html_url":"https://github.com/blab/nextflu/pull/83","diff_url":"https://github.com/blab/nextflu/pull/83.diff","patch_url":"https://github.com/blab/nextflu/pull/83.patch"},"body":"This branch modifies `make_all.py` to push and pull from S3. The S3 bucket `nextflu-data` is used to store and sync FASTA files. After the pipeline is run auspice JSONs are pushed to the bucket `nextflu-dev`. At this point, I'm picturing the production pipeline to be:\r\n\r\n1. Download new `gisaid_epiflu_sequence.fasta`.\r\n2. Run `python src/make_all.py --s3`.\r\n3. Check locally or at `dev.nextflu.org` to see that everything was okay.\r\n4. Sync JSONs in `nextflu.org` with JSONs at `dev.nextflu.org` (writing script for this now).\r\n\r\nIn this case, the build script could be running on a server somewhere and we could still easily check output. Every day, the build script is run with a new sequence dump. We look at `dev.nextflu.org` and push live if nothing broke. Once all the kinks are worked out, `make_all.py` could push directly to production."},"comment":{"url":"https://api.github.com/repos/blab/nextflu/issues/comments/91755637","html_url":"https://github.com/blab/nextflu/pull/83#issuecomment-91755637","issue_url":"https://api.github.com/repos/blab/nextflu/issues/83","id":91755637,"user":{"login":"trvrb","id":1176109,"avatar_url":"https://avatars.githubusercontent.com/u/1176109?v=3","gravatar_id":"","url":"https://api.github.com/users/trvrb","html_url":"https://github.com/trvrb","followers_url":"https://api.github.com/users/trvrb/followers","following_url":"https://api.github.com/users/trvrb/following{/other_user}","gists_url":"https://api.github.com/users/trvrb/gists{/gist_id}","starred_url":"https://api.github.com/users/trvrb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/trvrb/subscriptions","organizations_url":"https://api.github.com/users/trvrb/orgs","repos_url":"https://api.github.com/users/trvrb/repos","events_url":"https://api.github.com/users/trvrb/events{/privacy}","received_events_url":"https://api.github.com/users/trvrb/received_events","type":"User","site_admin":false},"created_at":"2015-04-11T03:48:15Z","updated_at":"2015-04-11T03:48:15Z","body":"I think this is there."}}