{"action":"created","issue":{"url":"https://api.github.com/repos/airbnb/airflow/issues/55","labels_url":"https://api.github.com/repos/airbnb/airflow/issues/55/labels{/name}","comments_url":"https://api.github.com/repos/airbnb/airflow/issues/55/comments","events_url":"https://api.github.com/repos/airbnb/airflow/issues/55/events","html_url":"https://github.com/airbnb/airflow/issues/55","id":89976720,"number":55,"title":"Can you add a slightly more realistic example of a data pipeline in the cloud?","user":{"login":"r39132","id":581734,"avatar_url":"https://avatars.githubusercontent.com/u/581734?v=3","gravatar_id":"","url":"https://api.github.com/users/r39132","html_url":"https://github.com/r39132","followers_url":"https://api.github.com/users/r39132/followers","following_url":"https://api.github.com/users/r39132/following{/other_user}","gists_url":"https://api.github.com/users/r39132/gists{/gist_id}","starred_url":"https://api.github.com/users/r39132/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/r39132/subscriptions","organizations_url":"https://api.github.com/users/r39132/orgs","repos_url":"https://api.github.com/users/r39132/repos","events_url":"https://api.github.com/users/r39132/events{/privacy}","received_events_url":"https://api.github.com/users/r39132/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-06-21T23:58:07Z","updated_at":"2015-06-22T04:27:33Z","closed_at":null,"body":"For example, the Luigi [example](http://luigi.readthedocs.org/en/latest/example_top_artists.html) walks through a case that involves importing data into a DB. It would be cool if there were some examples that read from one location (e.g. S3) and wrote to another (e.g. DB).  \r\n"},"comment":{"url":"https://api.github.com/repos/airbnb/airflow/issues/comments/113997412","html_url":"https://github.com/airbnb/airflow/issues/55#issuecomment-113997412","issue_url":"https://api.github.com/repos/airbnb/airflow/issues/55","id":113997412,"user":{"login":"mistercrunch","id":487433,"avatar_url":"https://avatars.githubusercontent.com/u/487433?v=3","gravatar_id":"","url":"https://api.github.com/users/mistercrunch","html_url":"https://github.com/mistercrunch","followers_url":"https://api.github.com/users/mistercrunch/followers","following_url":"https://api.github.com/users/mistercrunch/following{/other_user}","gists_url":"https://api.github.com/users/mistercrunch/gists{/gist_id}","starred_url":"https://api.github.com/users/mistercrunch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mistercrunch/subscriptions","organizations_url":"https://api.github.com/users/mistercrunch/orgs","repos_url":"https://api.github.com/users/mistercrunch/repos","events_url":"https://api.github.com/users/mistercrunch/events{/privacy}","received_events_url":"https://api.github.com/users/mistercrunch/received_events","type":"User","site_admin":false},"created_at":"2015-06-22T04:27:33Z","updated_at":"2015-06-22T04:27:33Z","body":"Agreed, the current tutorial is really just focused on the mechanics of Airflow with very foobar-y examples. I didn't want to write a pipeline that was too stack specific (MySQL / Hive / ...) and wanted to make sure it would work for anyone, regardless of the stack they might have. \r\n\r\nMaybe using a SqliteOperator to do some analytics on some data scraped from the Internet would be a good example. It could be interesting to re-write the Luigi example for comparison :)\r\n\r\nBut yeah, it's on the TODO list."}}