{"action":"created","issue":{"url":"https://api.github.com/repos/QuantEcon/QuantEcon.jl/issues/13","labels_url":"https://api.github.com/repos/QuantEcon/QuantEcon.jl/issues/13/labels{/name}","comments_url":"https://api.github.com/repos/QuantEcon/QuantEcon.jl/issues/13/comments","events_url":"https://api.github.com/repos/QuantEcon/QuantEcon.jl/issues/13/events","html_url":"https://github.com/QuantEcon/QuantEcon.jl/issues/13","id":41661441,"number":13,"title":"ENH: parallelize the bellman_operator (and similar)","user":{"login":"spencerlyon2","id":1001948,"avatar_url":"https://avatars.githubusercontent.com/u/1001948?v=3","gravatar_id":"","url":"https://api.github.com/users/spencerlyon2","html_url":"https://github.com/spencerlyon2","followers_url":"https://api.github.com/users/spencerlyon2/followers","following_url":"https://api.github.com/users/spencerlyon2/following{/other_user}","gists_url":"https://api.github.com/users/spencerlyon2/gists{/gist_id}","starred_url":"https://api.github.com/users/spencerlyon2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/spencerlyon2/subscriptions","organizations_url":"https://api.github.com/users/spencerlyon2/orgs","repos_url":"https://api.github.com/users/spencerlyon2/repos","events_url":"https://api.github.com/users/spencerlyon2/events{/privacy}","received_events_url":"https://api.github.com/users/spencerlyon2/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":11,"created_at":"2014-09-01T20:58:01Z","updated_at":"2015-01-28T07:19:19Z","closed_at":null,"body":"This algorithm is easily parallelizable. \r\n\r\nAs a first shot we might want to implement this using the `DArray` type. We can refer to [this implementation](https://github.com/JuliaLang/julia/blob/master/examples/plife.jl) of the game of life to see how it works. If that doesn't give us what we want, we could easily just distribute indices/chunks of the array, have each process update their chunk, then have the master process organize them back into the original array in preparation for the next iteration."},"comment":{"url":"https://api.github.com/repos/QuantEcon/QuantEcon.jl/issues/comments/71791396","html_url":"https://github.com/QuantEcon/QuantEcon.jl/issues/13#issuecomment-71791396","issue_url":"https://api.github.com/repos/QuantEcon/QuantEcon.jl/issues/13","id":71791396,"user":{"login":"oyamad","id":7353083,"avatar_url":"https://avatars.githubusercontent.com/u/7353083?v=3","gravatar_id":"","url":"https://api.github.com/users/oyamad","html_url":"https://github.com/oyamad","followers_url":"https://api.github.com/users/oyamad/followers","following_url":"https://api.github.com/users/oyamad/following{/other_user}","gists_url":"https://api.github.com/users/oyamad/gists{/gist_id}","starred_url":"https://api.github.com/users/oyamad/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/oyamad/subscriptions","organizations_url":"https://api.github.com/users/oyamad/orgs","repos_url":"https://api.github.com/users/oyamad/repos","events_url":"https://api.github.com/users/oyamad/events{/privacy}","received_events_url":"https://api.github.com/users/oyamad/received_events","type":"User","site_admin":false},"created_at":"2015-01-28T07:19:19Z","updated_at":"2015-01-28T07:19:19Z","body":"Hi all,\r\nI have been working on coding a Markov Decision Processes (MDP) class (while I am not totally sure if this is exactly what @jstac has in mid), which has been work in progress for a while:\r\nhttps://github.com/oyamad/mdp\r\n\r\nThere are two tasks yet to be done:\r\n\r\n* Integrate two pieces of code, in which a transition matrix is\r\n\r\n  0. a 3-dimensional array defined on S x A x S\r\n  0. a 2-dimensional array defined on SA x S\r\n\r\n  where S is the state space, A the action space, and SA the set of (feasible) state-action pairs.\r\n  (Note that the second allows sparse matrix representation.)\r\n\r\n* Write docstring.\r\n\r\n\r\nI have been learning by teaching on this matter; you might take a look at my course repository:\r\nhttps://github.com/oyamad/theory14\r\n\r\nAny suggestions would be greatly appreciated (though this, Julia side, may not be a good place to start a discussion on this...).\r\n"}}