{"action":"created","comment":{"url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/comments/31344875","id":31344875,"diff_hunk":"@@ -33,46 +34,30 @@ as training. Techncially there are some difficulties with this approach:\n * We do not want to serialize the training data kept in memory, since this can\n   be prohibitively large.\n \n-Blocks addresses these problems by using a pickling extension called Dill,\n-avoiding certain data structures such as generators and nested classes (see the\n-:ref:`developer guidelines <serialization_guidelines>`), and by overriding the\n-pickling behavior of datasets.\n+Blocks addresses these problems by avoiding certain data structures such as\n+generators and nested classes (see the :ref:`developer guidelines\n+<serialization_guidelines>`) and overriding the pickling behaviour of some\n+objects, making the pickling of the main loop possible.\n \n-However, in general you should not rely on this serialization approach for the\n-long term saving of your models. Problems that remain are\n+However, pickling can be problematic for long-term storage of models, because\n \n * Unpickling depends on the libraries used being unchanged. This means that if\n   you updated Blocks, Theano, etc. to a new version where the interface has\n-  changed, loading your training progress will fail.\n+  changed, loading your training progress could fail.\n * The unpickling of Theano objects can be problematic, especially when\n   transferring from GPU to CPU or vice versa.\n * It is not possible on Python 2 to unpickle objects that were pickled in Python\n   3.","path":"docs/serialization.rst","position":56,"original_position":56,"commit_id":"42f4bac1950df4bbc0b226ed5724d1d2212e276f","original_commit_id":"42f4bac1950df4bbc0b226ed5724d1d2212e276f","user":{"login":"bartvm","id":2299595,"avatar_url":"https://avatars.githubusercontent.com/u/2299595?v=3","gravatar_id":"","url":"https://api.github.com/users/bartvm","html_url":"https://github.com/bartvm","followers_url":"https://api.github.com/users/bartvm/followers","following_url":"https://api.github.com/users/bartvm/following{/other_user}","gists_url":"https://api.github.com/users/bartvm/gists{/gist_id}","starred_url":"https://api.github.com/users/bartvm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bartvm/subscriptions","organizations_url":"https://api.github.com/users/bartvm/orgs","repos_url":"https://api.github.com/users/bartvm/repos","events_url":"https://api.github.com/users/bartvm/events{/privacy}","received_events_url":"https://api.github.com/users/bartvm/received_events","type":"User","site_admin":false},"body":"Yes, but it doesn't always work out of the box. You might need to specify the encoding as a keyword argument, and you might have problems with bytestrings to unicode conversion and such.","created_at":"2015-05-29T17:19:36Z","updated_at":"2015-05-29T17:19:36Z","html_url":"https://github.com/dmitriy-serdyuk/blocks/pull/3#discussion_r31344875","pull_request_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3","_links":{"self":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/comments/31344875"},"html":{"href":"https://github.com/dmitriy-serdyuk/blocks/pull/3#discussion_r31344875"},"pull_request":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3"}}},"pull_request":{"url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3","id":36519845,"html_url":"https://github.com/dmitriy-serdyuk/blocks/pull/3","diff_url":"https://github.com/dmitriy-serdyuk/blocks/pull/3.diff","patch_url":"https://github.com/dmitriy-serdyuk/blocks/pull/3.patch","issue_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/issues/3","number":3,"state":"open","locked":false,"title":"Move dump","user":{"login":"bartvm","id":2299595,"avatar_url":"https://avatars.githubusercontent.com/u/2299595?v=3","gravatar_id":"","url":"https://api.github.com/users/bartvm","html_url":"https://github.com/bartvm","followers_url":"https://api.github.com/users/bartvm/followers","following_url":"https://api.github.com/users/bartvm/following{/other_user}","gists_url":"https://api.github.com/users/bartvm/gists{/gist_id}","starred_url":"https://api.github.com/users/bartvm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bartvm/subscriptions","organizations_url":"https://api.github.com/users/bartvm/orgs","repos_url":"https://api.github.com/users/bartvm/repos","events_url":"https://api.github.com/users/bartvm/events{/privacy}","received_events_url":"https://api.github.com/users/bartvm/received_events","type":"User","site_admin":false},"body":"","created_at":"2015-05-29T16:02:39Z","updated_at":"2015-05-29T17:19:36Z","closed_at":null,"merged_at":null,"merge_commit_sha":"0e7b9541646b03dffdcbe1bdeed3abcb425ac566","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3/commits","review_comments_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3/comments","review_comment_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/comments{/number}","comments_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/issues/3/comments","statuses_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/statuses/42f4bac1950df4bbc0b226ed5724d1d2212e276f","head":{"label":"mila-udem:move_dump","ref":"move_dump","sha":"42f4bac1950df4bbc0b226ed5724d1d2212e276f","user":{"login":"mila-udem","id":11724251,"avatar_url":"https://avatars.githubusercontent.com/u/11724251?v=3","gravatar_id":"","url":"https://api.github.com/users/mila-udem","html_url":"https://github.com/mila-udem","followers_url":"https://api.github.com/users/mila-udem/followers","following_url":"https://api.github.com/users/mila-udem/following{/other_user}","gists_url":"https://api.github.com/users/mila-udem/gists{/gist_id}","starred_url":"https://api.github.com/users/mila-udem/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mila-udem/subscriptions","organizations_url":"https://api.github.com/users/mila-udem/orgs","repos_url":"https://api.github.com/users/mila-udem/repos","events_url":"https://api.github.com/users/mila-udem/events{/privacy}","received_events_url":"https://api.github.com/users/mila-udem/received_events","type":"Organization","site_admin":false},"repo":{"id":24829371,"name":"blocks","full_name":"mila-udem/blocks","owner":{"login":"mila-udem","id":11724251,"avatar_url":"https://avatars.githubusercontent.com/u/11724251?v=3","gravatar_id":"","url":"https://api.github.com/users/mila-udem","html_url":"https://github.com/mila-udem","followers_url":"https://api.github.com/users/mila-udem/followers","following_url":"https://api.github.com/users/mila-udem/following{/other_user}","gists_url":"https://api.github.com/users/mila-udem/gists{/gist_id}","starred_url":"https://api.github.com/users/mila-udem/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mila-udem/subscriptions","organizations_url":"https://api.github.com/users/mila-udem/orgs","repos_url":"https://api.github.com/users/mila-udem/repos","events_url":"https://api.github.com/users/mila-udem/events{/privacy}","received_events_url":"https://api.github.com/users/mila-udem/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/mila-udem/blocks","description":"A Theano framework for building and training neural networks","fork":false,"url":"https://api.github.com/repos/mila-udem/blocks","forks_url":"https://api.github.com/repos/mila-udem/blocks/forks","keys_url":"https://api.github.com/repos/mila-udem/blocks/keys{/key_id}","collaborators_url":"https://api.github.com/repos/mila-udem/blocks/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/mila-udem/blocks/teams","hooks_url":"https://api.github.com/repos/mila-udem/blocks/hooks","issue_events_url":"https://api.github.com/repos/mila-udem/blocks/issues/events{/number}","events_url":"https://api.github.com/repos/mila-udem/blocks/events","assignees_url":"https://api.github.com/repos/mila-udem/blocks/assignees{/user}","branches_url":"https://api.github.com/repos/mila-udem/blocks/branches{/branch}","tags_url":"https://api.github.com/repos/mila-udem/blocks/tags","blobs_url":"https://api.github.com/repos/mila-udem/blocks/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/mila-udem/blocks/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/mila-udem/blocks/git/refs{/sha}","trees_url":"https://api.github.com/repos/mila-udem/blocks/git/trees{/sha}","statuses_url":"https://api.github.com/repos/mila-udem/blocks/statuses/{sha}","languages_url":"https://api.github.com/repos/mila-udem/blocks/languages","stargazers_url":"https://api.github.com/repos/mila-udem/blocks/stargazers","contributors_url":"https://api.github.com/repos/mila-udem/blocks/contributors","subscribers_url":"https://api.github.com/repos/mila-udem/blocks/subscribers","subscription_url":"https://api.github.com/repos/mila-udem/blocks/subscription","commits_url":"https://api.github.com/repos/mila-udem/blocks/commits{/sha}","git_commits_url":"https://api.github.com/repos/mila-udem/blocks/git/commits{/sha}","comments_url":"https://api.github.com/repos/mila-udem/blocks/comments{/number}","issue_comment_url":"https://api.github.com/repos/mila-udem/blocks/issues/comments{/number}","contents_url":"https://api.github.com/repos/mila-udem/blocks/contents/{+path}","compare_url":"https://api.github.com/repos/mila-udem/blocks/compare/{base}...{head}","merges_url":"https://api.github.com/repos/mila-udem/blocks/merges","archive_url":"https://api.github.com/repos/mila-udem/blocks/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/mila-udem/blocks/downloads","issues_url":"https://api.github.com/repos/mila-udem/blocks/issues{/number}","pulls_url":"https://api.github.com/repos/mila-udem/blocks/pulls{/number}","milestones_url":"https://api.github.com/repos/mila-udem/blocks/milestones{/number}","notifications_url":"https://api.github.com/repos/mila-udem/blocks/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/mila-udem/blocks/labels{/name}","releases_url":"https://api.github.com/repos/mila-udem/blocks/releases{/id}","created_at":"2014-10-06T00:08:32Z","updated_at":"2015-05-28T17:01:18Z","pushed_at":"2015-05-29T17:12:56Z","git_url":"git://github.com/mila-udem/blocks.git","ssh_url":"git@github.com:mila-udem/blocks.git","clone_url":"https://github.com/mila-udem/blocks.git","svn_url":"https://github.com/mila-udem/blocks","homepage":"","size":35621,"stargazers_count":240,"watchers_count":240,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":72,"mirror_url":null,"open_issues_count":100,"forks":72,"open_issues":100,"watchers":240,"default_branch":"master"}},"base":{"label":"dmitriy-serdyuk:custom_pickler","ref":"custom_pickler","sha":"7399169285ab4ff5444e473da6c235e8179baca1","user":{"login":"dmitriy-serdyuk","id":2872615,"avatar_url":"https://avatars.githubusercontent.com/u/2872615?v=3","gravatar_id":"","url":"https://api.github.com/users/dmitriy-serdyuk","html_url":"https://github.com/dmitriy-serdyuk","followers_url":"https://api.github.com/users/dmitriy-serdyuk/followers","following_url":"https://api.github.com/users/dmitriy-serdyuk/following{/other_user}","gists_url":"https://api.github.com/users/dmitriy-serdyuk/gists{/gist_id}","starred_url":"https://api.github.com/users/dmitriy-serdyuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dmitriy-serdyuk/subscriptions","organizations_url":"https://api.github.com/users/dmitriy-serdyuk/orgs","repos_url":"https://api.github.com/users/dmitriy-serdyuk/repos","events_url":"https://api.github.com/users/dmitriy-serdyuk/events{/privacy}","received_events_url":"https://api.github.com/users/dmitriy-serdyuk/received_events","type":"User","site_admin":false},"repo":{"id":27456006,"name":"blocks","full_name":"dmitriy-serdyuk/blocks","owner":{"login":"dmitriy-serdyuk","id":2872615,"avatar_url":"https://avatars.githubusercontent.com/u/2872615?v=3","gravatar_id":"","url":"https://api.github.com/users/dmitriy-serdyuk","html_url":"https://github.com/dmitriy-serdyuk","followers_url":"https://api.github.com/users/dmitriy-serdyuk/followers","following_url":"https://api.github.com/users/dmitriy-serdyuk/following{/other_user}","gists_url":"https://api.github.com/users/dmitriy-serdyuk/gists{/gist_id}","starred_url":"https://api.github.com/users/dmitriy-serdyuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dmitriy-serdyuk/subscriptions","organizations_url":"https://api.github.com/users/dmitriy-serdyuk/orgs","repos_url":"https://api.github.com/users/dmitriy-serdyuk/repos","events_url":"https://api.github.com/users/dmitriy-serdyuk/events{/privacy}","received_events_url":"https://api.github.com/users/dmitriy-serdyuk/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/dmitriy-serdyuk/blocks","description":"","fork":true,"url":"https://api.github.com/repos/dmitriy-serdyuk/blocks","forks_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/forks","keys_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/keys{/key_id}","collaborators_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/teams","hooks_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/hooks","issue_events_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/issues/events{/number}","events_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/events","assignees_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/assignees{/user}","branches_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/branches{/branch}","tags_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/tags","blobs_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/git/refs{/sha}","trees_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/git/trees{/sha}","statuses_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/statuses/{sha}","languages_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/languages","stargazers_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/stargazers","contributors_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/contributors","subscribers_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/subscribers","subscription_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/subscription","commits_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/commits{/sha}","git_commits_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/git/commits{/sha}","comments_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/comments{/number}","issue_comment_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/issues/comments{/number}","contents_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/contents/{+path}","compare_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/compare/{base}...{head}","merges_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/merges","archive_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/downloads","issues_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/issues{/number}","pulls_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls{/number}","milestones_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/milestones{/number}","notifications_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/labels{/name}","releases_url":"https://api.github.com/repos/dmitriy-serdyuk/blocks/releases{/id}","created_at":"2014-12-02T22:07:51Z","updated_at":"2015-04-09T19:37:13Z","pushed_at":"2015-05-29T16:51:27Z","git_url":"git://github.com/dmitriy-serdyuk/blocks.git","ssh_url":"git@github.com:dmitriy-serdyuk/blocks.git","clone_url":"https://github.com/dmitriy-serdyuk/blocks.git","svn_url":"https://github.com/dmitriy-serdyuk/blocks","homepage":null,"size":4140,"stargazers_count":0,"watchers_count":0,"language":"Python","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":1,"forks":0,"open_issues":1,"watchers":0,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3"},"html":{"href":"https://github.com/dmitriy-serdyuk/blocks/pull/3"},"issue":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/issues/3"},"comments":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/issues/3/comments"},"review_comments":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3/comments"},"review_comment":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/pulls/3/commits"},"statuses":{"href":"https://api.github.com/repos/dmitriy-serdyuk/blocks/statuses/42f4bac1950df4bbc0b226ed5724d1d2212e276f"}}}}