{"push_id":540098141,"size":1,"distinct_size":1,"ref":"refs/heads/master","head":"3c48da4eddb51f2649d7674d8f8c25c0a9255bb9","before":"7dd1c7f78a51dc260fbc50005eca96758b68c4a6","commits":[{"sha":"3c48da4eddb51f2649d7674d8f8c25c0a9255bb9","author":{"email":"5aa370712a3e8ee40e71a085d1a105e824066db2@c7155fb1-f0a7-4240-a2fc-2600b6f42f90","name":"unhammer"},"message":"Don't load language models from scratch for each document\n\nNow starts languageguesser with all langs, and calls classify(inlangs)\nrather than load a new languageguesser(inlangs) per document.\n\nUses a global LANGUAGEGUESSER object since we want to share it between\nprocesses. (I first tried simply putting the guesser in worker()'s args,\nbut then it seems like it was copied for each document rather than for\neach worker :-O (started swapping real fast)\nhttp://stackoverflow.com/a/26289464/69663 discusses this global-method.)\n\nNow back to its old speed when running on loads of files (was 10x slower\nfor some commits there …)\n\ngit-svn-id: https://victorio.uit.no/langtech/trunk/tools/CorpusTools@105172 c7155fb1-f0a7-4240-a2fc-2600b6f42f90","distinct":true,"url":"https://api.github.com/repos/unhammer/gt-CorpusTools/commits/3c48da4eddb51f2649d7674d8f8c25c0a9255bb9"}]}