{"action":"created","issue":{"url":"https://api.github.com/repos/dkpro/dkpro-core/issues/552","labels_url":"https://api.github.com/repos/dkpro/dkpro-core/issues/552/labels{/name}","comments_url":"https://api.github.com/repos/dkpro/dkpro-core/issues/552/comments","events_url":"https://api.github.com/repos/dkpro/dkpro-core/issues/552/events","html_url":"https://github.com/dkpro/dkpro-core/issues/552","id":75764860,"number":552,"title":"Create a WhitespaceTokenizer (or maybe a generic RegexBasedTokenizer)","user":{"login":"reckart","id":1410238,"avatar_url":"https://avatars.githubusercontent.com/u/1410238?v=3","gravatar_id":"","url":"https://api.github.com/users/reckart","html_url":"https://github.com/reckart","followers_url":"https://api.github.com/users/reckart/followers","following_url":"https://api.github.com/users/reckart/following{/other_user}","gists_url":"https://api.github.com/users/reckart/gists{/gist_id}","starred_url":"https://api.github.com/users/reckart/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/reckart/subscriptions","organizations_url":"https://api.github.com/users/reckart/orgs","repos_url":"https://api.github.com/users/reckart/repos","events_url":"https://api.github.com/users/reckart/events{/privacy}","received_events_url":"https://api.github.com/users/reckart/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/dkpro/dkpro-core/labels/enhancement","name":"enhancement","color":"84b6eb"},{"url":"https://api.github.com/repos/dkpro/dkpro-core/labels/Module-tokit","name":"Module-tokit","color":"ededed"},{"url":"https://api.github.com/repos/dkpro/dkpro-core/labels/Priority-Medium","name":"Priority-Medium","color":"ededed"}],"state":"open","locked":false,"assignee":{"login":"carschno","id":4696228,"avatar_url":"https://avatars.githubusercontent.com/u/4696228?v=3","gravatar_id":"","url":"https://api.github.com/users/carschno","html_url":"https://github.com/carschno","followers_url":"https://api.github.com/users/carschno/followers","following_url":"https://api.github.com/users/carschno/following{/other_user}","gists_url":"https://api.github.com/users/carschno/gists{/gist_id}","starred_url":"https://api.github.com/users/carschno/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/carschno/subscriptions","organizations_url":"https://api.github.com/users/carschno/orgs","repos_url":"https://api.github.com/users/carschno/repos","events_url":"https://api.github.com/users/carschno/events{/privacy}","received_events_url":"https://api.github.com/users/carschno/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/dkpro/dkpro-core/milestones/1","html_url":"https://github.com/dkpro/dkpro-core/milestones/1.8.0","labels_url":"https://api.github.com/repos/dkpro/dkpro-core/milestones/1/labels","id":1110791,"number":1,"title":"1.8.0","description":"","creator":{"login":"reckart","id":1410238,"avatar_url":"https://avatars.githubusercontent.com/u/1410238?v=3","gravatar_id":"","url":"https://api.github.com/users/reckart","html_url":"https://github.com/reckart","followers_url":"https://api.github.com/users/reckart/followers","following_url":"https://api.github.com/users/reckart/following{/other_user}","gists_url":"https://api.github.com/users/reckart/gists{/gist_id}","starred_url":"https://api.github.com/users/reckart/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/reckart/subscriptions","organizations_url":"https://api.github.com/users/reckart/orgs","repos_url":"https://api.github.com/users/reckart/repos","events_url":"https://api.github.com/users/reckart/events{/privacy}","received_events_url":"https://api.github.com/users/reckart/received_events","type":"User","site_admin":false},"open_issues":56,"closed_issues":65,"state":"open","created_at":"2015-05-14T19:48:08Z","updated_at":"2015-07-24T11:51:34Z","due_on":null,"closed_at":null},"comments":1,"created_at":"2015-05-12T22:37:57Z","updated_at":"2015-07-29T14:57:35Z","closed_at":null,"body":"```\nCreate a WhitespaceTokenizer (or maybe a generic RegexBasedTokenizer).\n```\n\nOriginal issue reported on code.google.com by `richard.eckart` on 2014-12-04 11:36:31"},"comment":{"url":"https://api.github.com/repos/dkpro/dkpro-core/issues/comments/125979794","html_url":"https://github.com/dkpro/dkpro-core/issues/552#issuecomment-125979794","issue_url":"https://api.github.com/repos/dkpro/dkpro-core/issues/552","id":125979794,"user":{"login":"carschno","id":4696228,"avatar_url":"https://avatars.githubusercontent.com/u/4696228?v=3","gravatar_id":"","url":"https://api.github.com/users/carschno","html_url":"https://github.com/carschno","followers_url":"https://api.github.com/users/carschno/followers","following_url":"https://api.github.com/users/carschno/following{/other_user}","gists_url":"https://api.github.com/users/carschno/gists{/gist_id}","starred_url":"https://api.github.com/users/carschno/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/carschno/subscriptions","organizations_url":"https://api.github.com/users/carschno/orgs","repos_url":"https://api.github.com/users/carschno/repos","events_url":"https://api.github.com/users/carschno/events{/privacy}","received_events_url":"https://api.github.com/users/carschno/received_events","type":"User","site_admin":false},"created_at":"2015-07-29T14:57:35Z","updated_at":"2015-07-29T14:57:35Z","body":"I've created a simple Whitespace tokenizer. It should be possible to generalize to a regex-based tokenizer."}}