{"action":"created","issue":{"url":"https://api.github.com/repos/datamade/parserator/issues/16","labels_url":"https://api.github.com/repos/datamade/parserator/issues/16/labels{/name}","comments_url":"https://api.github.com/repos/datamade/parserator/issues/16/comments","events_url":"https://api.github.com/repos/datamade/parserator/issues/16/events","html_url":"https://github.com/datamade/parserator/issues/16","id":64127637,"number":16,"title":"Adapting parserator to handle an entire document","user":{"login":"AbeHandler","id":1252925,"avatar_url":"https://avatars.githubusercontent.com/u/1252925?v=3","gravatar_id":"","url":"https://api.github.com/users/AbeHandler","html_url":"https://github.com/AbeHandler","followers_url":"https://api.github.com/users/AbeHandler/followers","following_url":"https://api.github.com/users/AbeHandler/following{/other_user}","gists_url":"https://api.github.com/users/AbeHandler/gists{/gist_id}","starred_url":"https://api.github.com/users/AbeHandler/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AbeHandler/subscriptions","organizations_url":"https://api.github.com/users/AbeHandler/orgs","repos_url":"https://api.github.com/users/AbeHandler/repos","events_url":"https://api.github.com/users/AbeHandler/events{/privacy}","received_events_url":"https://api.github.com/users/AbeHandler/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":23,"created_at":"2015-03-24T23:35:14Z","updated_at":"2015-04-27T21:34:59Z","closed_at":null,"body":"I am currently using Parserator to parse short strings, like this: \r\n\r\n> s of 1110 of an hour. The maximum amount to be paid under this contract is $20,000.00. No amount of  work is guaranteed under this agreement; payments wil\r\n\r\nand this \r\n\r\n> General Liability insurance will be purchased and maintained with limits of $1,000,000 per occurrence  an\r\n\r\nI extract these strings using a loose regular expression \".{75}\\$[0-9]+.{75}\" on documents that are usually 5 to 10 pages long. I'm most interested in tagging and categorizing the dollar values. Often, the 100 characters around the string is enough to categorize the dollar value. But in some cases I need input from other parts of the document to do the tagging (ex. earlier in the document it might mention that the document is a lease).\r\n\r\n@fgregg has pointed me here to show how you could do this with crfsuite http://nbviewer.ipython.org/github/tpeng/python-crfsuite/blob/master/examples/CoNLL%202002.ipynb but I am wondering if it might be possible with the parserator wrapper. All uninteresting tokens would be tagged as \\<skip\\> and the interesting ones would be tagged with their proper values. \r\n\r\nI wanted to see what you all thought about (1) using parserator in this way (2) adapting parserator to cover such cases. The biggest hold up to using parserator in this way is tagging documents with hundreds and hundreds of tokens. It seems like you would want a small document annotation GUI to generate the XML to train parserator. Do you think that such a GUI should be part of the library? Do you think this would work? Would you be open to a pull request?"},"comment":{"url":"https://api.github.com/repos/datamade/parserator/issues/comments/96828349","html_url":"https://github.com/datamade/parserator/issues/16#issuecomment-96828349","issue_url":"https://api.github.com/repos/datamade/parserator/issues/16","id":96828349,"user":{"login":"fgregg","id":536941,"avatar_url":"https://avatars.githubusercontent.com/u/536941?v=3","gravatar_id":"","url":"https://api.github.com/users/fgregg","html_url":"https://github.com/fgregg","followers_url":"https://api.github.com/users/fgregg/followers","following_url":"https://api.github.com/users/fgregg/following{/other_user}","gists_url":"https://api.github.com/users/fgregg/gists{/gist_id}","starred_url":"https://api.github.com/users/fgregg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fgregg/subscriptions","organizations_url":"https://api.github.com/users/fgregg/orgs","repos_url":"https://api.github.com/users/fgregg/repos","events_url":"https://api.github.com/users/fgregg/events{/privacy}","received_events_url":"https://api.github.com/users/fgregg/received_events","type":"User","site_admin":false},"created_at":"2015-04-27T21:34:59Z","updated_at":"2015-04-27T21:34:59Z","body":"Hmm.. I think this would probably be best as a separate repo that depended\nupon parserator.\n\nOn Mon, Apr 27, 2015 at 1:13 PM Abe Handler <notifications@github.com>\nwrote:\n\n> Hi everyone, this project is pretty far along and (if you all are\n> interested) I'd like to put in a pull request. Would you be open to\n> directory /documentparserator that contains the webapp allowing people to\n> run parserator on a whole document cloud document? Any advice on how to\n> proceed? https://github.com/AbeHandler/DocumentParserator\n>\n> —\n> Reply to this email directly or view it on GitHub\n> <https://github.com/datamade/parserator/issues/16#issuecomment-96764773>.\n>\n"}}