{"action":"closed","issue":{"url":"https://api.github.com/repos/jprante/elasticsearch-analysis-decompound/issues/9","labels_url":"https://api.github.com/repos/jprante/elasticsearch-analysis-decompound/issues/9/labels{/name}","comments_url":"https://api.github.com/repos/jprante/elasticsearch-analysis-decompound/issues/9/comments","events_url":"https://api.github.com/repos/jprante/elasticsearch-analysis-decompound/issues/9/events","html_url":"https://github.com/jprante/elasticsearch-analysis-decompound/issues/9","id":50026564,"number":9,"title":"incorrect offsets / fast vector highlighter","user":{"login":"elastic-martin","id":9947392,"avatar_url":"https://avatars.githubusercontent.com/u/9947392?v=3","gravatar_id":"","url":"https://api.github.com/users/elastic-martin","html_url":"https://github.com/elastic-martin","followers_url":"https://api.github.com/users/elastic-martin/followers","following_url":"https://api.github.com/users/elastic-martin/following{/other_user}","gists_url":"https://api.github.com/users/elastic-martin/gists{/gist_id}","starred_url":"https://api.github.com/users/elastic-martin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/elastic-martin/subscriptions","organizations_url":"https://api.github.com/users/elastic-martin/orgs","repos_url":"https://api.github.com/users/elastic-martin/repos","events_url":"https://api.github.com/users/elastic-martin/events{/privacy}","received_events_url":"https://api.github.com/users/elastic-martin/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2014-11-25T13:36:34Z","updated_at":"2015-02-11T09:44:49Z","closed_at":"2015-02-11T09:44:49Z","body":"Hi, \r\n\r\nI use the german-decompounder in conjunction with the fast vector highlighter. The offsets of decompounded words seem to be incorrect.\r\n\r\nFor example, the analyze API returns for \"Die Jahresfeier der Rechtsanwaltskanzleien auf dem Donaudampfschiff hat viel Ökosteuer gekostet.\":\r\n\r\n{\r\n\r\n    \"tokens\": [\r\n        {\r\n            \"token\": \"Die\",\r\n            \"start_offset\": 1,\r\n            \"end_offset\": 4,\r\n            \"type\": \"<ALPHANUM>\",\r\n            \"position\": 1\r\n        }\r\n        ,\r\n        {\r\n            \"token\": \"Die\",\r\n            \"start_offset\": 1,\r\n            \"end_offset\": 4,\r\n            \"type\": \"<ALPHANUM>\",\r\n            \"position\": 1\r\n        }\r\n        ,\r\n        {\r\n            \"token\": \"Jahresfeier\",\r\n            \"start_offset\": 5,\r\n            \"end_offset\": 16,\r\n            \"type\": \"<ALPHANUM>\",\r\n            \"position\": 2\r\n        }\r\n        ,\r\n        {\r\n            \"token\": \"Jahr\",\r\n            \"start_offset\": 5,\r\n            \"end_offset\": 9,\r\n            \"type\": \"<ALPHANUM>\",\r\n            \"position\": 2\r\n        }\r\n        ,\r\n        {\r\n            \"token\": \"feier\",\r\n            \"start_offset\": 9,\r\n            \"end_offset\": 14,\r\n            \"type\": \"<ALPHANUM>\",\r\n            \"position\": 2\r\n        }\r\n        ,...\r\n\t\t\r\nThe fast-vector-highlighter returns \"Die Jahr&lt;tag1&gt;esfei&lt;/tag1&gt;er der Rechtsanwaltskanzleien...\" when searching for \"Feier\" since the offset of the \"feier\"-token is incorrect."}}