{"action":"created","issue":{"url":"https://api.github.com/repos/AtlasOfLivingAustralia/biocache-store/issues/97","labels_url":"https://api.github.com/repos/AtlasOfLivingAustralia/biocache-store/issues/97/labels{/name}","comments_url":"https://api.github.com/repos/AtlasOfLivingAustralia/biocache-store/issues/97/comments","events_url":"https://api.github.com/repos/AtlasOfLivingAustralia/biocache-store/issues/97/events","html_url":"https://github.com/AtlasOfLivingAustralia/biocache-store/issues/97","id":120714916,"number":97,"title":"ALA is downgrading and obfuscating species records","user":{"login":"Mesibov","id":16182234,"avatar_url":"https://avatars.githubusercontent.com/u/16182234?v=3","gravatar_id":"","url":"https://api.github.com/users/Mesibov","html_url":"https://github.com/Mesibov","followers_url":"https://api.github.com/users/Mesibov/followers","following_url":"https://api.github.com/users/Mesibov/following{/other_user}","gists_url":"https://api.github.com/users/Mesibov/gists{/gist_id}","starred_url":"https://api.github.com/users/Mesibov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Mesibov/subscriptions","organizations_url":"https://api.github.com/users/Mesibov/orgs","repos_url":"https://api.github.com/users/Mesibov/repos","events_url":"https://api.github.com/users/Mesibov/events{/privacy}","received_events_url":"https://api.github.com/users/Mesibov/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-12-07T07:18:16Z","updated_at":"2015-12-09T23:07:17Z","closed_at":null,"body":"In auditing ALA's Coleoptera (2 December 2015 download) I've so far found hundreds of cases in which apparently good species records have been 'downgraded' during processing to higher taxon records and hidden from searching. Below are three examples.\r\n\r\n--\r\n\r\n(1) Amblystogenium pacificum is a carabid beetle. The Australian Antarctic Data Centre provided two records to ALA from islands in the French Southern Territories. A search for Amblystogenium pacificum on the ALA website returns no results. Despite both AADC records being uploaded with Amblystogenium as the genus item and pacificum as the specific epithet, one record has been assigned to Coleoptera:\r\n\r\nhttp://biocache.ala.org.au/occurrences/82e887ca-0c35-4ef0-a9f2-878a1f0012df\r\n\r\nand the other to Carabidae:\r\n\r\nhttp://biocache.ala.org.au/occurrences/e6c7f45b-c388-4a57-bbb8-c12cb68088da\r\n\r\nThe name 'Amblystogenium pacificum' is not in AFD but has a listing in CoL:\r\n\r\nhttp://www.catalogueoflife.org/col/details/species/id/762976f3892d25893864cf272ff31260\r\n\r\n--\r\n\r\n(2) 88 specimen records of the ant Paratrechina minutula were provided to ALA by the Australian Museum. The Museum misspelled 'Paratrechina' as 'Paratrachina' in its upload. Although all 88 records give Hymenoptera for order and Formicidae for family, ALA has listed them all as subtribe Paratrachina in order Coleoptera, family Buprestidae, e.g.\r\n\r\nhttp://biocache.ala.org.au/occurrences/cd45395e-0a02-4686-8d86-06dbfe36b21a\r\n\r\nThese 88 records don't appear among ALA's ant records.\r\n\r\n--\r\n\r\n(3) 10 specimen records of the beetle Dorysthenes walkeri were provided to ALA by the Australian Museum. A search for \"Dorysthenes walkeri\" on the ALA website returns no results. All 10 records have been 'downgraded' to Cerambycidae, e.g.\r\n\r\nhttp://biocache.ala.org.au/occurrences/e54e8567-4146-441c-9b9c-90afb412f5fc\r\n\r\nThe name 'Dorysthenes walkeri' is not in AFD but has a listing in CoL:\r\n\r\nhttp://www.catalogueoflife.org/col/details/species/id/b7f5669190f3e08bcf25a1d51217c922"},"comment":{"url":"https://api.github.com/repos/AtlasOfLivingAustralia/biocache-store/issues/comments/163430817","html_url":"https://github.com/AtlasOfLivingAustralia/biocache-store/issues/97#issuecomment-163430817","issue_url":"https://api.github.com/repos/AtlasOfLivingAustralia/biocache-store/issues/97","id":163430817,"user":{"login":"nickdos","id":532845,"avatar_url":"https://avatars.githubusercontent.com/u/532845?v=3","gravatar_id":"","url":"https://api.github.com/users/nickdos","html_url":"https://github.com/nickdos","followers_url":"https://api.github.com/users/nickdos/followers","following_url":"https://api.github.com/users/nickdos/following{/other_user}","gists_url":"https://api.github.com/users/nickdos/gists{/gist_id}","starred_url":"https://api.github.com/users/nickdos/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nickdos/subscriptions","organizations_url":"https://api.github.com/users/nickdos/orgs","repos_url":"https://api.github.com/users/nickdos/repos","events_url":"https://api.github.com/users/nickdos/events{/privacy}","received_events_url":"https://api.github.com/users/nickdos/received_events","type":"User","site_admin":false},"created_at":"2015-12-09T23:07:17Z","updated_at":"2015-12-09T23:07:17Z","body":"Thanks again Bob - this is an ongoing issue for us (it's never \"done\") but we've neglected it a bit in the past year. We're currently working on updating our name indexing and parsing software, so these examples will be useful in improving the software's name matching accuracy. \r\n\r\nI just wanted to point out at that mis-matched or unmatched names are not (completely) hidden from the search - we provide an option in the advanced search page to search for the \"raw/verbatim/unprocessed name\". But I agree it would be far better to have the matching work the way a human would expect it to.\r\n\r\n![image](https://cloud.githubusercontent.com/assets/532845/11701778/a51e681e-9f25-11e5-88dd-40aa6659a1e9.png)\r\n\r\n"}}