{"action":"created","issue":{"url":"https://api.github.com/repos/MarcusBarnes/mik/issues/71","labels_url":"https://api.github.com/repos/MarcusBarnes/mik/issues/71/labels{/name}","comments_url":"https://api.github.com/repos/MarcusBarnes/mik/issues/71/comments","events_url":"https://api.github.com/repos/MarcusBarnes/mik/issues/71/events","html_url":"https://github.com/MarcusBarnes/mik/issues/71","id":108982981,"number":71,"title":"Extras: output package checker - all expected files present?","user":{"login":"MarcusBarnes","id":938274,"avatar_url":"https://avatars.githubusercontent.com/u/938274?v=3","gravatar_id":"","url":"https://api.github.com/users/MarcusBarnes","html_url":"https://github.com/MarcusBarnes","followers_url":"https://api.github.com/users/MarcusBarnes/followers","following_url":"https://api.github.com/users/MarcusBarnes/following{/other_user}","gists_url":"https://api.github.com/users/MarcusBarnes/gists{/gist_id}","starred_url":"https://api.github.com/users/MarcusBarnes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MarcusBarnes/subscriptions","organizations_url":"https://api.github.com/users/MarcusBarnes/orgs","repos_url":"https://api.github.com/users/MarcusBarnes/repos","events_url":"https://api.github.com/users/MarcusBarnes/events{/privacy}","received_events_url":"https://api.github.com/users/MarcusBarnes/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/MarcusBarnes/mik/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":{"login":"mjordan","id":403918,"avatar_url":"https://avatars.githubusercontent.com/u/403918?v=3","gravatar_id":"","url":"https://api.github.com/users/mjordan","html_url":"https://github.com/mjordan","followers_url":"https://api.github.com/users/mjordan/followers","following_url":"https://api.github.com/users/mjordan/following{/other_user}","gists_url":"https://api.github.com/users/mjordan/gists{/gist_id}","starred_url":"https://api.github.com/users/mjordan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mjordan/subscriptions","organizations_url":"https://api.github.com/users/mjordan/orgs","repos_url":"https://api.github.com/users/mjordan/repos","events_url":"https://api.github.com/users/mjordan/events{/privacy}","received_events_url":"https://api.github.com/users/mjordan/received_events","type":"User","site_admin":false},"milestone":null,"comments":2,"created_at":"2015-09-29T23:53:35Z","updated_at":"2015-11-12T15:06:53Z","closed_at":null,"body":"Provide a QA tool as part of the extras that will double check the output packages from MIK to verify that all files that are expected are present.\r\n\r\nHere is an example scenario for the CdmNewspaper toolchain. A newspaper collection is processed by a user, but one or more issues cause exceptions while writing the package for the issues.  These issues were properly logged in the problem_records.log on the user's machine.  The user does not check check the problem_records.log and moves onto other work.  Coming back later to the packages created for the newspaper collection, another user assume that the entire collection has been processed without any exceptions or problems. The newspaper issue corresponding a problem_record may not have all the files expected (datastreams in the Islandora context).\r\n\r\nThe tool would take the path for the directory containing the packages output by MIK, the expected output model (for example, newspapers) and a list of expected datastreams, iterate through the subdirectories making up MIK output packages, and return a list of directories that do not contain all the expected files.\r\n\r\nThere would be no need for this tool assuming a perfect package creation workflow, but given that MIK may be used as part of large migrations, additional workflow checks such as this tool may prove useful as an extra."},"comment":{"url":"https://api.github.com/repos/MarcusBarnes/mik/issues/comments/156132600","html_url":"https://github.com/MarcusBarnes/mik/issues/71#issuecomment-156132600","issue_url":"https://api.github.com/repos/MarcusBarnes/mik/issues/71","id":156132600,"user":{"login":"mjordan","id":403918,"avatar_url":"https://avatars.githubusercontent.com/u/403918?v=3","gravatar_id":"","url":"https://api.github.com/users/mjordan","html_url":"https://github.com/mjordan","followers_url":"https://api.github.com/users/mjordan/followers","following_url":"https://api.github.com/users/mjordan/following{/other_user}","gists_url":"https://api.github.com/users/mjordan/gists{/gist_id}","starred_url":"https://api.github.com/users/mjordan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mjordan/subscriptions","organizations_url":"https://api.github.com/users/mjordan/orgs","repos_url":"https://api.github.com/users/mjordan/repos","events_url":"https://api.github.com/users/mjordan/events{/privacy}","received_events_url":"https://api.github.com/users/mjordan/received_events","type":"User","site_admin":false},"created_at":"2015-11-12T15:06:53Z","updated_at":"2015-11-12T15:06:53Z","body":"Currently, the script assumes that MODS.xml is the issue-level metadata file. Newspaper batch allows MODS, DC or MARCXML (.xml). Maybe we should add an optional command-line option  (with a default of MODS.xml) so the user can specific which one to check for at the newspaper issue level, e.gi `--issue_level_metadata=DC.xml`."}}