{"action":"closed","issue":{"url":"https://api.github.com/repos/facebook/ios-snapshot-test-case/issues/133","labels_url":"https://api.github.com/repos/facebook/ios-snapshot-test-case/issues/133/labels{/name}","comments_url":"https://api.github.com/repos/facebook/ios-snapshot-test-case/issues/133/comments","events_url":"https://api.github.com/repos/facebook/ios-snapshot-test-case/issues/133/events","html_url":"https://github.com/facebook/ios-snapshot-test-case/issues/133","id":116285380,"number":133,"title":"Duplicate output for failing tests; expected behaviour?","user":{"login":"larslockefeer","id":3273722,"avatar_url":"https://avatars.githubusercontent.com/u/3273722?v=3","gravatar_id":"","url":"https://api.github.com/users/larslockefeer","html_url":"https://github.com/larslockefeer","followers_url":"https://api.github.com/users/larslockefeer/followers","following_url":"https://api.github.com/users/larslockefeer/following{/other_user}","gists_url":"https://api.github.com/users/larslockefeer/gists{/gist_id}","starred_url":"https://api.github.com/users/larslockefeer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/larslockefeer/subscriptions","organizations_url":"https://api.github.com/users/larslockefeer/orgs","repos_url":"https://api.github.com/users/larslockefeer/repos","events_url":"https://api.github.com/users/larslockefeer/events{/privacy}","received_events_url":"https://api.github.com/users/larslockefeer/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/facebook/ios-snapshot-test-case/labels/question","name":"question","color":"cc317c"}],"state":"closed","locked":false,"assignee":{"login":"nscoding","id":185995,"avatar_url":"https://avatars.githubusercontent.com/u/185995?v=3","gravatar_id":"","url":"https://api.github.com/users/nscoding","html_url":"https://github.com/nscoding","followers_url":"https://api.github.com/users/nscoding/followers","following_url":"https://api.github.com/users/nscoding/following{/other_user}","gists_url":"https://api.github.com/users/nscoding/gists{/gist_id}","starred_url":"https://api.github.com/users/nscoding/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nscoding/subscriptions","organizations_url":"https://api.github.com/users/nscoding/orgs","repos_url":"https://api.github.com/users/nscoding/repos","events_url":"https://api.github.com/users/nscoding/events{/privacy}","received_events_url":"https://api.github.com/users/nscoding/received_events","type":"User","site_admin":false},"milestone":null,"comments":1,"created_at":"2015-11-11T08:01:01Z","updated_at":"2015-11-16T19:16:51Z","closed_at":"2015-11-16T19:16:51Z","body":"When I ran a snapshot test that failed, the output produced when a Snapshot Test fails was a bit surprising to me. I recorded the reference images on a 64-bit architecture. Then, when I change something to the view and run the tests, I get the following output:\r\n\r\n```\r\nTest Case '-[PicnicTests.MessageViewControllerTests testMessageViewControllerWith1Button]' started.\r\n2015-11-11 08:48:27.423 Picnic[30698:20383230] If you have Kaleidoscope installed you can run this command to see an image diff:\r\nksdiff \"/Users/larslockefeer/Projects/Picnic/picnic-ios/PicnicTests/DiffImages/PicnicTests.MessageViewControllerTests/reference_testMessageViewControllerWith1Button@2x.png\" \"/Users/larslockefeer/Projects/Picnic/picnic-ios/PicnicTests/DiffImages/PicnicTests.MessageViewControllerTests/failed_testMessageViewControllerWith1Button@2x.png\"\r\n/Users/larslockefeer/Projects/Picnic/picnic-ios/Pods/FBSnapshotTestCase/FBSnapshotTestCase/SwiftSupport.swift:13: error: -[PicnicTests.MessageViewControllerTests testMessageViewControllerWith1Button] : failed - Snapshot comparison failed: Optional(Error Domain=FBSnapshotTestControllerErrorDomain Code=4 \"Images different\" UserInfo={NSLocalizedDescription=Images different})\r\n/Users/larslockefeer/Projects/Picnic/picnic-ios/Pods/FBSnapshotTestCase/FBSnapshotTestCase/SwiftSupport.swift:13: error: -[PicnicTests.MessageViewControllerTests testMessageViewControllerWith1Button] : failed - Snapshot comparison failed: Optional(Error Domain=FBSnapshotTestControllerErrorDomain Code=1 \"Unable to load reference image.\" UserInfo={NSLocalizedFailureReason=Reference image not found. You need to run the test in record mode, NSLocalizedDescription=Unable to load reference image., FBReferenceImageFilePathKey=/Users/larslockefeer/Projects/Picnic/picnic-ios/PicnicTests/ReferenceImages_32/PicnicTests.MessageViewControllerTests/testMessageViewControllerWith1Button@2x.png})\r\nTest Case '-[PicnicTests.MessageViewControllerTests testMessageViewControllerWith1Button]' failed (0.214 seconds).\r\n```\r\n\r\nOf interest here are lines 4 and 5. Initially, I only noticed the second of these lines and concluded that for some reason, the tests were running on a 32-bit architecture on our CI server or that there was some bug with the suffix generation. It took me a while to see that this is just additional output for the case where `FBSnapshotTestCase` starts looking for a fallback image and fails to find one.\r\n\r\nIs this output the expected behaviour for the case where a reference image could be found but failed verification? Or should the second line be omitted?"}}