{"action":"created","issue":{"url":"https://api.github.com/repos/khaivngo/QuickEval/issues/55","labels_url":"https://api.github.com/repos/khaivngo/QuickEval/issues/55/labels{/name}","comments_url":"https://api.github.com/repos/khaivngo/QuickEval/issues/55/comments","events_url":"https://api.github.com/repos/khaivngo/QuickEval/issues/55/events","html_url":"https://github.com/khaivngo/QuickEval/issues/55","id":58283797,"number":55,"title":"Missing subjective rating in final report","user":{"login":"ping-zhao","id":9220129,"avatar_url":"https://avatars.githubusercontent.com/u/9220129?v=3","gravatar_id":"","url":"https://api.github.com/users/ping-zhao","html_url":"https://github.com/ping-zhao","followers_url":"https://api.github.com/users/ping-zhao/followers","following_url":"https://api.github.com/users/ping-zhao/following{/other_user}","gists_url":"https://api.github.com/users/ping-zhao/gists{/gist_id}","starred_url":"https://api.github.com/users/ping-zhao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ping-zhao/subscriptions","organizations_url":"https://api.github.com/users/ping-zhao/orgs","repos_url":"https://api.github.com/users/ping-zhao/repos","events_url":"https://api.github.com/users/ping-zhao/events{/privacy}","received_events_url":"https://api.github.com/users/ping-zhao/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/khaivngo/QuickEval/labels/critical","name":"critical","color":"009800"},{"url":"https://api.github.com/repos/khaivngo/QuickEval/labels/P1","name":"P1","color":"fbca04"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":9,"created_at":"2015-02-19T22:56:10Z","updated_at":"2015-02-25T19:03:36Z","closed_at":null,"body":"In the experiment, I have 10 groups of images, each group has 7 distortion levels, but the final report displays only 6 levels of subjective ratings for some groups. I version I used was the version \"123a56deb9ec43e06728dbb7195dfaafa0c5b475\" in the development branch. This is critical and it stops me from inviting more human observers.\r\n\r\n![untitled](https://cloud.githubusercontent.com/assets/9220129/6277904/cfa36974-b892-11e4-963f-65e8f9d4573b.png)\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/khaivngo/QuickEval/issues/comments/76031642","html_url":"https://github.com/khaivngo/QuickEval/issues/55#issuecomment-76031642","issue_url":"https://api.github.com/repos/khaivngo/QuickEval/issues/55","id":76031642,"user":{"login":"khaivngo","id":5311481,"avatar_url":"https://avatars.githubusercontent.com/u/5311481?v=3","gravatar_id":"","url":"https://api.github.com/users/khaivngo","html_url":"https://github.com/khaivngo","followers_url":"https://api.github.com/users/khaivngo/followers","following_url":"https://api.github.com/users/khaivngo/following{/other_user}","gists_url":"https://api.github.com/users/khaivngo/gists{/gist_id}","starred_url":"https://api.github.com/users/khaivngo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/khaivngo/subscriptions","organizations_url":"https://api.github.com/users/khaivngo/orgs","repos_url":"https://api.github.com/users/khaivngo/repos","events_url":"https://api.github.com/users/khaivngo/events{/privacy}","received_events_url":"https://api.github.com/users/khaivngo/received_events","type":"User","site_admin":false},"created_at":"2015-02-25T19:03:35Z","updated_at":"2015-02-25T19:03:35Z","body":"> I have checked the z-score calculations for paired comparison, and the calculations are correct. However, the raw data shown on the results page (at least in test I did) one observer more than what the calculations are based on. If the raw data says 5 observers, then the z-score calculations are based on 4. It seems like something happens when the frequency matrix is obtained, but I have not debugged that yet.\r\n\r\nThat is good news, keep us updated.\r\n\r\n"}}