Fifth International Workshop on Quality of Multimedia Experience (QoMEX 2014), Singapore, 18–20 September 2014
Subject Bias: Introducing a Theoretical User Model
Cite This Publication
Lucjan Janowski and Margaret H. Pinson, “Subject Bias: Introducing a Theoretical User Model,” in Fifth International Workshop on Quality of Multimedia Experience (QoMEX 2014) Singapore, 18–20 September 2014.
Lucjan Janowski and Margaret H. Pinson
Abstract: We propose a model for rating behavior based on subject bias and subject error. Evidence for subject bias can be found in freely available subjective experiments. When subject bias is removed from ratings, the sensitivity of statistical comparisons between stimuli usually improves. According to our model, subject biases characterize the subject pool. These between-subject differences are important when analyzing and comparing people. On the other hand, it is advantageous to remove subject bias when analyzing mean opinion score. We conclude that bias acts like a random variable within ratings.
Keywords: design of experiments; mean opinion score; video quality assessment; quality of experience (QoE); subjective ratings
For technical information concerning this report, contact:
Margaret H. Pinson
Institute for Telecommunication Sciences
(303) 497-3579
mpinson@ntia.doc.gov
Disclaimer: Certain commercial equipment, components, and software may be identified in this report to specify adequately the technical aspects of the reported results. In no case does such identification imply recommendation or endorsement by the National Telecommunications and Information Administration, nor does it imply that the equipment or software identified is necessarily the best available for the particular application or uses.
For questions or information on this or any other NTIA scientific publication, contact the ITS Publications Office at ITSinfo@ntia.gov or 303-497-3572.