Margaret H. Pinson , Karen Sue Boyd, Jessica Hooker, and Kristina Muntean

Abstract: This paper presents recommended techniques for choosing video sequences for subjective experiments. Subjective video quality assessment is a well understood field, yet scene selection is often limited by content availability. The Consumer Digital Video Library (www.cdvl.org) is a solution. Task oriented subjective testing is a newer field than entertainment oriented testing that may require a different approach to scene selection. We describe three different task-based investigations currently underway: performance requirements for public safety equipment, how quality affects comprehension of sign language over a video link, and how video affects oral comprehension over an audiovisual link. Recommendations for scene selection for two types of testing are given. The impact of experiment design will be considered. An example 1080i 29.97fps video sequence set is presented.

Keywords: experiment design; MOS; subjective testing; task-based subjective testing; video quality assessment

Disclaimer: Certain commercial equipment, components, and software may be identified in this report to specify adequately the technical aspects of the reported results. In no case does such identification imply recommendation or endorsement by the National Telecommunications and Information Administration, nor does it imply that the equipment or software identified is necessarily the best available for the particular application or uses.

For questions or information on this or any other NTIA scientific publication, contact the ITS Publications Office at ITSinfo@ntia.gov or 303-497-3572.

Back to Search Results