English

Perceptual Quality Assessment of Virtual Reality Videos in the Wild

Computer Vision and Pattern Recognition 2024-03-18 v3 Image and Video Processing

Abstract

Investigating how people perceive virtual reality (VR) videos in the wild (i.e., those captured by everyday users) is a crucial and challenging task in VR-related applications due to complex authentic distortions localized in space and time. Existing panoramic video databases only consider synthetic distortions, assume fixed viewing conditions, and are limited in size. To overcome these shortcomings, we construct the VR Video Quality in the Wild (VRVQW) database, containing 502502 user-generated videos with diverse content and distortion characteristics. Based on VRVQW, we conduct a formal psychophysical experiment to record the scanpaths and perceived quality scores from 139139 participants under two different viewing conditions. We provide a thorough statistical analysis of the recorded data, observing significant impact of viewing conditions on both human scanpaths and perceived quality. Moreover, we develop an objective quality assessment model for VR videos based on pseudocylindrical representation and convolution. Results on the proposed VRVQW show that our method is superior to existing video quality assessment models. We have made the database and code available at https://github.com/limuhit/VR-Video-Quality-in-the-Wild.

Keywords

Cite

@article{arxiv.2206.08751,
  title  = {Perceptual Quality Assessment of Virtual Reality Videos in the Wild},
  author = {Wen Wen and Mu Li and Yiru Yao and Xiangjie Sui and Yabin Zhang and Long Lan and Yuming Fang and Kede Ma},
  journal= {arXiv preprint arXiv:2206.08751},
  year   = {2024}
}

Comments

Accepted by IEEE Transactions on Circuits and Systems for Video Technology