English
Related papers

Related papers: KVQ: Boosting Video Quality Assessment via Salienc…

200 papers

Omnidirectional images and videos can provide immersive experience of real-world scenes in Virtual Reality (VR) environment. We present a perceptual omnidirectional image quality assessment (IQA) study in this paper since it is extremely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Huiyu Duan , Guangtao Zhai , Xiongkuo Min , Yucheng Zhu , Yi Fang , Xiaokang Yang

In recent years, AI generative models have made remarkable progress across various domains, including text generation, image generation, and video generation. However, assessing the quality of text-to-video generation is still in its…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Xinli Yue , Jianhui Sun , Han Kong , Liangchao Yao , Tianyi Wang , Lei Li , Fengyun Rao , Jing Lv , Fan Xia , Yuetang Deng , Qian Wang , Lingchen Zhao

Over the past decade, the online video industry has greatly expanded the volume of visual data that is streamed and shared over the Internet. Moreover, because of the increasing ease of video capture, many millions of consumers create and…

Image and Video Processing · Electrical Eng. & Systems 2021-09-15 Xiangxu Yu , Neil Birkbeck , Yilin Wang , Christos G. Bampis , Balu Adsumilli , Alan C. Bovik

Existing AI-generated video quality assessment (AIGVQA) methods mainly focus on global perceptual realism and coarse text-video alignment, while overlooking a critical requirement in educational scenarios: concept correctness. In early…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Baoliang Chen , Xinlong Bu , Hanwei Zhu , Lingyu Zhu , Jieyu Zhan

Large Multimodal Models (LMMs) have shown promise for video quality assessment, but most methods still predict an absolute score for each video. Such pointwise supervision often mixes perceptual quality with dataset-specific calibration,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shibei Meng , Binxin Yang , Yuan Liu , Jiexuan Zhang , Zhengyao Lv , Hubery Yin , Qiang Xu

Dynamic adaptive streaming over HTTP provides the work of most multimedia services, however, the nature of this technology further complicates the assessment of the QoE (Quality of Experience). In this paper, the influence of various…

Multimedia · Computer Science 2020-12-09 Aleksandr Ivchenko , Pavel Kononyuk , Alexander Dvorkovich , Liubov Antiufrieva

Spatio-temporal forecasting is crucial in various fields and requires a careful balance between identifying subtle patterns and filtering out noise. Vector quantization (VQ) appears well-suited for this purpose, as it quantizes input…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chao Chen , Tian Zhou , Yanjun Zhao , Hui Liu , Liang Sun , Rong Jin

Quality assessment of videos is crucial for many computer graphics applications, including video games, virtual reality, and augmented reality, where visual performance has a significant impact on user experience. When test videos cannot be…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sipeng Yang , Jiayu Ji , Qingchuan Zhu , Zhiyao Yang , Xiaogang Jin

Recently, with the emergence of recent Multimodal Large Language Model (MLLM) technology, it has become possible to exploit its video understanding capability on different classification tasks. In practice, we face the difficulty of huge…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Xin Dong , Sen Jia , Ming Rui Wang , Yan Li , Zhenheng Yang , Bingfeng Deng , Hongyu Xiong

This paper proposes a deep learning model to efficiently detect salient regions in videos. It addresses two important issues: (1) deep video saliency model training with the absence of sufficiently large and pixel-wise annotated video data,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Wenguan Wang , Jianbing Shen , Ling Shao

Video question-answering (QA) is a core task in video understanding. Evaluating the quality of video QA and video caption data quality for training video large language models (VideoLLMs) is an essential challenge. Although various methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Hao Liang , Zirong Chen , Hejun Dong , Wentao Zhang

Perceptual video quality assessment plays a vital role in the field of video processing due to the existence of quality degradations introduced in various stages of video signal acquisition, compression, transmission and display. With the…

Multimedia · Computer Science 2024-02-07 Xiongkuo Min , Huiyu Duan , Wei Sun , Yucheng Zhu , Guangtao Zhai

Since the early 2000s, computational visual saliency has been a very active research area. Each year, more and more new models are published in the main computer vision conferences. Nowadays, one of the big challenges is to find a way to…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Nicolas Riche , Matthieu Duvinage , Matei Mancas , Bernard Gosselin , Thierry Dutoit

In recent years, artificial intelligence (AI)-driven video generation has gained significant attention. Consequently, there is a growing need for accurate video quality assessment (VQA) metrics to evaluate the perceptual quality of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zhichao Zhang , Wei Sun , Xinyue Li , Jun Jia , Xiongkuo Min , Zicheng Zhang , Chunyi Li , Zijian Chen , Puyi Wang , Fengyu Sun , Shangling Jui , Guangtao Zhai

While existing video and image quality datasets have extensively studied natural videos and traditional distortions, the perception of synthetic content and modern rendering artifacts remains underexplored. We present a novel video quality…

Graphics · Computer Science 2025-06-16 Akshay Jindal , Nabil Sadaka , Manu Mathew Thomas , Anton Sochenov , Anton Kaplanyan

Recently, video streams have occupied a large proportion of Internet traffic, most of which contain human faces. Hence, it is necessary to predict saliency on multiple-face videos, which can provide attention cues for many content based…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Yufan Liu , Minglang Qiao , Mai Xu , Bing Li , Weiming Hu , Ali Borji

Video quality assessment (VQA) methods focus on particular degradation types, usually artificially induced on a small set of reference videos. Hence, most traditional VQA methods under-perform in-the-wild. Deep learning approaches have had…

Multimedia · Computer Science 2021-03-02 Franz Götz-Hahn , Vlad Hosu , Hanhe Lin , Dietmar Saupe

Vector quantization (VQ) is a key technique in high-resolution and high-fidelity image synthesis, which aims to learn a codebook to encode an image with a sequence of discrete codes and then generate an image in an auto-regression manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Guotao Liang , Baoquan Zhang , Yaowei Wang , Xutao Li , Yunming Ye , Huaibin Wang , Chuyao Luo , Kola Ye , linfeng Luo

Video quality assessment (VQA) is a crucial task in the development of video compression standards, as it directly impacts the viewer experience. This paper presents the results of the Compressed Video Quality Assessment challenge, held in…

Video Question Answering (VideoQA) models enhance understanding and interaction with audiovisual content, making it more accessible, searchable, and useful for a wide range of fields such as education, surveillance, entertainment, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Himanshu Patil , Geo Jolly , Ramana Raja Buddala , Ganesh Ramakrishnan , Rohit Saluja