English
Related papers

Related papers: Audio-Visual Quality Assessment for User Generated…

200 papers

Visual Question Answering (VQA) is a core task for evaluating the capabilities of Vision-Language Models (VLMs). Existing VQA benchmarks primarily feature clear and unambiguous image-question pairs, whereas real-world scenarios often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jihyoung Jang , Hyounghun Kim

As image generation technology advances, AI-based image generation has been applied in various fields and Artificial Intelligence Generated Content (AIGC) has garnered widespread attention. However, the development of AI-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Jiquan Yuan , Xinyan Cao , Changjin Li , Fanyi Yang , Jinlong Lin , Xixin Cao

Audio-Visual Question Answering (AVQA) is a complex multi-modal reasoning task, demanding intelligent systems to accurately respond to natural language queries based on audio-video input pairs. Nevertheless, prevalent AVQA approaches are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jie Ma , Min Hu , Pinghui Wang , Wangchun Sun , Lingyun Song , Hongbin Pei , Jun Liu , Youtian Du

This paper studies the quality of multimedia content focusing on 360 video and ambisonic spatial audio reproduced using a head-mounted display and a multichannel loudspeaker setup. Encoding parameters following basic video quality test…

Multimedia · Computer Science 2020-05-20 Randy Frans Fela , Nick Zacharov , Søren Forchhammer

Integrating audio and visual data for training multimodal foundational models remains a challenge. The Audio-Video Vector Alignment (AVVA) framework addresses this by considering AV scene alignment beyond mere temporal synchronization, and…

Multimedia · Computer Science 2025-11-12 Ali Vosoughi , Dimitra Emmanouilidou , Hannes Gamper

Recent learning-based video quality assessment (VQA) algorithms are expensive to implement due to the cost of data collection of human quality opinions, and are less robust across various scenarios due to the biases of these opinions. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Haoning Wu , Liang Liao , Jingwen Hou , Chaofeng Chen , Erli Zhang , Annan Wang , Wenxiu Sun , Qiong Yan , Weisi Lin

Video quality assessment (VQA) is a fundamental computer vision task that aims to predict the perceptual quality of a given video in alignment with human judgments. Existing performant VQA models trained with direct score supervision suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Shuo Xing , Soumik Dey , Mingyang Wu , Ashirbad Mishra , Naveen Ravipati , Binbin Li , Hansi Wu , Zhengzhong Tu

Digital humans have witnessed extensive applications in various domains, necessitating related quality assessment studies. However, there is a lack of comprehensive digital human quality assessment (DHQA) databases. To address this gap, we…

Image and Video Processing · Electrical Eng. & Systems 2023-07-07 Zicheng Zhang , Wei Sun , Yingjie Zhou , Haoning Wu , Chunyi Li , Xiongkuo Min , Xiaohong Liu , Guangtao Zhai , Weisi Lin

The popularity of Short form videos (SFV) has grown dramatically in the past few years, and has become a phenomenal video category with billions of viewers. Meanwhile, High Dynamic Range (HDR) as an advanced feature also becomes more and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Yilin Wang , Joong Gon Yim , Neil Birkbeck , Balu Adsumilli

Video quality assessment (VQA) seeks to predict the perceptual quality of a video in alignment with human visual perception, serving as a fundamental tool for quantifying quality degradation across video processing workflows. The dominant…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Linhan Cao , Wei Sun , Xiangyang Zhu , Kaiwei Zhang , Jun Jia , Yicong Peng , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

With the development of multimedia technology, Augmented Reality (AR) has become a promising next-generation mobile platform. The primary value of AR is to promote the fusion of digital contents and real-world environments, however, studies…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Huiyu Duan , Xiongkuo Min , Yucheng Zhu , Guangtao Zhai , Xiaokang Yang , Patrick Le Callet

In recent years, static meshes with texture maps have become one of the most prevalent digital representations of 3D shapes in various applications, such as animation, gaming, medical imaging, and cultural heritage applications. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Bingyang Cui , Qi Yang , Kaifa Yang , Yiling Xu , Xiaozhong Xu , Shan Liu

High Dynamic Range (HDR) user-generated (UGC) videos are rapidly proliferating across social platforms, yet most perceptual video quality assessment (VQA) systems remain tailored to Standard Dynamic Range (SDR). HDR has a higher bit depth,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Shreshth Saini , Bowen Chen , Neil Birkbeck , Yilin Wang , Balu Adsumilli , Alan C. Bovik

The advent of next-generation video generation models like \textit{Sora} poses challenges for AI-generated content (AIGC) video quality assessment (VQA). These models substantially mitigate flickering artifacts prevalent in prior models,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Shangkun Sun , Xiaoyu Liang , Bowen Qu , Wei Gao

We propose a perceptual video quality assessment (PVQA) metric for distorted videos by analyzing the power spectral density (PSD) of a group of pictures. This is an estimation approach that relies on the changes in video dynamic calculated…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Mohammed A. Aabed , Gukyeong Kwon , Ghassan AlRegib

An accurate computational model for image quality assessment (IQA) benefits many vision applications, such as image filtering, image processing, and image generation. Although the study of face images is an important subfield in computer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Shaolin Su , Hanhe Lin , Vlad Hosu , Oliver Wiedemann , Jinqiu Sun , Yu Zhu , Hantao Liu , Yanning Zhang , Dietmar Saupe

Demand for streaming services, including satellite, continues to exhibit unprecedented growth. Internet Service Providers find themselves at the crossroads of technological advancements and rising customer expectations. To stay relevant and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Bowen Chen , Zaixi Shang , Jae Won Chung , David Lerner , Werner Robitza , Rakesh Rao Ramachandra Rao , Alexander Raake , Alan C. Bovik

Video Quality Assessment (VQA) is a very challenging task due to its highly subjective nature. Moreover, many factors influence VQA. Compression of video content, while necessary for minimising transmission and storage requirements,…

Recently, many video enhancement methods have been proposed to improve video quality from different aspects such as color, brightness, contrast, and stability. Therefore, how to evaluate the quality of the enhanced video in a way consistent…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Yixuan Gao , Yuqin Cao , Tengchuan Kou , Wei Sun , Yunlong Dong , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Raihan Kabir , Naznin Haque , Md Saiful Islam , Marium-E-Jannat