English
Related papers

Related papers: FGSVQA: Frequency-Guided Short-form Video Quality …

200 papers

The Visual Multimethod Assessment Fusion (VMAF) algorithm has recently emerged as a state-of-the-art approach to video quality prediction, that now pervades the streaming and social media industry. However, since VMAF requires the…

Image and Video Processing · Electrical Eng. & Systems 2023-11-21 Abhinau K. Venkataramanan , Cosmin Stejerean , Ioannis Katsavounidis , Alan C. Bovik

Face image quality assessment (FIQA) plays a critical role in face recognition and verification systems, especially in uncontrolled, real-world environments. Although several methods have been proposed, general-purpose no-reference image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 MohammadAli Hamidi , Hadi Amirpour , Luigi Atzori , Christian Timmerer

Visual Question Answering (VQA) is the task of answering questions based on image content. Building upon this, Knowledge-Based VQA (KB-VQA) requires models to answer questions that depend on external knowledge beyond the visual content of…

Information Retrieval · Computer Science 2026-04-08 Wei Ye , Yixin Su , Yueguo Chen , Longxiang Gao , Jianjun Li , Ruixuan Li , Rui Zhang

As multimedia services such as video streaming, video conferencing, virtual reality (VR), and online gaming continue to expand, ensuring high perceptual visual quality becomes a priority to maintain user satisfaction and competitiveness.…

Multimedia · Computer Science 2025-03-04 Wei Zhou , Hadi Amirpour , Christian Timmerer , Guangtao Zhai , Patrick Le Callet , Alan C. Bovik

This paper presents an overview of the VQualA 2025 Challenge on Engagement Prediction for Short Videos, held in conjunction with ICCV 2025. The challenge focuses on understanding and modeling the popularity of user-generated content (UGC)…

Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yiwen Song , Tomas Pfister , Yale Song

The development of Large Language Models (LLM) and Diffusion Models brings the boom of Artificial Intelligence Generated Content (AIGC). It is essential to build an effective quality assessment framework to provide a quantifiable evaluation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Xi Fang , Weigang Wang , Xiaoxin Lv , Jun Yan

The advent and proliferation of large multi-modal models (LMMs) have introduced new paradigms to computer vision, transforming various tasks into a unified visual question answering framework. Video Quality Assessment (VQA), a classic field…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ziheng Jia , Zicheng Zhang , Jiaying Qian , Haoning Wu , Wei Sun , Chunyi Li , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

In the context of long-term video understanding with large multimodal models, many frameworks have been proposed. Although transformer-based visual compressors and memory-augmented approaches are often used to process long videos, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Sosuke Yamao , Natsuki Miyahara , Yuankai Qi , Shun Takeuchi

This paper reviews the AIS 2024 Video Quality Assessment (VQA) Challenge, focused on User-Generated Content (UGC). The aim of this challenge is to gather deep learning-based methods capable of estimating the perceptual quality of UGC…

Videos convey rich information. Dynamic spatio-temporal relationships between people/objects, and diverse multimodal events are present in a video clip. Hence, it is important to develop automated models that can accurately extract such…

Computation and Language · Computer Science 2020-05-14 Hyounghun Kim , Zineng Tang , Mohit Bansal

Recently, with the growing popularity of mobile devices as well as video sharing platforms (e.g., YouTube, Facebook, TikTok, and Twitch), User-Generated Content (UGC) videos have become increasingly common and now account for a large…

Image and Video Processing · Electrical Eng. & Systems 2023-10-31 Ahmed Telili , Sid Ahmed Fezza , Wassim Hamidouche , Hanene F. Z. Brachemi Meftah

Video Question Answering (VideoQA) aims to answer natural language questions based on the information observed in videos. Despite the recent success of Large Multimodal Models (LMMs) in image-language understanding and reasoning, they deal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Haibo Wang , Chenghang Lai , Yixuan Sun , Weifeng Ge

With the growing demand for video applications, many advanced learned video compression methods have been developed, outperforming traditional methods in terms of objective quality metrics such as PSNR. Existing methods primarily focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Meng Li , Yibo Shi , Jing Wang , Yunqi Huang

Recent multimodal large language models (MLLMs) have shown promising performance on video quality assessment (VQA) tasks. However, adapting them to new scenarios remains expensive due to large-scale retraining and costly mean opinion score…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xinyue Li , Shubo Xu , Zhichao Zhang , Zhaolin Cai , Yitong Chen , Guangtao Zhai

With recent advancements in video backbone architectures, combined with the remarkable achievements of large language models (LLMs), the analysis of long-form videos spanning tens of minutes has become both feasible and increasingly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Yuxiao Chen , Jue Wang , Zhikang Zhang , Jingru Yi , Xu Zhang , Yang Zou , Zhaowei Cai , Jianbo Yuan , Xinyu Li , Hao Yang , Davide Modolo

Video quality significantly affects video classification. We found this problem when we classified Mild Cognitive Impairment well from clear videos, but worse from blurred ones. From then, we realized that referring to Video Quality…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jian Sun , Mohammad H. Mahoor

The attention mechanism is blooming in computer vision nowadays. However, its application to video quality assessment (VQA) has not been reported. Evaluating the quality of in-the-wild videos is challenging due to the unknown of pristine…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Fengchuang Xing , Yuan-Gen Wang , Hanpin Wang , Leida Li , Guopu Zhu

Video compression is a standard procedure applied to all videos to minimize storage and transmission demands while preserving visual quality as much as possible. Therefore, evaluating the visual quality of compressed videos is crucial for…

Image and Video Processing · Electrical Eng. & Systems 2025-07-17 Wei Sun , Linhan Cao , Kang Fu , Dandan Zhu , Jun Jia , Menghan Hu , Xiongkuo Min , Guangtao Zhai

Learning based video compression attracts increasing attention in the past few years. The previous hybrid coding approaches rely on pixel space operations to reduce spatial and temporal redundancy, which may suffer from inaccurate motion…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Zhihao Hu , Guo Lu , Dong Xu