English
Related papers

Related papers: A JND-based Video Quality Assessment Model and Its…

200 papers

Recently, with the development of deep learning, a number of Just Noticeable Difference (JND) datasets have been built for JND modeling. However, all the existing JND datasets only label the JND points based on the level of compression…

Graphics · Computer Science 2023-03-09 Yaxuan Liu , Jian Jin , Yuan Xue , Weisi Lin

The advent and proliferation of large multi-modal models (LMMs) have introduced new paradigms to computer vision, transforming various tasks into a unified visual question answering framework. Video Quality Assessment (VQA), a classic field…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ziheng Jia , Zicheng Zhang , Jiaying Qian , Haoning Wu , Wei Sun , Chunyi Li , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yiwen Song , Tomas Pfister , Yale Song

Accurately estimating humans' subjective feedback on video fluency, e.g., motion consistency and frame continuity, is crucial for various applications like streaming and gaming. Yet, it has long been overlooked, as prior arts have focused…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Qizhi Xie , Kun Yuan , Yunpeng Qu , Ming Sun , Chao Zhou , Jihong Zhu

Face video quality assessment (FVQA) deserves to be explored in addition to general video quality assessment (VQA), as face videos are the primary content on social media platforms and human visual system (HVS) is particularly sensitive to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sijing Wu , Yunhao Li , Ziwen Xu , Yixuan Gao , Huiyu Duan , Wei Sun , Guangtao Zhai

Video Quality Assessment (VQA) aims to simulate the process of perceiving video quality by the human visual system (HVS). The judgments made by HVS are always influenced by human subjective feelings. However, most of the current VQA…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Yachun Mi , Yu Li , Yan Shu , Chen Hui , Puchao Zhou , Shaohui Liu

Current methods of Visual Question Answering perform well on the answers with an amount of training data but have limited accuracy on the novel ones with few examples. However, humans can quickly adapt to these new categories with just a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Dalu Guo , Dacheng Tao

Recent learning-based video quality assessment (VQA) algorithms are expensive to implement due to the cost of data collection of human quality opinions, and are less robust across various scenarios due to the biases of these opinions. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Haoning Wu , Liang Liao , Jingwen Hou , Chaofeng Chen , Erli Zhang , Annan Wang , Wenxiu Sun , Qiong Yan , Weisi Lin

A large-scale video quality dataset called the VideoSet has been constructed recently to measure human subjective experience of H.264 coded video in terms of the just-noticeable-difference (JND). It measures the first three JND points of…

Multimedia · Computer Science 2017-10-31 Haiqiang Wang , Ioannis Katsavounidis , Qin Huang , Xin Zhou , C. -C. Jay Kuo

Wide-angle video is favored for its wide viewing angle and ability to capture a large area of scenery, making it an ideal choice for sports and adventure recording. However, wide-angle video is prone to deformation, exposure and other…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Bo Hu , Wei Wang , Chunyi Li , Lihuo He , Leida Li , Xinbo Gao

Automatic action quality assessment (AQA) has attracted increasing attention due to its wide applications. However, most existing AQA methods employ deterministic models to predict the final score for each action, while overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Caixia Zhou , Yaping Huang

Introduction: Video Quality Assessment (VQA) is one of the important areas of study in this modern era, where video is a crucial component of communication with applications in every field. Rapid technology developments in mobile technology…

Image and Video Processing · Electrical Eng. & Systems 2024-04-10 Anantha Prabhu , David Pratap , Narayana Darapeni , Anwesh P R

The explosive growth of videos on streaming media platforms has underscored the urgent need for effective video quality assessment (VQA) algorithms to monitor and perceptually optimize the quality of streaming videos. However, VQA remains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qihang Ge , Wei Sun , Yu Zhang , Yunhao Li , Zhongpeng Ji , Fengyu Sun , Shangling Jui , Xiongkuo Min , Guangtao Zhai

The development of video large multimodal models (LMMs) has been hindered by the difficulty of curating large amounts of high-quality raw data from the web. To address this, we propose an alternative approach by creating a high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Yuanhan Zhang , Jinming Wu , Wei Li , Bo Li , Zejun Ma , Ziwei Liu , Chunyuan Li

The rapid advancement of video generation has rendered existing evaluation systems inadequate for assessing state-of-the-art models, primarily due to simple prompts that cannot showcase the model's capabilities, fixed evaluation operators…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yuhang Yang , Ke Fan , Shangkun Sun , Hongxiang Li , Ailing Zeng , FeiLin Han , Wei Zhai , Wei Liu , Yang Cao , Zheng-Jun Zha

Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Raihan Kabir , Naznin Haque , Md Saiful Islam , Marium-E-Jannat

Visual question answering (or VQA) is a new and exciting problem that combines natural language processing and computer vision techniques. We present a survey of the various datasets and models that have been used to tackle this task. The…

Computation and Language · Computer Science 2017-05-12 Akshay Kumar Gupta

The prevalence of user-generated content (UGC) on platforms such as YouTube and TikTok has rendered no-reference (NR) perceptual video quality assessment (VQA) vital for optimizing video delivery. Nonetheless, the characteristics of…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Xinyi Wang , Angeliki Katsenou , Junxiao Shen , David Bull

Evaluating generative video models remains an open problem. Reference-based metrics such as Structural Similarity Index Measure (SSIM) and Peak Signal to Noise Ratio (PSNR) reward pixel fidelity over semantic correctness, while Frechet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Karthik Inbasekar , Guy Rom , Omer Shlomovits

Quality assessment for User Generated Content (UGC) videos plays an important role in ensuring the viewing experience of end-users. Previous UGC video quality assessment (VQA) studies either use the image recognition model or the image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Wei Sun , Xiongkuo Min , Wei Lu , Guangtao Zhai