中文
相关论文

相关论文: Audio-Visual Quality Assessment for User Generated…

200 篇论文

In this paper, in order to get a better understanding of the human visual preferences for AIGIs, a large-scale IQA database for AIGC is established, which is named as AIGCIQA2023. We first generate over 2000 images based on 6…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Jiarui Wang , Huiyu Duan , Jing Liu , Shi Chen , Xiongkuo Min , Guangtao Zhai

Subjective video quality assessment (VQA) is the gold standard for measuring end-user experience across communication, streaming, and UGC pipelines. Beyond high-validity lab studies, crowdsourcing offers accurate, reliable, faster, and…

图像与视频处理 · 电气工程与系统科学 2025-09-25 Babak Naderi , Ross Cutler

In this paper, we focus on the Audio-Visual Question Answering (AVQA) task, which aims to answer questions regarding different visual objects, sounds, and their associations in videos. The problem requires comprehensive multimodal…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Guangyao Li , Yake Wei , Yapeng Tian , Chenliang Xu , Ji-Rong Wen , Di Hu

With the rapid development of generative models, Artificial Intelligence-Generated Contents (AIGC) have exponentially increased in daily lives. Among them, Text-to-Video (T2V) generation has received widespread attention. Though many T2V…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Tengchuan Kou , Xiaohong Liu , Zicheng Zhang , Chunyi Li , Haoning Wu , Xiongkuo Min , Guangtao Zhai , Ning Liu

Short-form video poses new challenges to the quality assessment of user-generated content (UGC) due to its complex generation pipeline, rapid content variation, and mixed distortions. To address this challenge, we propose an end-to-end…

图像与视频处理 · 电气工程与系统科学 2026-05-20 Xinyi Wang , Angeliki Katsenou , Junxiao Shen , David Bull

Assessing action quality is both imperative and challenging due to its significant impact on the quality of AI-generated videos, further complicated by the inherently ambiguous nature of actions within AI-generated video (AIGV). Current…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Zijian Chen , Wei Sun , Yuan Tian , Jun Jia , Zicheng Zhang , Jiarui Wang , Ru Huang , Xiongkuo Min , Guangtao Zhai , Wenjun Zhang

Omnidirectional images and videos can provide immersive experience of real-world scenes in Virtual Reality (VR) environment. We present a perceptual omnidirectional image quality assessment (IQA) study in this paper since it is extremely…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Huiyu Duan , Guangtao Zhai , Xiongkuo Min , Yucheng Zhu , Yi Fang , Xiaokang Yang

Dynamic adaptive streaming over HTTP provides the work of most multimedia services, however, the nature of this technology further complicates the assessment of the QoE (Quality of Experience). In this paper, the influence of various…

多媒体 · 计算机科学 2020-12-09 Aleksandr Ivchenko , Pavel Kononyuk , Alexander Dvorkovich , Liubov Antiufrieva

In this paper, we propose XGC-AVis, a multi-agent framework that enhances the audio-video temporal alignment capabilities of multimodal large models (MLLMs) and improves the efficiency of retrieving key video segments through 4 stages:…

多媒体 · 计算机科学 2025-09-30 Yuqin Cao , Xiongkuo Min , Yixuan Gao , Wei Sun , Zicheng Zhang , Jinliang Han , Guangtao Zhai

This paper presents a review for the NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement. The challenge comprises two tracks: (i) Efficient Video Quality Assessment (KVQ), and (ii) Diffusion-based Image…

图像与视频处理 · 电气工程与系统科学 2025-04-18 Xin Li , Kun Yuan , Bingchen Li , Fengbin Guan , Yizhen Shao , Zihao Yu , Xijun Wang , Yiting Lu , Wei Luo , Suhang Yao , Ming Sun , Chao Zhou , Zhibo Chen , Radu Timofte , Yabin Zhang , Ao-Xiang Zhang , Tianwu Zhi , Jianzhao Liu , Yang Li , Jingwen Xu , Yiting Liao , Yushen Zuo , Mingyang Wu , Renjie Li , Shengyun Zhong , Zhengzhong Tu , Yufan Liu , Xiangguang Chen , Zuowei Cao , Minhao Tang , Shan Liu , Kexin Zhang , Jingfen Xie , Yan Wang , Kai Chen , Shijie Zhao , Yunchen Zhang , Xiangkai Xu , Hong Gao , Ji Shi , Yiming Bao , Xiugang Dong , Xiangsheng Zhou , Yaofeng Tu , Ying Liang , Yiwen Wang , Xinning Chai , Yuxuan Zhang , Zhengxue Cheng , Yingsheng Qin , Yucai Yang , Rong Xie , Li Song , Wei Sun , Kang Fu , Linhan Cao , Dandan Zhu , Kaiwei Zhang , Yucheng Zhu , Zicheng Zhang , Menghan Hu , Xiongkuo Min , Guangtao Zhai , Zhi Jin , Jiawei Wu , Wei Wang , Wenjian Zhang , Yuhai Lan , Gaoxiong Yi , Hengyuan Na , Wang Luo , Di Wu , MingYin Bai , Jiawang Du , Zilong Lu , Zhenyu Jiang , Hui Zeng , Ziguan Cui , Zongliang Gan , Guijin Tang , Xinglin Xie , Kehuan Song , Xiaoqiang Lu , Licheng Jiao , Fang Liu , Xu Liu , Puhua Chen , Ha Thu Nguyen , Katrien De Moor , Seyed Ali Amirshahi , Mohamed-Chaker Larabi , Qi Tang , Linfeng He , Zhiyong Gao , Zixuan Gao , Guohua Zhang , Zhiye Huang , Yi Deng , Qingmiao Jiang , Lu Chen , Yi Yang , Xi Liao , Nourine Mohammed Nadir , Yuxuan Jiang , Qiang Zhu , Siyue Teng , Fan Zhang , Shuyuan Zhu , Bing Zeng , David Bull , Meiqin Liu , Chao Yao , Yao Zhao

Blind or no-reference video quality assessment of user-generated content (UGC) has become a trending, challenging, heretofore unsolved problem. Accurate and efficient video quality predictors suitable for this content are thus in great…

计算机视觉与模式识别 · 计算机科学 2021-11-16 Zhengzhong Tu , Xiangxu Yu , Yilin Wang , Neil Birkbeck , Balu Adsumilli , Alan C. Bovik

This paper reviews the NTIRE 2024 Challenge on Shortform UGC Video Quality Assessment (S-UGC VQA), where various excellent solutions are submitted and evaluated on the collected dataset KVQ from popular short-form video platform, i.e.,…

This paper presents a novel approach for reduced-reference video quality assessment (VQA), developed as part of the recent VQA Grand Challenge. Our method leverages low-level complexity and structural information from reference and test…

多媒体 · 计算机科学 2025-06-12 Amritha Premkumar , Prajit T Rajendran , Vignesh V Menon

The rapid advancement of Artificial Intelligence Generated Content (AIGC) technology has propelled audio-driven talking head generation, gaining considerable research attention for practical applications. However, performance evaluation…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Weixia Zhang , Chengguang Zhu , Jingnan Gao , Yichao Yan , Guangtao Zhai , Xiaokang Yang

Video Quality Assessment (VQA) aims to simulate the process of perceiving video quality by the human visual system (HVS). The judgments made by HVS are always influenced by human subjective feelings. However, most of the current VQA…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Yachun Mi , Yu Li , Yan Shu , Chen Hui , Puchao Zhou , Shaohui Liu

In an earlier study, we gathered perceptual evaluations of the audio, video, and audiovisual quality for 360 audiovisual content. This paper investigates perceived audiovisual quality prediction based on objective quality metrics and…

多媒体 · 计算机科学 2021-12-24 Randy Frans Fela , Nick Zacharov , Søren Forchhammer

The rapid advancement of AIGC-based video generation has underscored the critical need for comprehensive evaluation frameworks that go beyond traditional generation quality metrics to encompass aesthetic appeal. However, existing benchmarks…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Longteng Jiang , DanDan Zheng , Qianqian Qiao , Heng Huang , Huaye Wang , Yihang Bo , Bao Peng , Jingdong Chen , Jun Zhou , Xin Jin

Video quality assessment (VQA) has attracted growing attention in recent years. While the great expense of annotating large-scale VQA datasets has become the main obstacle for current deep-learning methods. To surmount the constraint of…

计算机视觉与模式识别 · 计算机科学 2023-08-03 Hongbo Liu , Mingda Wu , Kun Yuan , Ming Sun , Yansong Tang , Chuanchuan Zheng , Xing Wen , Xiu Li

No-reference video quality assessment (NR-VQA) for user generated content (UGC) is crucial for understanding and improving visual experience. Unlike video recognition tasks, VQA tasks are sensitive to changes in input resolution. Since…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Junjie Ke , Tianhao Zhang , Yilin Wang , Peyman Milanfar , Feng Yang

With recent advances in deep learning, numerous algorithms have been developed to enhance video quality, reduce visual artifacts, and improve perceptual quality. However, little research has been reported on the quality assessment of…

图像与视频处理 · 电气工程与系统科学 2025-06-10 Tianhao Peng , Chen Feng , Duolikun Danier , Fan Zhang , Benoit Vallade , Alex Mackin , David Bull