English
Related papers

Related papers: Content-Rich AIGC Video Quality Assessment via Int…

200 papers

With the rapid growth of Internet video data amounts and types, a unified Video Quality Assessment (VQA) is needed to inspire video communication with perceptual quality. To meet the real-time and universal requirements in providing such…

Multimedia · Computer Science 2023-03-27 Xinhui Huang , Chunyi Li , Abdelhak Bentaleb , Roger Zimmermann , Guangtao Zhai

Recently, Users Generated Content (UGC) videos becomes ubiquitous in our daily lives. However, due to the limitations of photographic equipments and techniques, UGC videos often contain various degradations, in which one of the most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yunlong Dong , Xiaohong Liu , Yixuan Gao , Xunchu Zhou , Tao Tan , Guangtao Zhai

The rapid advancement of AI-generated video models has created a pressing need for robust and interpretable evaluation frameworks. Existing metrics are limited to producing numerical scores without explanatory comments, resulting in low…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Xiao Liu , Jiawei Zhang

Despite significant progress in generative AI, comprehensive evaluation remains challenging because of the lack of effective metrics and standardized benchmarks. For instance, the widely-used CLIPScore measures the alignment between a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhiqiu Lin , Deepak Pathak , Baiqi Li , Jiayao Li , Xide Xia , Graham Neubig , Pengchuan Zhang , Deva Ramanan

For video-text retrieval, the use of CLIP has been a de facto choice. Since CLIP provides only image and text encoders, this consensus has led to a biased paradigm that entirely ignores the sound track of videos. While several attempts have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Ruixiang Zhao , Zhihao Xu , Bangxiang Lan , Zijie Xin , Jingyu Liu , Xirong Li

With the rapid development of generative models, Artificial Intelligence-Generated Contents (AIGC) have exponentially increased in daily lives. Among them, Text-to-Video (T2V) generation has received widespread attention. Though many T2V…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Tengchuan Kou , Xiaohong Liu , Zicheng Zhang , Chunyi Li , Haoning Wu , Xiongkuo Min , Guangtao Zhai , Ning Liu

The rapid development of Artificial Intelligence Generated Content (AIGC) techniques has enabled the creation of high-quality synthetic content, but it also raises significant security concerns. Current detection methods face two major…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Changjiang Jiang , Wenhui Dong , Zhonghao Zhang , Fengchang Yu , Wei Peng , Xinbin Yuan , Yifei Bi , Ming Zhao , Zian Zhou , Chenyang Si , Caifeng Shan

Short-form UGC video platforms, like Kwai and TikTok, have been an emerging and irreplaceable mainstream media form, thriving on user-friendly engagement, and kaleidoscope creation, etc. However, the advancing content-generation modes,…

Image and Video Processing · Electrical Eng. & Systems 2024-02-21 Yiting Lu , Xin Li , Yajing Pei , Kun Yuan , Qizhi Xie , Yunpeng Qu , Ming Sun , Chao Zhou , Zhibo Chen

Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zhiyu Yin , Kehai Chen , Xuefeng Bai , Ruili Jiang , Juntao Li , Hongdong Li , Jin Liu , Yang Xiang , Jun Yu , Min Zhang

The rapid advancement in AI-generated video synthesis has led to a growth demand for standardized and effective evaluation metrics. Existing metrics lack a unified framework for systematically categorizing methodologies, limiting a holistic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Xinhao Xiang , Xiao Liu , Zizhong Li , Zhuosheng Liu , Jiawei Zhang

In recent years, several video quality assessment (VQA) methods have been developed, achieving high performance. However, these methods were not specifically trained for enhanced videos, which limits their ability to predict video quality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Ding-Jiun Huang , Yu-Ting Kao , Tieh-Hung Chuang , Ya-Chun Tsai , Jing-Kai Lou , Shuen-Huei Guan

The advent of AI has influenced many aspects of human life, from self-driving cars and intelligent chatbots to text-based image and video generation models capable of creating realistic images and videos based on user prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Abhijay Ghildyal , Yuanhan Chen , Saman Zadtootaghaj , Nabajeet Barman , Alan C. Bovik

Many video-to-audio (VTA) methods have been proposed for dubbing silent AI-generated videos. An efficient quality assessment method for AI-generated audio-visual content (AGAV) is crucial for ensuring audio-visual quality. Existing…

Multimedia · Computer Science 2025-07-15 Yuqin Cao , Xiongkuo Min , Yixuan Gao , Wei Sun , Guangtao Zhai

While text-to-video diffusion models have advanced significantly, creating coherent long-form content remains unreliable due to stochastic sampling artifacts. This necessitates generating multiple candidates, yet verifying them creates a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Daewon Yoon , Hyeongseok Lee , Wonsik Shin , Sangyu Han , Nojun Kwak

Recently, User-Generated Content (UGC) videos have gained popularity in our daily lives. However, UGC videos often suffer from poor exposure due to the limitations of photographic equipment and techniques. Therefore, Video Exposure…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Xunchu Zhou , Xiaohong Liu , Yunlong Dong , Tengchuan Kou , Yixuan Gao , Zicheng Zhang , Chunyi Li , Haoning Wu , Guangtao Zhai

Existing Video Corpus Moment Retrieval (VCMR) is limited to coarse-grained understanding, which hinders precise video moment localization when given fine-grained queries. In this paper, we propose a more challenging fine-grained VCMR…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Houlun Chen , Xin Wang , Hong Chen , Zeyang Zhang , Wei Feng , Bin Huang , Jia Jia , Wenwu Zhu

We consider the task of generating diverse and realistic videos guided by natural audio samples from a wide variety of semantic classes. For this task, the videos are required to be aligned both globally and temporally with the input audio:…

Machine Learning · Computer Science 2023-09-29 Guy Yariv , Itai Gat , Sagie Benaim , Lior Wolf , Idan Schwartz , Yossi Adi

Assessing the quality of artificial intelligence-generated images (AIGIs) plays a crucial role in their application in real-world scenarios. However, traditional image quality assessment (IQA) algorithms primarily focus on low-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yu Tian , Yixuan Li , Baoliang Chen , Hanwei Zhu , Shiqi Wang , Sam Kwong

Generative models have demonstrated remarkable capability in synthesizing high-quality text, images, and videos. For video generation, contemporary text-to-video models exhibit impressive capabilities, crafting visually stunning videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jay Zhangjie Wu , Guian Fang , Haoning Wu , Xintao Wang , Yixiao Ge , Xiaodong Cun , David Junhao Zhang , Jia-Wei Liu , Yuchao Gu , Rui Zhao , Weisi Lin , Wynne Hsu , Ying Shan , Mike Zheng Shou

Short-form video poses new challenges to the quality assessment of user-generated content (UGC) due to its complex generation pipeline, rapid content variation, and mixed distortions. To address this challenge, we propose an end-to-end…

Image and Video Processing · Electrical Eng. & Systems 2026-05-20 Xinyi Wang , Angeliki Katsenou , Junxiao Shen , David Bull