中文
相关论文

相关论文: MSG Score: Automated Video Verification for Reliab…

200 篇论文

Text to video generation has emerged as a critical frontier in generative artificial intelligence, yet existing approaches struggle with maintaining temporal consistency, compositional understanding, and fine grained control over visual…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Piyushkumar Patel

Traditional video summarization methods generate fixed video representations regardless of user interest. Therefore such methods limit users' expectations in content search and exploration scenarios. Multi-modal video summarization is one…

计算机视觉与模式识别 · 计算机科学 2021-04-27 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

Leveraging text, images, structure maps, or motion trajectories as conditional guidance, diffusion models have achieved great success in automated and high-quality video generation. However, generating smooth and rational transition videos…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Zuhao Yang , Jiahui Zhang , Yingchen Yu , Shijian Lu , Song Bai

Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Zhiyu Yin , Kehai Chen , Xuefeng Bai , Ruili Jiang , Juntao Li , Hongdong Li , Jin Liu , Yang Xiang , Jun Yu , Min Zhang

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

计算与语言 · 计算机科学 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

Diffusion-based video generation has achieved significant progress, yet generating multiple actions that occur sequentially remains a formidable task. Directly generating a video with sequential actions can be extremely challenging due to…

计算机视觉与模式识别 · 计算机科学 2024-05-29 Bowen Zhang , Xiaofei Xie , Haotian Lu , Na Ma , Tianlin Li , Qing Guo

Automatically evaluating multimodal generation presents a significant challenge, as automated metrics often struggle to align reliably with human evaluation, especially for complex tasks that involve multiple modalities. To address this, we…

Generating multi-view images based on text or single-image prompts is a critical capability for the creation of 3D content. Two fundamental questions on this topic are what data we use for training and how to ensure multi-view consistency.…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Qi Zuo , Xiaodong Gu , Lingteng Qiu , Yuan Dong , Zhengyi Zhao , Weihao Yuan , Rui Peng , Siyu Zhu , Zilong Dong , Liefeng Bo , Qixing Huang

While generative video models have achieved remarkable visual fidelity, their capacity to internalize and reason over implicit world rules remains a critical yet under-explored frontier. To bridge this gap, we present RISE-Video, a…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Mingxin Liu , Shuran Ma , Shibei Meng , Xiangyu Zhao , Zicheng Zhang , Shaofeng Zhang , Zhihang Zhong , Peixian Chen , Haoyu Cao , Xing Sun , Haodong Duan , Xue Yang

Without incurring significant computational overhead, train-free long video generation aims to enable foundation video generation models to produce longer videos. Frame-level autoregressive frameworks, e.g., FIFO-diffusion, offer the…

计算机视觉与模式识别 · 计算机科学 2026-05-19 X. Feng , J. Zhu , M. Wu , C. Chen , F. Mao , H. Guo , J. Wu , X. Chu , K. Huang

Text-to-Audio-Video (T2AV) generation is rapidly becoming a core interface for media creation, yet its evaluation remains fragmented. Existing benchmarks largely assess audio and video in isolation or rely on coarse embedding similarity,…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Ziwei Zhou , Zeyuan Lai , Rui Wang , Yifan Yang , Zhen Xing , Yuqing Yang , Qi Dai , Lili Qiu , Chong Luo

Video generation has witnessed remarkable progress with the advent of deep generative models, particularly diffusion models. While existing methods excel in generating high-quality videos from text prompts or single images, personalized…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Yufan Deng , Xun Guo , Yizhi Wang , Jacob Zhiyuan Fang , Angtian Wang , Shenghai Yuan , Yiding Yang , Bo Liu , Haibin Huang , Chongyang Ma

The field of text-to-3D content generation has made significant progress in generating realistic 3D objects, with existing methodologies like Score Distillation Sampling (SDS) offering promising guidance. However, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Phu Pham , Aradhya N. Mathur , Ojaswa Sharma , Aniket Bera

Real-world videos often extend over thousands of frames. Existing generative video super-resolution (VSR) approaches, however, face two persistent challenges when processing long sequences: (1) inefficiency due to the heavy cost of…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Ziqing Zhang , Kai Liu , Zheng Chen , Xi Li , Yucong Chen , Bingnan Duan , Linghe Kong , Yulun Zhang

In recent years, advancements in generative models have significantly expanded the capabilities of text-to-3D generation. Many approaches rely on Score Distillation Sampling (SDS) technology. However, SDS struggles to accommodate…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jiahui Yang , Donglin Di , Baorui Ma , Xun Yang , Yongjia Ma , Wenzhang Sun , Wei Chen , Jianxun Cui , Zhou Xue , Meng Wang , Yebin Liu

This paper proposes the synthetic long-video meta-evaluation (SLVMEval), a benchmark for meta-evaluating text-to-video (T2V) evaluation systems. The proposed SLVMEval benchmark focuses on assessing these systems on videos of up to 10,486 s…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Ryosuke Matsuda , Keito Kudo , Haruto Yoshida , Nobuyuki Shimizu , Jun Suzuki

Recent advancements in video generation models, like Stable Video Diffusion, show promising results, but primarily focus on short, single-scene videos. These models struggle with generating long videos that involve multiple scenes, coherent…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Weijia Wu , Mingyu Liu , Zeyu Zhu , Xi Xia , Haoen Feng , Wen Wang , Kevin Qinghong Lin , Chunhua Shen , Mike Zheng Shou

Automatic question generation (QG) is essential for AI and NLP, particularly in intelligent tutoring, dialogue systems, and fact verification. Generating multiple-choice questions (MCQG) for professional exams, like the United States…

计算与语言 · 计算机科学 2025-02-11 Zonghai Yao , Aditya Parashar , Huixue Zhou , Won Seok Jang , Feiyun Ouyang , Zhichao Yang , Hong Yu

While Video Large Language Models (Video-LLMs) have shown significant potential in multimodal understanding and reasoning tasks, how to efficiently select the most informative frames from videos remains a critical challenge. Existing…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Shihao Wang , Guo Chen , De-an Huang , Zhiqi Li , Minghan Li , Guilin Liu , Jose M. Alvarez , Lei Zhang , Zhiding Yu

Controllable video generation aims to synthesize video content that aligns precisely with user-provided conditions, such as text descriptions and initial images. However, a significant challenge persists in this domain: existing models…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Peng Hu , Yu Gu , Liang Luo , Fuji Ren