中文
相关论文

相关论文: Evaluation of Text-to-Video Generation Models: A D…

200 篇论文

Advances in video generation have significantly improved the realism and quality of created scenes. This has fueled interest in developing intuitive tools that let users leverage video generation as world simulators. Text-to-video (T2V)…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Zuhao Liu , Aleksandar Yanev , Ahmad Mahmood , Ivan Nikolov , Saman Motamed , Wei-Shi Zheng , Xi Wang , Lei Sun , Luc Van Gool , Danda Pani Paudel

Subject-driven text-to-image (T2I) generation aims to produce images that align with a given textual description, while preserving the visual identity from a referenced subject image. Despite its broad downstream applicability - ranging…

Text-to-Audio-Video (T2AV) generation aims to synthesize temporally coherent video and semantically synchronized audio from natural language, yet its evaluation remains fragmented, often relying on unimodal metrics or narrowly scoped…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Zhe Cao , Tao Wang , Jiaming Wang , Yanghai Wang , Yuanxing Zhang , Jialu Chen , Miao Deng , Jiahao Wang , Yubin Guo , Chenxi Liao , Yize Zhang , Zhaoxiang Zhang , Jiaheng Liu

Text-to-video (T2V) diffusion models have achieved rapid progress, yet their demographic biases, particularly gender bias, remain largely unexplored. We present FairT2V, a training-free debiasing framework for text-to-video generation that…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Haonan Zhong , Wei Song , Tingxu Han , Maurice Pagnucco , Jingling Xue , Yang Song

Recent advances in text-to-video generation have produced increasingly realistic and diverse content, yet evaluating such videos remains a fundamental challenge due to their multi-faceted nature encompassing visual quality, semantic…

Recent progress in text-to-video (T2V) generation has enabled the synthesis of visually compelling and temporally coherent videos from natural language. However, these models often fall short in basic physical commonsense, producing outputs…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Enes Sanli , Baris Sarper Tezcan , Aykut Erdem , Erkut Erdem

Generative models have driven significant progress in a variety of AI tasks, including text-to-video generation, where models like Video LDM and Stable Video Diffusion can produce realistic, movie-level videos from textual instructions.…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Xuyang Guo , Zekai Huang , Jiayan Huo , Yingyu Liang , Zhenmei Shi , Zhao Song , Jiahao Zhang

High-quality video generation, encompassing text-to-video (T2V), image-to-video (I2V), and video-to-video (V2V) generation, holds considerable significance in content creation to benefit anyone express their inherent creativity in new ways…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Ailing Zeng , Yuhang Yang , Weidong Chen , Wei Liu

Subject-to-Video (S2V) generation aims to create videos that faithfully incorporate reference content, providing enhanced flexibility in the production of videos. To establish the infrastructure for S2V generation, we propose OpenS2V-Nexus,…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Shenghai Yuan , Xianyi He , Yufan Deng , Yang Ye , Jinfa Huang , Bin Lin , Jiebo Luo , Li Yuan

Text-to-video (T2V) synthesis has gained increasing attention in the community, in which the recently emerged diffusion models (DMs) have promisingly shown stronger performance than the past approaches. While existing state-of-the-art DMs…

人工智能 · 计算机科学 2024-03-20 Hao Fei , Shengqiong Wu , Wei Ji , Hanwang Zhang , Tat-Seng Chua

Visual generation models have achieved remarkable progress in computer graphics applications but still face significant challenges in real-world deployment. Current assessment approaches for visual generation tasks typically follow an…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Xiaoyue Mi , Fan Tang , Juan Cao , Qiang Sheng , Ziyao Huang , Peng Li , Yang Liu , Tong-Yee Lee

With the rapid development of generative models, Artificial Intelligence-Generated Contents (AIGC) have exponentially increased in daily lives. Among them, Text-to-Video (T2V) generation has received widespread attention. Though many T2V…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Tengchuan Kou , Xiaohong Liu , Zicheng Zhang , Chunyi Li , Haoning Wu , Xiongkuo Min , Guangtao Zhai , Ning Liu

The current text-to-video (T2V) generation has made significant progress in synthesizing realistic general videos, but it is still under-explored in identity-specific human video generation with customized ID images. The key challenge lies…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Hengjia Li , Haonan Qiu , Shiwei Zhang , Xiang Wang , Yujie Wei , Zekun Li , Yingya Zhang , Boxi Wu , Deng Cai

Recent text-to-video generation models have made remarkable progress in visual realism, motion fidelity, and text-video alignment, yet they still struggle to produce socially coherent behavior. Unlike humans, who readily infer intentions,…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Wenshuo Peng , Gongxuan Wang , Tianmeng Yang , Chuanhao Li , Xiaojie Xu , Hui He , Kaipeng Zhang

Text-to-video (T2V) generation has been recently enabled by transformer-based diffusion models, but current T2V models lack capabilities in adhering to the real-world common knowledge and physical rules, due to their limited understanding…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Qiyao Xue , Xiangyu Yin , Boyuan Yang , Wei Gao

Text-to-video (T2V) generation has rapidly progressed in visual fidelity, yet its ability to faithfully represent multiple cultures within a single prompt remains underexplored. We introduce MAVEN, a multi-agent prompt refinement framework…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Shuowei Li , Yuming Zhao , Parth Bhalerao , Oana Ignat

Existing text-to-image (T2I) benchmarks largely rely on fixed prompt sets, leaving them vulnerable to overfitting and benchmark contamination once publicly released and repeatedly reused. In this work, we propose DynT2I-Eval, a fully…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Juntong Wang , Jiarui Wang , Huiyu Duan , Lewei Li , Guangtao Zhai , Xiongkuo Min

The field of video generation has made remarkable advancements, yet there remains a pressing need for a clear, systematic recipe that can guide the development of robust and scalable models. In this work, we present a comprehensive study…

Most of these text-to-video (T2V) generative models often produce single-scene video clips that depict an entity performing a particular action (e.g., 'a red panda climbing a tree'). However, it is pertinent to generate multi-scene videos…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Hritik Bansal , Yonatan Bitton , Michal Yarom , Idan Szpektor , Aditya Grover , Kai-Wei Chang

The rapid evolution of Text-to-Video (T2V) diffusion models has driven remarkable advancements in generating high-quality, temporally coherent videos from natural language descriptions. Despite these achievements, their vulnerability to…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Changzhen Li , Yuecong Min , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen