中文
相关论文

相关论文: PhyEduVideo: A Benchmark for Evaluating Text-to-Vi…

200 篇论文

Video generation models are revolutionizing content creation, with image-to-video models drawing increasing attention due to their enhanced controllability, visual consistency, and practical applications. However, despite their popularity,…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Wenhao Wang , Yi Yang

Recent advances in Large Multimodal Models (LMMs) have expanded their capabilities to video understanding, with Text-to-Video (T2V) models excelling in generating videos from textual prompts. However, they still frequently produce…

The task of Image-to-Video (I2V) generation aims to synthesize a video from a reference image and a text prompt. This requires diffusion models to reconcile high-frequency visual constraints and low-frequency textual guidance during the…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yuanyang Yin , Yufan Deng , Shenghai Yuan , Kaipeng Zhang , Xiao Yang , Feng Zhao

High-quality video generation, encompassing text-to-video (T2V), image-to-video (I2V), and video-to-video (V2V) generation, holds considerable significance in content creation to benefit anyone express their inherent creativity in new ways…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Ailing Zeng , Yuhang Yang , Weidong Chen , Wei Liu

Recent advances in internet-scale video data pretraining have led to the development of text-to-video generative models that can create high-quality videos across a broad range of visual concepts, synthesize realistic motions and render…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Hritik Bansal , Zongyu Lin , Tianyi Xie , Zeshun Zong , Michal Yarom , Yonatan Bitton , Chenfanfu Jiang , Yizhou Sun , Kai-Wei Chang , Aditya Grover

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

Recent Text-to-Video (T2V) models have demonstrated powerful capability in visual simulation of real-world geometry and physical laws, indicating its potential as implicit world models. Inspired by this, we explore the feasibility of…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Yu Li , Menghan Xia , Gongye Liu , Jianhong Bai , Xintao Wang , Conglang Zhang , Yuxuan Lin , Ruihang Chu , Pengfei Wan , Yujiu Yang

Evaluating the quality of synthesized images remains a significant challenge in the development of text-to-image (T2I) generation. Most existing studies in this area primarily focus on evaluating text-image alignment, image quality, and…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Ziwei Huang , Wanggui He , Quanyu Long , Yandi Wang , Haoyuan Li , Zhelun Yu , Fangxun Shu , Long Chan , Hao Jiang , Fei Wu , Leilei Gan

While diffusion models have shown impressive performance in 2D image/video generation, diffusion-based Text-to-Multi-view-Video (T2MVid) generation remains underexplored. The new challenges posed by T2MVid generation lie in the lack of…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Bing Li , Cheng Zheng , Wenxuan Zhu , Jinjie Mai , Biao Zhang , Peter Wonka , Bernard Ghanem

Text-to-Image (T2I) models have recently achieved remarkable success in generating images from textual descriptions. However, challenges still persist in accurately rendering complex scenes where actions and interactions form the primary…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Vatsal Malaviya , Agneet Chatterjee , Maitreya Patel , Yezhou Yang , Chitta Baral

While text-to-video (T2V) generation has achieved remarkable progress in photorealism, generating intent-aligned videos that faithfully obey physics principles remains a core challenge. In this work, we systematically study Newtonian…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Xiangyu Bai , He Liang , Bishoy Galoaa , Utsav Nandi , Shayda Moezzi , Yuhang He , Sarah Ostadabbas

Text-to-image (T2I) generation aims to synthesize images from textual prompts, which jointly specify what must be shown and imply what can be inferred, which thus correspond to two core capabilities: \textbf{\textit{composition}} and…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Ouxiang Li , Yuan Wang , Xinting Hu , Huijuan Huang , Rui Chen , Jiarong Ou , Xin Tao , Pengfei Wan , Xiaojuan Qi , Fuli Feng

Recent advances in diffusion-based and autoregressive video generation models have achieved remarkable visual realism. However, these models typically lack accurate physical alignment, failing to replicate real-world dynamics in object…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Tao Feng , Xianbing Zhao , Zhenhua Chen , Tien Tsin Wong , Hamid Rezatofighi , Gholamreza Haffari , Lizhen Qu

This paper presents SkyReels-A2, a controllable video generation framework capable of assembling arbitrary visual elements (e.g., characters, objects, backgrounds) into synthesized videos based on textual prompts while maintaining strict…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Zhengcong Fei , Debang Li , Di Qiu , Jiahua Wang , Yikun Dou , Rui Wang , Jingtao Xu , Mingyuan Fan , Guibin Chen , Yang Li , Yahui Zhou

Text-to-video (T2V) generation has recently garnered significant attention thanks to the large multi-modality model Sora. However, T2V generation still faces two important challenges: 1) Lacking a precise open sourced high-quality dataset.…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Kepan Nan , Rui Xie , Penghao Zhou , Tiehan Fan , Zhenheng Yang , Zhijie Chen , Xiang Li , Jian Yang , Ying Tai

Although text-to-image (T2I) models have recently thrived as visual generative priors, their reliance on high-quality text-image pairs makes scaling up expensive. We argue that grasping the cross-modality alignment is not a necessity for a…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Shuailei Ma , Kecheng Zheng , Ying Wei , Wei Wu , Fan Lu , Yifei Zhang , Chen-Wei Xie , Biao Gong , Jiapeng Zhu , Yujun Shen

Recent advancements in large multimodal models (LMMs) have driven substantial progress in both text-to-video (T2V) generation and video-to-text (V2T) interpretation tasks. However, current AI-generated videos (AIGVs) still exhibit…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Jiarui Wang , Huiyu Duan , Ziheng Jia , Yu Zhao , Woo Yi Yang , Zicheng Zhang , Zijian Chen , Juntong Wang , Yuke Xing , Guangtao Zhai , Xiongkuo Min

Diffusion models have achieved impressive results in generative tasks for text-to-video (T2V) synthesis. However, achieving accurate text alignment in T2V generation remains challenging due to the complex temporal dependencies across…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Jaemin Kim , Bryan Sangwoo Kim , Jong Chul Ye

Text-to-video (T2V) generation has recently attracted considerable attention, resulting in the development of numerous high-quality datasets that have propelled progress in this area. However, existing public datasets are primarily composed…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Yiming Ju , Jijin Hu , Zhengxiong Luo , Haoge Deng , hanyu Zhao , Li Du , Chengwei Wu , Donglin Hao , Xinlong Wang , Tengfei Pan

The rapid advancement of photorealistic Text-to-Video (T2V) generation brings in an urgent need for up-to-date evaluation methods. Existing benchmarks largely overlooked implausible scenarios and do not measure audio-visual alignment. We…

多媒体 · 计算机科学 2026-05-05 Advait Tilak , Jiwon Choi , Nazifa Mouli , Wei Le