中文
相关论文

相关论文: RunawayEvil: Jailbreaking the Image-to-Video Gener…

200 篇论文

Recently, image-to-video (I2V) diffusion models have demonstrated impressive scene understanding and generative quality, incorporating image conditions to guide generation. However, these models primarily animate static images without…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Luis Denninger , Sina Mokhtarzadeh Azar , Juergen Gall

Text-to-Video (T2V) models are capable of synthesizing high-quality, temporally coherent dynamic video content, but the diverse generation also inherently introduces critical safety challenges. Existing safety evaluation methods,which focus…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Jiaming He , Guanyu Hou , Hongwei Li , Zhicong Huang , Kangjie Chen , Yi Yu , Wenbo Jiang , Guowen Xu , Tianwei Zhang

Text-to-video generation has advanced rapidly, but existing methods typically output only the final composited video and lack editable layered representations, limiting their use in professional workflows. We propose \textbf{LayerT2V}, a…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Guangzhao Li , Kangrui Cen , Baixuan Zhao , Yi Xin , Siqi Luo , Guangtao Zhai , Lei Zhang , Xiaohong Liu

High-resolution image-to-video (I2V) generation aims to synthesize realistic temporal dynamics while preserving fine-grained appearance details of the input image. At 2K resolution, it becomes extremely challenging, and existing solutions…

计算机视觉与模式识别 · 计算机科学 2026-05-12 YaoYang Liu , Yuechen Zhang , Wenbo Li , Yufei Zhao , Rui Liu , Long Chen

The rapid progress of image-to-video (I2V) generation models has introduced significant risks by enabling deceptive or malicious video synthesis from a single image. Prior defenses such as I2VGuard attempt to immunize images by inducing…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Rohit Chowdhury , Aniruddha Bala , Rohan Jaiswal , Siddharth Roheda

We consider the task of Image-to-Video (I2V) generation, which involves transforming static images into realistic video sequences based on a textual description. While recent advancements produce photorealistic outputs, they frequently…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Guy Yariv , Yuval Kirstain , Amit Zohar , Shelly Sheynin , Yaniv Taigman , Yossi Adi , Sagie Benaim , Adam Polyak

We present Step-Video-T2V, a state-of-the-art text-to-video pre-trained model with 30B parameters and the ability to generate videos up to 204 frames in length. A deep compression Variational Autoencoder, Video-VAE, is designed for video…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Guoqing Ma , Haoyang Huang , Kun Yan , Liangyu Chen , Nan Duan , Shengming Yin , Changyi Wan , Ranchen Ming , Xiaoniu Song , Xing Chen , Yu Zhou , Deshan Sun , Deyu Zhou , Jian Zhou , Kaijun Tan , Kang An , Mei Chen , Wei Ji , Qiling Wu , Wen Sun , Xin Han , Yanan Wei , Zheng Ge , Aojie Li , Bin Wang , Bizhu Huang , Bo Wang , Brian Li , Changxing Miao , Chen Xu , Chenfei Wu , Chenguang Yu , Dapeng Shi , Dingyuan Hu , Enle Liu , Gang Yu , Ge Yang , Guanzhe Huang , Gulin Yan , Haiyang Feng , Hao Nie , Haonan Jia , Hanpeng Hu , Hanqi Chen , Haolong Yan , Heng Wang , Hongcheng Guo , Huilin Xiong , Huixin Xiong , Jiahao Gong , Jianchang Wu , Jiaoren Wu , Jie Wu , Jie Yang , Jiashuai Liu , Jiashuo Li , Jingyang Zhang , Junjing Guo , Junzhe Lin , Kaixiang Li , Lei Liu , Lei Xia , Liang Zhao , Liguo Tan , Liwen Huang , Liying Shi , Ming Li , Mingliang Li , Muhua Cheng , Na Wang , Qiaohui Chen , Qinglin He , Qiuyan Liang , Quan Sun , Ran Sun , Rui Wang , Shaoliang Pang , Shiliang Yang , Sitong Liu , Siqi Liu , Shuli Gao , Tiancheng Cao , Tianyu Wang , Weipeng Ming , Wenqing He , Xu Zhao , Xuelin Zhang , Xianfang Zeng , Xiaojia Liu , Xuan Yang , Yaqi Dai , Yanbo Yu , Yang Li , Yineng Deng , Yingming Wang , Yilei Wang , Yuanwei Lu , Yu Chen , Yu Luo , Yuchu Luo , Yuhe Yin , Yuheng Feng , Yuxiang Yang , Zecheng Tang , Zekai Zhang , Zidong Yang , Binxing Jiao , Jiansheng Chen , Jing Li , Shuchang Zhou , Xiangyu Zhang , Xinhao Zhang , Yibo Zhu , Heung-Yeung Shum , Daxin Jiang

Recent unified models integrate multimodal understanding and generation within a single framework. However, an "understanding-generation gap" persists, where models can capture user intent but often fail to translate this semantic knowledge…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Qingyang Liu , Bingjie Gao , Canmiao Fu , Zhipeng Huang , Chen Li , Feng Wang , Shuochen Chang , Shaobo Wang , Yali Wang , Keming Ye , Jiangtong Li , Li Niu

Recent advances in image-to-video (I2V) generation have achieved remarkable progress in synthesizing high-quality, temporally coherent videos from static images. Among all the applications of I2V, human-centric video generation includes a…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Liao Shen , Wentao Jiang , Yiran Zhu , Jiahe Li , Tiezheng Ge , Zhiguo Cao , Bo Zheng

Text-to-Image (T2I) diffusion models have demonstrated strong generation ability, but their potential to generate unsafe content raises significant safety concerns. Existing inference-time defense methods typically perform category-agnostic…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Binhong Tan , Zhaoxin Wang , Handing Wang

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

We present Step-Video-TI2V, a state-of-the-art text-driven image-to-video generation model with 30B parameters, capable of generating videos up to 102 frames based on both text and image inputs. We build Step-Video-TI2V-Eval as a new…

Generating controllable videos conforming to user intentions is an appealing yet challenging topic in computer vision. To enable maneuverable control in line with user intentions, a novel video generation task, named Text-Image-to-Video…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Yaosi Hu , Chong Luo , Zhenzhong Chen

Diffusion models have obtained substantial progress in image-to-video generation. However, in this paper, we find that these models tend to generate videos with less motion than expected. We attribute this to the issue called conditional…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Min Zhao , Hongzhou Zhu , Chendong Xiang , Kaiwen Zheng , Chongxuan Li , Jun Zhu

Despite advancements in Text-to-Video (T2V) generation, producing videos with realistic motion remains challenging. Current models often yield static or minimally dynamic outputs, failing to capture complex motions described by text. This…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Penghui Ruan , Pichao Wang , Divya Saxena , Jiannong Cao , Yuhui Shi

Text-to-Image (T2I) models generate high-quality images but are vulnerable to malicious backdoor attacks that inject harmful biases (e.g., trigger-activated gender or racial stereotypes). Existing debiasing methods, often designed for…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Hongyi Cai , Mohammad Mahdinur Rahman , Mingkang Dong , Muxin Pu , Moqyad Alqaily , Jie Li , Xinfeng Li , Jialie Shen , Meikang Qiu , Qingsong Wen

Customizing text-to-image (T2I) models has seen tremendous progress recently, particularly in areas such as personalization, stylization, and conditional generation. However, expanding this progress to video generation is still in its…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Hila Chefer , Shiran Zada , Roni Paiss , Ariel Ephrat , Omer Tov , Michael Rubinstein , Lior Wolf , Tali Dekel , Tomer Michaeli , Inbar Mosseri

Text-to-Video (T2V) generation has attracted significant attention for its ability to synthesize realistic videos from textual descriptions. However, existing models struggle to balance computational efficiency and high visual quality,…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Takashi Isobe , He Cui , Dong Zhou , Mengmeng Ge , Dong Li , Emad Barsoum

Text-to-video diffusion models enable the generation of high-quality videos that follow text instructions, making it easy to create diverse and individual content. However, existing approaches mostly focus on high-quality short video…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Roberto Henschel , Levon Khachatryan , Hayk Poghosyan , Daniil Hayrapetyan , Vahram Tadevosyan , Zhangyang Wang , Shant Navasardyan , Humphrey Shi

This work aims to learn a high-quality text-to-video (T2V) generative model by leveraging a pre-trained text-to-image (T2I) model as a basis. It is a highly desirable yet challenging task to simultaneously a) accomplish the synthesis of…