English
Related papers

Related papers: RunawayEvil: Jailbreaking the Image-to-Video Gener…

200 papers

Image animation has seen significant progress, driven by the powerful generative capabilities of diffusion models. However, maintaining appearance consistency with static input images and mitigating abrupt motion transitions in generated…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xin Ma , Yaohui Wang , Genyun Jia , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

Current video generation models perform well at single-shot synthesis but struggle with multi-shot videos, facing critical challenges in maintaining character and background consistency across shots and flexibly generating videos of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Xiangyang Luo , Qingyu Li , Xiaokun Liu , Wenyu Qin , Miao Yang , Meng Wang , Pengfei Wan , Di Zhang , Kun Gai , Shao-Lun Huang

Large Language Models (LLMs) continue to exhibit vulnerabilities to jailbreaking attacks: carefully crafted malicious inputs intended to circumvent safety guardrails and elicit harmful responses. As such, we present AutoAdv, a novel…

Cryptography and Security · Computer Science 2025-12-25 Aashray Reddy , Andrew Zagula , Nicholas Saban

Multimodal Large Language Models (MLLMs) extend text-only LLMs with visual reasoning, but also introduce new safety failure modes under visually grounded instructions. We study comic-template jailbreaks that embed harmful goals inside…

Cryptography and Security · Computer Science 2026-04-24 Rui Yang Tan , Yujia Hu , Roy Ka-Wei Lee

The rapid evolution of Text-to-Video (T2V) diffusion models has driven remarkable advancements in generating high-quality, temporally coherent videos from natural language descriptions. Despite these achievements, their vulnerability to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Changzhen Li , Yuecong Min , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

Generative AI models, particularly Text-to-Video (T2V) systems, offer a promising avenue for transforming science education by automating the creation of engaging and intuitive visual explanations. In this work, we take a first step toward…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Megha Mariam K. M , Aditya Arun , Zakaria Laskar , C. V. Jawahar

State-of-the-art Text-to-Video (T2V) diffusion models can generate visually impressive results, yet they still frequently fail to compose complex scenes or follow logical temporal instructions. In this paper, we argue that many errors,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mariam Hassan , Bastien Van Delft , Wuyang Li , Alexandre Alahi

Vision-Language Models (VLMs) are increasingly susceptible to sophisticated adversarial attacks, including adaptive strategies specifically designed to bypass existing defenses. To address this vulnerability, we propose MirrorCheck, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Samar Fares , Klea Ziu , Toluwani Aremu , Nikita Durasov , Martin Takáč , Pascal Fua , Ivan Laptev , Karthik Nandakumar

Advances in video generation have significantly improved the realism and quality of created scenes. This has fueled interest in developing intuitive tools that let users leverage video generation as world simulators. Text-to-video (T2V)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Zuhao Liu , Aleksandar Yanev , Ahmad Mahmood , Ivan Nikolov , Saman Motamed , Wei-Shi Zheng , Xi Wang , Lei Sun , Luc Van Gool , Danda Pani Paudel

Humans often specify and create through visual artifacts: typography sheets, sketches, reference images, and annotated scenes. Yet modern visual generators still ask users to serialize this intent into text, a bottleneck that compresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yaofang Liu , Kangning Cui , Meng Chu , Zhaoqing Li , Suiyun Zhang , Jean-Michel Morel , Xiaodong Cun , Haoxuan Che , Rui Liu , Raymond H. Chan

Text-to-multiview (T2MV) diffusion models have shown great promise in generating multiple views of a scene from a single text prompt. While few-step backbones enable real-time T2MV generation, they often compromise key aspects of generation…

Machine Learning · Computer Science 2026-03-18 Ziyi Zhang , Li Shen , Deheng Ye , Yong Luo , Huangxuan Zhao , Meng Liu , Wei Yu , Lefei Zhang

As large language models have demonstrated impressive performance in many domains, recent works have adopted language models (LMs) as controllers of visual modules for vision-and-language tasks. While existing work focuses on equipping LMs…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Jaemin Cho , Abhay Zala , Mohit Bansal

Diffusion-based text-to-video generation (T2V) or image-to-video (I2V) generation have emerged as a prominent research focus. However, there exists a challenge in integrating the two generative paradigms into a unified model. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xinyu Xiao , Binbin Yang , Tingtian Li , Yipeng Yu , Sen Lei

In facial image generation, current text-to-image models often suffer from facial attribute leakage and insufficient physical consistency when responding to local semantic instructions. In this study, we propose Face-MakeUpV2, a facial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Dawei Dai , Yinxiu Zhou , Chenghang Li , Guolai Jiang , Chengfang Zhang

Text-based image generation models, such as Stable Diffusion and DALL-E 3, hold significant potential in content creation and publishing workflows, making them the focus in recent years. Despite their remarkable capability to generate…

Computation and Language · Computer Science 2025-06-04 Wenxuan Wang , Kuiyi Gao , Youliang Yuan , Jen-tse Huang , Qiuzhi Liu , Shuai Wang , Wenxiang Jiao , Zhaopeng Tu

In the paradigm of AI-generated content (AIGC), there has been increasing attention to transferring knowledge from pre-trained text-to-image (T2I) models to text-to-video (T2V) generation. Despite their effectiveness, these frameworks face…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Susung Hong , Junyoung Seo , Heeseong Shin , Sunghwan Hong , Seungryong Kim

With the ability to generate high-quality images, text-to-image (T2I) models can be exploited for creating inappropriate content. To prevent misuse, existing safety measures are either based on text blacklists, which can be easily…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Runtao Liu , Ashkan Khakzar , Jindong Gu , Qifeng Chen , Philip Torr , Fabio Pizzati

Text to video generation has emerged as a critical frontier in generative artificial intelligence, yet existing approaches struggle with maintaining temporal consistency, compositional understanding, and fine grained control over visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Piyushkumar Patel

Generative models have substantially expanded video generation capabilities, yet practical thought-to-video creation remains a multi-stage, multi-modal, and decision-intensive process. However, existing tools either hide intermediate…

Multimedia · Computer Science 2026-02-10 Zhuoyun Zheng , Yu Dong , Gaorong Liang , Guan Li , Guihua Shan , Shiyu Cheng , Dong Tian , Jianlong Zhou , Jie Liang

Text-to-video (T2V) generation has surged in response to challenging questions, especially when a long video must depict multiple sequential events with temporal coherence and controllable content. Existing methods that extend to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Ruotong Liao , Guowen Huang , Qing Cheng , Thomas Seidl , Daniel Cremers , Volker Tresp