English
Related papers

Related papers: BadVideo: Stealthy Backdoor Attack against Text-to…

200 papers

Vision Language Models (VLMs) have shown remarkable performance, but are also vulnerable to backdoor attacks whereby the adversary can manipulate the model's outputs through hidden triggers. Prior attacks primarily rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zhiyuan Zhong , Zhen Sun , Yepang Liu , Xinlei He , Guanhong Tao

The growing application of large language models (LLMs) in safety-critical domains has raised urgent concerns about their security. Many recent studies have demonstrated the feasibility of backdoor attacks against LLMs. However, existing…

Cryptography and Security · Computer Science 2026-04-24 Jiali Wei , Ming Fan , Guoheng Sun , Xicheng Zhang , Haijun Wang , Ting Liu

Video generation is a challenging yet pivotal task in various industries, such as gaming, e-commerce, and advertising. One significant unresolved aspect within T2V is the effective visualization of text within generated videos. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Lin Liu , Quande Liu , Shengju Qian , Yuan Zhou , Wengang Zhou , Houqiang Li , Lingxi Xie , Qi Tian

Existing text-to-video (T2V) models often struggle with generating videos with sufficiently pronounced or complex actions. A key limitation lies in the text prompt's inability to precisely convey intricate motion details. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Qiang Zhou , Shaofeng Zhang , Nianzu Yang , Ye Qian , Hao Li

Multimodal pretrained models are vulnerable to backdoor attacks, yet most existing methods rely on visual or multimodal triggers, which are impractical since visually embedded triggers rarely occur in real-world data. To overcome this…

Cryptography and Security · Computer Science 2026-04-08 Yiyang Zhang , Chaojian Yu , Ziming Hong , Yuanjie Shao , Qinmu Peng , Tongliang Liu , Xinge You

Visual State Space Models (VSSM) have shown remarkable performance in various computer vision tasks. However, backdoor attacks pose significant security challenges, causing compromised models to predict target labels when specific triggers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Cheng-Yi Lee , Yu-Hsuan Chiang , Zhong-You Wu , Chia-Mu Yu , Chun-Shien Lu

Although recent personalization methods have democratized high-resolution image synthesis by enabling swift concept acquisition with minimal examples and lightweight computation, they also present an exploitable avenue for high accessible…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yihao Huang , Felix Juefei-Xu , Qing Guo , Jie Zhang , Yutong Wu , Ming Hu , Tianlin Li , Geguang Pu , Yang Liu

Text-to-video generation has advanced rapidly, but existing methods typically output only the final composited video and lack editable layered representations, limiting their use in professional workflows. We propose \textbf{LayerT2V}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Guangzhao Li , Kangrui Cen , Baixuan Zhao , Yi Xin , Siqi Luo , Guangtao Zhai , Lei Zhang , Xiaohong Liu

Recent advances in text-to-video (T2V) generation highlight the critical role of high-quality video-text pairs in training models capable of producing coherent and instruction-aligned videos. However, strategies for optimizing video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yang Du , Zhuoran Lin , Kaiqiang Song , Biao Wang , Zhicheng Zheng , Tiezheng Ge , Bo Zheng , Qin Jin

Despite remarkable successes in unimodal learning tasks, backdoor attacks against cross-modal learning are still underexplored due to the limited generalization and inferior stealthiness when involving multiple modalities. Notably, since…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Zheng Zhang , Xu Yuan , Lei Zhu , Jingkuan Song , Liqiang Nie

Robust and imperceptible adversarial video attack is challenging due to the spatial and temporal characteristics of videos. The existing video adversarial attack methods mainly take a gradient-based approach and generate adversarial videos…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yi Pan , Jun-Jie Huang , Zihan Chen , Wentao Zhao , Ziyue Wang

The current text-to-video (T2V) generation has made significant progress in synthesizing realistic general videos, but it is still under-explored in identity-specific human video generation with customized ID images. The key challenge lies…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hengjia Li , Haonan Qiu , Shiwei Zhang , Xiang Wang , Yujie Wei , Zekun Li , Yingya Zhang , Boxi Wu , Deng Cai

Recent advances in Text-to-Video generation (T2V) have achieved remarkable success in synthesizing high-quality general videos from textual descriptions. A largely overlooked problem in T2V is that existing models have not adequately…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shenghai Yuan , Jinfa Huang , Yujun Shi , Yongqi Xu , Ruijie Zhu , Bin Lin , Xinhua Cheng , Li Yuan , Jiebo Luo

Video generation has increasingly gained interest in both academia and industry. Although commercial tools can generate plausible videos, there is a limited number of open-source models available for researchers and engineers. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Haoxin Chen , Menghan Xia , Yingqing He , Yong Zhang , Xiaodong Cun , Shaoshu Yang , Jinbo Xing , Yaofang Liu , Qifeng Chen , Xintao Wang , Chao Weng , Ying Shan

We present a method to create diffusion-based video models from pretrained Text-to-Image (T2I) models. Recently, AnimateDiff proposed freezing the T2I model while only training temporal layers. We advance this method by proposing a unique…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Mingi Kwon , Seoung Wug Oh , Yang Zhou , Difan Liu , Joon-Young Lee , Haoran Cai , Baqiao Liu , Feng Liu , Youngjung Uh

While diffusion models have shown impressive performance in 2D image/video generation, diffusion-based Text-to-Multi-view-Video (T2MVid) generation remains underexplored. The new challenges posed by T2MVid generation lie in the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Bing Li , Cheng Zheng , Wenxuan Zhu , Jinjie Mai , Biao Zhang , Peter Wonka , Bernard Ghanem

Recent advances in text-to-video (T2V) diffusion models have significantly enhanced the quality of generated videos. However, their capability to produce explicit or harmful content introduces new challenges related to misuse and potential…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xiaoyu Ye , Songjie Cheng , Yongtao Wang , Yajiao Xiong , Yishen Li

Text-to-video (T2V) generative models have advanced significantly, yet their ability to compose different objects, attributes, actions, and motions into a video remains unexplored. Previous text-to-video benchmarks also neglect this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Kaiyue Sun , Kaiyi Huang , Xian Liu , Yue Wu , Zihan Xu , Zhenguo Li , Xihui Liu

Diffusion models (DMs) have revolutionized data generation, particularly in text-to-image (T2I) synthesis. However, the widespread use of personalized generative models raises significant concerns regarding privacy violations and copyright…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xinwei Liu , Xiaojun Jia , Yuan Xun , Hua Zhang , Xiaochun Cao

Prompt-driven Video Segmentation Foundation Models (VSFMs), such as SAM2, are increasingly used in applications including autonomous driving and digital pathology, yet their security risks remain underexplored. We study backdoor attacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zongmin Zhang , Zhen Sun , Yifan Liao , Wenhan Dong , Xinlei He , Xingshuo Han , Shengmin Xu , Xinyi Huang