English
Related papers

Related papers: Efficient Input-level Backdoor Defense on Text-to-…

200 papers

Recent advances in text-to-image (T2I) diffusion models have significantly improved the quality of generated images. However, providing efficient control over individual subjects, particularly the attributes characterizing them, remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Stefan Andreas Baumann , Felix Krause , Michael Neumayr , Nick Stracke , Melvin Sevi , Vincent Tao Hu , Björn Ommer

Image-to-Video (I2V) generation synthesizes dynamic visual content from image and text inputs, providing significant creative control. However, the security of such multimodal systems, particularly their vulnerability to jailbreak attacks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Songping Wang , Rufan Qian , Yueming Lyu , Qinglong Liu , Linzhuang Zou , Jie Qin , Songhua Liu , Caifeng Shan

Recent deep-learning-based compression methods have achieved superior performance compared with traditional approaches. However, deep learning models have proven to be vulnerable to backdoor attacks, where some specific trigger patterns…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yi Yu , Yufei Wang , Wenhan Yang , Shijian Lu , Yap-peng Tan , Alex C. Kot

Text-to-Image (T2I) models have advanced significantly, but their growing popularity raises security concerns due to their potential to generate harmful images. To address these issues, we propose UPAM, a novel framework to evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Duo Peng , Qiuhong Ke , Mark He Huang , Ping Hu , Jun Liu

This paper investigates how Backdoor Attacks are represented within Vision Transformers (ViTs). By assuming knowledge of the trigger, we identify a specific ``trigger direction'' in the model's activations that corresponds to the internal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Sengim Karayalcin , Marina Krcek , Pin-Yu Chen , Stjepan Picek

Model Inversion (MI) attacks pose a significant threat to the privacy of Deep Neural Networks by recovering training data distribution from well-trained models. While existing defenses often rely on regularization techniques to reduce…

Cryptography and Security · Computer Science 2024-11-26 Zhen-Ting Liu , Shang-Tse Chen

Text-to-visualization (text-to-vis) models for tabular data have become essential tools in the era of big data, enabling users to generate visualizations and make data-driven decisions through natural language queries (NLQs). Despite their…

Cryptography and Security · Computer Science 2026-03-11 Shuaimin Li , Chen Jason Zhang , Xuanang Chen , Anni Peng , Zhuoyue Wan , Yuanfeng Song , Shiwen Ni , Min Yang , Fei Hao , Raymond Chi-Wing Wong

Recent advancements in controllable text-to-image (T2I) diffusion models, such as Ctrl-X and FreeControl, have demonstrated robust spatial and appearance control without requiring auxiliary module training. However, these models often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jiwon Kim , Pureum Kim , SeonHwa Kim , Soobin Park , Eunju Cha , Kyong Hwan Jin

Vision Transformers (ViTs) have become popular in computer vision tasks. Backdoor attacks, which trigger undesirable behaviours in models during inference, threaten ViTs' performance, particularly in security-sensitive tasks. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Michael Li

Deep neural networks (DNNs) are vulnerable to backdoor attacks. The backdoor adversaries intend to maliciously control the predictions of attacked DNNs by injecting hidden backdoors that can be activated by adversary-specified trigger…

Cryptography and Security · Computer Science 2023-03-07 Tong Xu , Yiming Li , Yong Jiang , Shu-Tao Xia

Backdoor attacks pose a critical threat by embedding hidden triggers into inputs, causing models to misclassify them into target labels. While extensive research has focused on mitigating these attacks in object recognition models through…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Kyle Stein , Andrew Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Recent progress in text-to-image (T2I) models enables high-quality image generation with flexible textual control. To utilize the abundant visual priors in the off-the-shelf T2I models, a series of methods try to invert an image to proper…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Zijie Wu , Chaohui Yu , Zhen Zhu , Fan Wang , Xiang Bai

Over the past few years, the emergence of backdoor attacks has presented significant challenges to deep learning systems, allowing attackers to insert backdoors into neural networks. When data with a trigger is processed by a backdoor…

Cryptography and Security · Computer Science 2025-03-07 Haiyang Yu , Tian Xie , Jiaping Gui , Pengyang Wang , Ping Yi , Yue Wu

Text-to-image (T2I) generation has been actively studied using Diffusion Models and Autoregressive Models. Recently, Masked Generative Transformers have gained attention as an alternative to Autoregressive Models to overcome the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Wonjun Kang , Byeongkeun Ahn , Minjae Lee , Kevin Galim , Seunghyuk Oh , Hyung Il Koo , Nam Ik Cho

Ultrasound images acquired from different devices exhibit diverse styles, resulting in decreased performance of downstream tasks. To mitigate the style gap, unpaired image-to-image (UI2I) translation methods aim to transfer images from a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Nhat-Tuong Do-Tran , Ngoc-Hoang-Lam Le , Ian Chiu , Po-Tsun Paul Kuo , Ching-Chun Huang

The issue of generative pretraining for vision models has persisted as a long-standing conundrum. At present, the text-to-image (T2I) diffusion model demonstrates remarkable proficiency in generating high-definition images matching textual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Qiang Wan , Zilong Huang , Bingyi Kang , Jiashi Feng , Li Zhang

Dataset distillation has emerged as a prominent technique to improve data efficiency when training machine learning models. It encapsulates the knowledge from a large dataset into a smaller synthetic dataset. A model trained on this smaller…

Cryptography and Security · Computer Science 2023-01-04 Yugeng Liu , Zheng Li , Michael Backes , Yun Shen , Yang Zhang

Text-guided image-to-video (I2V) generation aims to generate a coherent video that preserves the identity of the input image and semantically aligns with the input prompt. Existing methods typically augment pretrained text-to-video (T2V)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xun Guo , Mingwu Zheng , Liang Hou , Yuan Gao , Yufan Deng , Pengfei Wan , Di Zhang , Yufan Liu , Weiming Hu , Zhengjun Zha , Haibin Huang , Chongyang Ma

Text-to-image (T2I) diffusion models have achieved impressive image generation quality and are increasingly fine-tuned for personalized applications. However, these models often inherit unsafe behaviors from toxic pretraining data, raising…

Machine Learning · Computer Science 2025-12-09 Boheng Li , Renjie Gu , Junjie Wang , Leyi Qi , Yiming Li , Run Wang , Zhan Qin , Tianwei Zhang

Although deep neural networks (DNNs) have achieved a great success in various computer vision tasks, it is recently found that they are vulnerable to adversarial attacks. In this paper, we focus on the so-called \textit{backdoor attack},…

Cryptography and Security · Computer Science 2025-03-27 Hao Cheng , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Pu Zhao , Xue Lin