中文
相关论文

相关论文: Erasing Undesirable Concepts in Diffusion Models w…

200 篇论文

Diffusion based text-to-image models are trained on large datasets scraped from the Internet, potentially containing unacceptable concepts (e.g., copyright-infringing or unsafe). We need concept removal techniques (CRTs) which are i)…

计算机视觉与模式识别 · 计算机科学 2025-02-27 Anudeep Das , Vasisht Duddu , Rui Zhang , N. Asokan

Object detection is fundamental to various real-world applications, such as security monitoring and surveillance video analysis. Despite their advancements, state-of-the-art object detectors are still vulnerable to adversarial patch…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Jin Ma , Mohammed Aldeen , Christopher Salas , Feng Luo , Mashrur Chowdhury , Mert Pesé , Long Cheng

Text-to-Image synthesis is the task of generating an image according to a specific text description. Generative Adversarial Networks have been considered the standard method for image synthesis virtually since their introduction. Denoising…

Text-to-image generative models can produce photo-realistic images for an extremely broad range of concepts, and their usage has proliferated widely among the general public. On the flip side, these models have numerous drawbacks, including…

机器学习 · 计算机科学 2023-10-10 Minh Pham , Kelly O. Marshall , Niv Cohen , Govind Mittal , Chinmay Hegde

Ensuring that neural models used in real-world applications cannot infer sensitive information, such as demographic attributes like gender or race, from text representations is a critical challenge when fairness is a concern. We address…

机器学习 · 计算机科学 2025-08-19 Antoine Saillenfest , Pirmin Lemberger

Recent advances in diffusion generative models have yielded remarkable progress. While the quality of generated content continues to improve, these models have grown considerably in size and complexity. This increasing computational burden…

机器学习 · 计算机科学 2025-03-13 Reza Shirkavand , Peiran Yu , Shangqian Gao , Gowthami Somepalli , Tom Goldstein , Heng Huang

Text-to-image diffusion models have revolutionized generative AI, but their vulnerability to backdoor attacks poses significant security risks. Adversaries can inject imperceptible textual triggers into training data, causing models to…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Ashwath Vaithinathan Aravindan , Abha Jha , Matthew Salaway , Atharva Sandeep Bhide , Duygu Nur Yaldiz

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

机器学习 · 计算机科学 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Concept erasure has emerged as a promising approach to mitigate undesired or unsafe content in diffusion models, yet existing methods still face significant limitations. While training-based methods are effective, their high computational…

人工智能 · 计算机科学 2026-05-29 Yuhao Sun , Lingyun Yu , Haoxiang Xu , Fengyuan Miao , Zhuoer Xu , Hongtao Xie

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad

Text-to-image (T2I) diffusion models have shown exceptional capabilities in generating images that closely correspond to textual prompts. However, the advancement of T2I diffusion models presents significant risks, as the models could be…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Jie Ren , Kangrui Chen , Yingqian Cui , Shenglai Zeng , Hui Liu , Yue Xing , Jiliang Tang , Lingjuan Lyu

Diffusion models have demonstrated impressive capabilities in synthesizing diverse content. However, despite their high-quality outputs, these models often perpetuate social biases, including those related to gender and race. These biases…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Yingdong Shi , Changming Li , Yifan Wang , Yongxiang Zhao , Anqi Pang , Sibei Yang , Jingyi Yu , Kan Ren

In this paper, we propose TextDestroyer, the first training- and annotation-free method for scene text destruction using a pre-trained diffusion model. Existing scene text removal models require complex annotation and retraining, and may…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Mengcheng Li , Fei Chao

The personalized text-to-image generation has rapidly advanced with the emergence of Stable Diffusion. Existing methods, which typically fine-tune models using embedded identifiers, often struggle with insufficient stylization and…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Anran Yu , Wei Feng , Yaochen Zhang , Xiang Li , Lei Meng , Lei Wu , Xiangxu Meng

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

The rise in harmful online content not only distorts public discourse but also poses significant challenges to maintaining a healthy digital environment. In response to this, we introduce a multimodal dataset uniquely crafted for…

The fabrication of visual misinformation on the web and social media has increased exponentially with the advent of foundational text-to-image diffusion models. Namely, Stable Diffusion inpainters allow the synthesis of maliciously…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Geonho Son , Juhun Lee , Simon S. Woo

Adversarial purification is one of the promising approaches to defend neural networks against adversarial attacks. Recently, methods utilizing diffusion probabilistic models have achieved great success for adversarial purification in image…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Mingkun Zhang , Jianing Li , Wei Chen , Jiafeng Guo , Xueqi Cheng

The escalating sophistication of cyberattacks has encouraged the integration of machine learning techniques in intrusion detection systems, but the rise of adversarial examples presents a significant challenge. These crafted perturbations…

密码学与安全 · 计算机科学 2024-06-26 Mohamed Amine Merzouk , Erwan Beurier , Reda Yaich , Nora Boulahia-Cuppens , Frédéric Cuppens

Adversarial purification is a successful defense mechanism against adversarial attacks without requiring knowledge of the form of the incoming attack. Generally, adversarial purification aims to remove the adversarial perturbations…

计算与语言 · 计算机科学 2023-05-04 Linyang Li , Demin Song , Xipeng Qiu