English
Related papers

Related papers: TaCo: Targeted Concept Erasure Prevents Non-Linear…

200 papers

Recent work has explored how to train machine learning models which do not discriminate against any subgroup of the population as determined by sensitive attributes such as gender or race. To avoid disparate treatment, sensitive attributes…

Machine Learning · Statistics 2018-09-06 Niki Kilbertus , Adrià Gascón , Matt J. Kusner , Michael Veale , Krishna P. Gummadi , Adrian Weller

Concept erasure in text-to-image diffusion models aims to disable pre-trained diffusion models from generating images related to a target concept. To perform reliable concept erasure, the properties of robustness and locality are desirable.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Chi-Pin Huang , Kai-Po Chang , Chung-Ting Tsai , Yung-Hsuan Lai , Fu-En Yang , Yu-Chiang Frank Wang

One of the pursued objectives of deep learning is to provide tools that learn abstract representations of reality from the observation of multiple contextual situations. More precisely, one wishes to extract disentangled representations…

Machine Learning · Computer Science 2023-10-24 Pierre Colombo , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

Methods for erasing human-interpretable concepts from neural representations that assume linearity have been found to be tractable and useful. However, the impact of this removal on the behavior of downstream classifiers trained on the…

Machine Learning · Computer Science 2024-05-14 Shauli Ravfogel , Yoav Goldberg , Ryan Cotterell

We address the problem of concept removal in deep neural networks, aiming to learn representations that do not encode certain specified concepts (e.g., gender etc.) We propose a novel method based on adversarial linear classifiers trained…

Machine Learning · Computer Science 2023-10-10 Yegor Klochkov , Jean-Francois Ton , Ruocheng Guo , Yang Liu , Hang Li

Text-to-Image (T2I) models have made remarkable progress in generating high-quality, diverse visual content from natural language prompts. However, their ability to reproduce copyrighted styles, sensitive imagery, and harmful content raises…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Changhoon Kim , Yanjun Qi

Existing concept erasure methods for text-to-image diffusion models commonly rely on fixed anchor strategies, which often lead to critical issues such as concept re-emergence and erosion. To address this, we conduct causal tracing to reveal…

Artificial Intelligence · Computer Science 2025-10-21 Tong Zhang , Ru Zhang , Jianyi Liu , Zhen Yang , Gongshen Liu

Concept erasure aims to remove specified features from an embedding. It can improve fairness (e.g. preventing a classifier from using gender or race) and interpretability (e.g. removing a concept to observe changes in model behavior). We…

Machine Learning · Computer Science 2025-04-04 Nora Belrose , David Schneider-Joseph , Shauli Ravfogel , Ryan Cotterell , Edward Raff , Stella Biderman

Text-to-image diffusion models have shown unprecedented generative capability, but their ability to produce undesirable concepts (e.g.~pornographic content, sensitive identities, copyrighted styles) poses serious concerns for privacy,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Finn Carter

Text-to-image generative models can produce photo-realistic images for an extremely broad range of concepts, and their usage has proliferated widely among the general public. On the flip side, these models have numerous drawbacks, including…

Machine Learning · Computer Science 2023-10-10 Minh Pham , Kelly O. Marshall , Niv Cohen , Govind Mittal , Chinmay Hegde

To what extent does concept erasure eliminate generative capacity in diffusion models? While prior evaluations have primarily focused on measuring concept suppression under specific textual prompts, we explore a complementary and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Ping Liu , Chi Zhang

Recent advance in text-to-image diffusion models have significantly facilitated the generation of high-quality images, but also raising concerns about the illegal creation of harmful content, such as copyrighted images. Existing concept…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Zihao Wang , Yuxiang Wei , Fan Li , Renjing Pei , Hang Xu , Wangmeng Zuo

Machine learning models are extensively being used to make decisions that have a significant impact on human life. These models are trained over historical data that may contain information about sensitive attributes such as race, sex,…

Machine Learning · Computer Science 2020-10-22 Ramanujam Madhavan , Mohit Wadhwa

The emergence of large-scale pretrained language models has posed unprecedented challenges in deriving explanations of why the model has made some predictions. Stemmed from the compositional nature of languages, spurious correlations have…

Computation and Language · Computer Science 2023-05-04 Ruochen Zhao , Shafiq Joty , Yongjie Wang , Tan Wang

Modern neural networks often encode unwanted concepts alongside task-relevant information, leading to fairness and interpretability concerns. Existing post-hoc approaches can remove undesired concepts but often degrade useful signals. We…

Machine Learning · Computer Science 2025-11-17 Floris Holstege , Shauli Ravfogel , Bram Wouters

Optimizing NLP models for fairness poses many challenges. Lack of differentiable fairness measures prevents gradient-based loss training or requires surrogate losses that diverge from the true metric of interest. In addition, competing…

Computation and Language · Computer Science 2025-06-19 Soumyajit Gupta , Venelin Kovatchev , Anubrata Das , Maria De-Arteaga , Matthew Lease

As text-to-image diffusion models grow increasingly prevalent, the ability to remove specific concepts-mostly explicit content and many copyrighted characters or styles-has become essential for safety and compliance. Existing unlearning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Junyeong Ahn , Seojin Yoon , Sungyong Baik

Text-to-Image models such as Stable Diffusion have shown impressive image generation synthesis, thanks to the utilization of large-scale datasets. However, these datasets may contain sexually explicit, copyrighted, or undesirable content,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Seunghoo Hong , Juhun Lee , Simon S. Woo

The exceptional generative capability of text-to-image models has raised substantial safety concerns regarding the generation of Not-Safe-For-Work (NSFW) content and potential copyright infringement. To address these concerns, previous…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Feng Han , Kai Chen , Chao Gong , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

State-of-the-art NLP methods achieve human-like performance on many tasks, but make errors nevertheless. Characterizing these errors in easily interpretable terms gives insight into whether a classifier is prone to making systematic errors,…

Computation and Language · Computer Science 2023-11-21 Michael A. Hedderich , Jonas Fischer , Dietrich Klakow , Jilles Vreeken