English
Related papers

Related papers: A Single Neuron Works: Precise Concept Erasure in …

200 papers

In the evolving landscape of text-to-image (T2I) diffusion models, the remarkable capability to generate high-quality images from textual descriptions faces challenges with the potential misuse of reproducing sensitive content. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Changhoon Kim , Kyle Min , Yezhou Yang

Recently, autoregressive image generation models have wowed audiences with their remarkable capability in creating surprisingly realistic images. Models such as GPT-4o and LlamaGen can not only produce images that faithfully mimic renowned…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Chao Gong , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

Text-only training provides an attractive approach to address data scarcity challenges in zero-shot image captioning (ZIC), avoiding the expense of collecting paired image-text annotations. However, although these approaches perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Zimao Lu , Hui Xu , Bing Liu , Ke Wang

Recent advances in generative models have demonstrated remarkable capabilities in producing high-quality images, but their reliance on large-scale unlabeled data has raised significant safety and copyright concerns. Efforts to address these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yang Zhang , Er Jin , Yanfei Dong , Yixuan Wu , Philip Torr , Ashkan Khakzar , Johannes Stegmaier , Kenji Kawaguchi

The rapid expansion of large-scale text-to-image diffusion models has raised growing concerns regarding their potential misuse in creating harmful or misleading content. In this paper, we introduce MACE, a finetuning framework for the task…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shilin Lu , Zilan Wang , Leyang Li , Yanzhu Liu , Adams Wai-Kin Kong

Text guided diffusion models are used by millions of users, but can be easily exploited to produce harmful content. Concept unlearning methods aim at reducing the models' likelihood of generating harmful content. Traditionally, this has…

Artificial Intelligence · Computer Science 2026-02-10 Mansi , Avinash Kori , Francesca Toni , Soteris Demetriou

Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept-layer topological alignment, under which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yiwei Xie , Ping Liu , Zheng Zhang

Text-to-image diffusion models have shown an impressive ability to generate high-quality images from input textual descriptions. However, concerns have been raised about the potential for these models to create content that infringes on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tingxu Han , Weisong Sun , Yanrong Hu , Chunrong Fang , Yonglong Zhang , Shiqing Ma , Tao Zheng , Zhenyu Chen , Zhenting Wang

Large-scale image generation models, with impressive quality made possible by the vast amount of data available on the Internet, raise social concerns that these models may generate harmful or copyrighted content. The biases and harmfulness…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Sanghyun Kim , Seohyeon Jung , Balhae Kim , Moonseok Choi , Jinwoo Shin , Juho Lee

Brain lesion and anatomy segmentation in magnetic resonance images are fundamental tasks in neuroimaging research and clinical practice. Given enough training data, convolutional neuronal networks (CNN) proved to outperform all existent…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Nicolas Roulet , Diego Fernandez Slezak , Enzo Ferrante

The recent proliferation of large-scale text-to-image models has led to growing concerns that such models may be misused to generate harmful, misleading, and inappropriate content. Motivated by this issue, we derive a technique inspired by…

Machine Learning · Computer Science 2023-10-18 Alvin Heng , Harold Soh

The unlearning problem of deep learning models, once primarily an academic concern, has become a prevalent issue in the industry. The significant advances in text-to-image generation techniques have prompted global discussions on privacy,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Eric Zhang , Kai Wang , Xingqian Xu , Zhangyang Wang , Humphrey Shi

Erasing concepts from large-scale text-to-image (T2I) diffusion models has become increasingly crucial due to the growing concerns over copyright infringement, offensive content, and privacy violations. In scalable applications,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ouxiang Li , Yuan Wang , Xinting Hu , Houcheng Jiang , Yanbin Hao , Fuli Feng

The inherent ambiguity in defining visual concepts poses significant challenges for modern generative models, such as the diffusion-based Text-to-Image (T2I) models, in accurately learning concepts from a single image. Existing methods lack…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fernando Julio Cendra , Kai Han

Prior work suggests that neural networks tend to learn low-order moments of the data distribution first, before moving on to higher-order correlations. In this work, we derive a novel closed-form concept erasure method, QLEACE, which…

Machine Learning · Computer Science 2025-02-06 Lucia Quirke , Nora Belrose

Unlearning specific concepts in text-to-image diffusion models has become increasingly important for preventing undesirable content generation. Among prior approaches, sparse autoencoder (SAE)-based methods have attracted attention due to…

Machine Learning · Computer Science 2026-05-13 Hyeonjin Kim , Hangyeol Jung , Heechan Yun , Sungjun Yun , Dong-Jun Han

Recent text-to-image models have achieved impressive results in generating high-quality images. However, when tasked with multi-concept generation creating images that contain multiple characters or objects, existing methods often suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yang Zhang , Rui Zhang , Xuecheng Nie , Haochen Li , Jikun Chen , Yifan Hao , Xin Zhang , Luoqi Liu , Ling Li

Text-to-image diffusion models have demonstrated remarkable capabilities in generating high-quality images, yet their tendency to reproduce undesirable concepts, such as NSFW content, copyrighted styles, or specific objects, poses growing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zhiqi Zhang , Xinhao Zhong , Yi Sun , Shuoyang Sun , Bin Chen , Shu-Tao Xia , Xuan Wang

Modern neural networks often encode unwanted concepts alongside task-relevant information, leading to fairness and interpretability concerns. Existing post-hoc approaches can remove undesired concepts but often degrade useful signals. We…

Machine Learning · Computer Science 2025-11-17 Floris Holstege , Shauli Ravfogel , Bram Wouters

Recent advances in text-to-image (T2I) diffusion models have seen rapid and widespread adoption. However, their powerful generative capabilities raise concerns about potential misuse for synthesizing harmful, private, or copyrighted…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Uichan Lee , Jeonghyeon Kim , Sangheum Hwang