中文
相关论文

相关论文: Neighbor-Aware Localized Concept Erasure in Text-t…

200 篇论文

Prior work suggests that neural networks tend to learn low-order moments of the data distribution first, before moving on to higher-order correlations. In this work, we derive a novel closed-form concept erasure method, QLEACE, which…

机器学习 · 计算机科学 2025-02-06 Lucia Quirke , Nora Belrose

Lifelong few-shot customization for text-to-image diffusion aims to continually generalize existing models for new tasks with minimal data while preserving old knowledge. Current customization diffusion models excel in few-shot tasks but…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Nan Song , Xiaofeng Yang , Ze Yang , Guosheng Lin

How can we effectively unlearn selected concepts from pre-trained generative foundation models without resorting to extensive retraining? This research introduces `continual unlearning', a novel paradigm that enables the targeted removal of…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Kartik Thakral , Tamar Glaser , Tal Hassner , Mayank Vatsa , Richa Singh

Text-to-image diffusion models have made significant advancements in generating high-quality, diverse images from text prompts. However, the inherent limitations of textual signals often prevent these models from fully capturing specific…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Ziqiang Li , Jun Li , Lizhi Xiong , Zhangjie Fu , Zechao Li

With the advancement of image-to-image diffusion models guided by text, significant progress has been made in image editing. However, a persistent challenge remains in seamlessly incorporating objects into images based on textual…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Jia Li , Lijie Hu , Zhixian He , Jingfeng Zhang , Tianhang Zheng , Di Wang

Concept unlearning aims to erase a target concept from a pretrained text-to-image diffusion model without retraining. Closed-form methods are attractive in this setting because they apply a single deterministic edit to the cross-attention…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Saemi Moon , Suhyeon Jun , Seoyeon Lee , Dongwoo Kim

Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However,…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Rohit Gandikota , Hadas Orgad , Yonatan Belinkov , Joanna Materzyńska , David Bau

In the evolving landscape of text-to-image (T2I) diffusion models, the remarkable capability to generate high-quality images from textual descriptions faces challenges with the potential misuse of reproducing sensitive content. To address…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Changhoon Kim , Kyle Min , Yezhou Yang

Concept unlearning in diffusion models is hampered by feature splitting, where concepts are distributed across many latent features, making their removal challenging and computationally expensive. We introduce SAEmnesia, a supervised sparse…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Enrico Cassano , Riccardo Renzulli , Marco Nurisso , Mirko Zaffaroni , Alan Perotti , Marco Grangetto

The proliferation of text-to-image diffusion models has raised significant privacy and security concerns, particularly regarding the generation of copyrighted or harmful images. In response, concept erasure (defense) methods have been…

机器学习 · 计算机科学 2025-10-06 Alex D. Richardson , Kaicheng Zhang , Lucas Beerens , Dongdong Chen

Autoregressive (AR) models have achieved unified and strong performance across both visual understanding and image generation tasks. However, removing undesired concepts from AR models while maintaining overall generation quality remains an…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Haipeng Fan , Shiyuan Zhang , Baohunesitu , Zihang Guo , Huaiwen Zhang

Identifying layers within text-to-image models which control visual attributes can facilitate efficient model editing through closed-form updates. Recent work, leveraging causal tracing show that early Stable-Diffusion variants confine…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Samyadeep Basu , Keivan Rezaei , Priyatham Kattakinda , Ryan Rossi , Cherry Zhao , Vlad Morariu , Varun Manjunatha , Soheil Feizi

Diffusion models have demonstrated remarkable capability in generating high-quality visual content from textual descriptions. However, since these models are trained on large-scale internet data, they inevitably learn undesirable concepts,…

机器学习 · 计算机科学 2025-02-18 Anh Bui , Khanh Doan , Trung Le , Paul Montague , Tamas Abraham , Dinh Phung

Concept erasure serves as a vital safety mechanism for removing unwanted concepts from text-to-image (T2I) models. While extensively studied in U-Net and dual-stream architectures (e.g., Flux), this task remains under-explored in the recent…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Nanxiang Jiang , Zhaoxin Fan , Baisen Wang , Daiheng Gao , Junhang Cheng , Jifeng Guo , Yalan Qin , Yeying Jin , Hongwei Zheng , Faguo Wu , Wenjun Wu

Machine unlearning for text-to-image diffusion models aims to selectively remove undesirable concepts from pre-trained models without costly retraining. Current unlearning methods share a common weakness: erased concepts return when the…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Aljalila Aladawi , Mohammed Talha Alam , Fakhri Karray

Learning discriminative image feature embeddings is of great importance to visual recognition. To achieve better feature embeddings, most current methods focus on designing different network structures or loss functions, and the estimated…

计算机视觉与模式识别 · 计算机科学 2019-08-15 Suichan Li , Dapeng Chen , Bin Liu , Nenghai Yu , Rui Zhao

Recent advances in text-to-video (T2V) diffusion models have significantly enhanced the quality of generated videos. However, their capability to produce explicit or harmful content introduces new challenges related to misuse and potential…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Xiaoyu Ye , Songjie Cheng , Yongtao Wang , Yajiao Xiong , Yishen Li

The unlearning problem of deep learning models, once primarily an academic concern, has become a prevalent issue in the industry. The significant advances in text-to-image generation techniques have prompted global discussions on privacy,…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Eric Zhang , Kai Wang , Xingqian Xu , Zhangyang Wang , Humphrey Shi

Text-to-Image (T2I) models have demonstrated impressive capabilities in generating high-quality and diverse visual content from natural language prompts. However, uncontrolled reproduction of sensitive, copyrighted, or harmful imagery poses…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Yiwei Xie , Ping Liu , Zheng Zhang

Large text-to-image models have revolutionized the ability to generate imagery using natural language. However, particularly unique or personal visual concepts, such as pets and furniture, will not be captured by the original model. This…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Xingzhe He , Zhiwen Cao , Nicholas Kolkin , Lantao Yu , Kun Wan , Helge Rhodin , Ratheesh Kalarot