中文
相关论文

相关论文: Sculpting Memory: Multi-Concept Forgetting in Diff…

200 篇论文

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

多媒体 · 计算机科学 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

How can we effectively unlearn selected concepts from pre-trained generative foundation models without resorting to extensive retraining? This research introduces `continual unlearning', a novel paradigm that enables the targeted removal of…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Kartik Thakral , Tamar Glaser , Tal Hassner , Mayank Vatsa , Richa Singh

Despite the impressive capabilities of generating images, text-to-image diffusion models are susceptible to producing undesirable outputs such as NSFW content and copyrighted artworks. To address this issue, recent studies have focused on…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Tianyun Yang , Juan Cao , Chang Xu

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

Diffusion models have dramatically advanced text-to-image generation in recent years, translating abstract concepts into high-fidelity images with remarkable ease. In this work, we examine whether they can also blend distinct concepts,…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Lorenzo Olearo , Giorgio Longari , Alessandro Raganato , Rafael Peñaloza , Simone Melzi

In this paper, we investigate knowledge forgetting in large language models with a focus on its generalisation, ensuring that models forget not only specific training samples but also related implicit knowledge. To this end, we begin by…

计算与语言 · 计算机科学 2025-10-10 Huazheng Wang , Yongcheng Jing , Haifeng Sun , Yingjie Wang , Jingyu Wang , Jianxin Liao , Dacheng Tao

The past a few years have witnessed the great success of large language models, demonstrating powerful capabilities in comprehending textual data and generating human-like languages. Large language models achieve success by being trained on…

计算与语言 · 计算机科学 2025-03-20 Estrid He , Tabinda Sarwar , Ibrahim Khalil , Xun Yi , Ke Wang

Diffusion models excel at generating high-quality, diverse images but suffer from training data memorization, raising critical privacy and safety concerns. Data unlearning has emerged to mitigate this issue by removing the influence of…

机器学习 · 计算机科学 2026-03-31 Qitan Shi , Cheng Jin , Jiawei Zhang , Yuantao Gu

While modern diffusion models excel at generating high-quality and diverse images, they still struggle with high-fidelity compositional and multimodal control, particularly when users simultaneously specify text prompts, subject references,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yusuf Dalva , Guocheng Gordon Qian , Maya Goldenberg , Tsai-Shien Chen , Kfir Aberman , Sergey Tulyakov , Pinar Yanardag , Kuan-Chieh Jackson Wang

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Beyond high-fidelity image synthesis, diffusion models have recently exhibited promising results in dense visual perception tasks. However, most existing work treats diffusion models as a standalone component for perception tasks, employing…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Shuhong Zheng , Zhipeng Bao , Ruoyu Zhao , Martial Hebert , Yu-Xiong Wang

Recent advances in multimodal large language models (MLLMs) have enabled image-based question-answering capabilities. However, a key limitation is the use of CLIP as the visual encoder; while it can capture coarse global information, it…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Vatsal Agarwal , Matthew Gwilliam , Gefen Kohavi , Eshan Verma , Daniel Ulbricht , Abhinav Shrivastava

Integrating multiple personalized concepts into a single image has recently gained attention in text-to-image (T2I) generation. However, existing methods often suffer from performance degradation in complex scenes due to distortions in…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Young Beom Woo , Sun Eung Kim , Seong-Whan Lee

Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in knowledge unlearning involve updating LLM parameters to erase…

计算与语言 · 计算机科学 2024-10-08 Bozhong Tian , Xiaozhuan Liang , Siyuan Cheng , Qingbin Liu , Mengru Wang , Dianbo Sui , Xi Chen , Huajun Chen , Ningyu Zhang

For a responsible and safe deployment of diffusion models in various domains, regulating the generated outputs from these models is desirable because such models could generate undesired, violent, and obscene outputs. To tackle this…

机器学习 · 计算机科学 2026-03-24 Subhodip Panda , Varun M S , Shreyans Jain , Sarthak Kumar Maharana , Prathosh A. P

Remarkable progress in text-to-image diffusion models has brought a major concern about potentially generating images on inappropriate or trademarked concepts. Concept erasing has been investigated with the goals of deleting target concepts…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Byung Hyun Lee , Sungjin Lim , Seunggyu Lee , Dong Un Kang , Se Young Chun

This work delves into the complexities of machine unlearning in the face of distributional shifts, particularly focusing on the challenges posed by non-uniform feature and label removal. With the advent of regulations like the GDPR…

机器学习 · 计算机科学 2024-03-14 Ling Han , Nanqing Luo , Hao Huang , Jing Chen , Mary-Anne Hartley

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

计算机视觉与模式识别 · 计算机科学 2021-01-22 Umberto Michieli , Pietro Zanuttigh

While recent developments in text-to-image generative models have led to a suite of high-performing methods capable of producing creative imagery from free-form text, there are several limitations. By analyzing the cross-attention…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Aishwarya Agarwal , Srikrishna Karanam , K J Joseph , Apoorv Saxena , Koustava Goswami , Balaji Vasan Srinivasan

Incremental learning targets at achieving good performance on new categories without forgetting old ones. Knowledge distillation has been shown critical in preserving the performance on old classes. Conventional methods, however,…

计算机视觉与模式识别 · 计算机科学 2020-09-08 Peng Zhou , Long Mai , Jianming Zhang , Ning Xu , Zuxuan Wu , Larry S. Davis