English
Related papers

Related papers: PROBE: Diagnosing Residual Concept Capacity in Era…

200 papers

Concept erasure helps stop diffusion models (DMs) from generating harmful content; but current methods face robustness retention trade off. Robustness means the model fine-tuned by concept erasure methods resists reactivation of erased…

Machine Learning · Computer Science 2026-02-16 Fengpeng Li , Kemou Li , Qizhou Wang , Bo Han , Jiantao Zhou

Diffusion Transformer (DiT) faces challenges when generating images with higher resolution compared at training resolution, causing especially structural degradation due to attention dilution. Previous approaches attempt to mitigate this by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yihua Liu , Fanjiang Ye , Bowen Lin , Rongyu Fang , Chengming Zhang

Deployed text-to-image diffusion models increasingly require post-hoc concept unlearning for copyright claims, artist opt-outs, safety updates, and protected-content mitigation without full retraining. A central challenge is erase-retain…

Machine Learning · Computer Science 2026-05-19 Ashutosh Ranjan , Vivek Srivastava , Shirish Karande , Murari Mandal

Existing unlearning algorithms in text-to-image generative models often fail to preserve the knowledge of semantically related concepts when removing specific target concepts: a challenge known as adjacency. To address this, we propose FADE…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Kartik Thakral , Tamar Glaser , Tal Hassner , Mayank Vatsa , Richa Singh

The exceptional generative capability of text-to-image models has raised substantial safety concerns regarding the generation of Not-Safe-For-Work (NSFW) content and potential copyright infringement. To address these concerns, previous…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Feng Han , Kai Chen , Chao Gong , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

Semantic noise initialization has been reported to improve robustness and controllability in image diffusion models. Whether these gains transfer to text-to-video (T2V) generation remains unclear, since temporal coupling can introduce extra…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yixiao Jing , Chaoyu Zhang , Zixuan Zhong , Peizhou Huang

Recent text-to-image diffusion models have shown surprising performance in generating high-quality images. However, concerns have arisen regarding the unauthorized data usage during the training or fine-tuning process. One example is when a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zhenting Wang , Chen Chen , Lingjuan Lyu , Dimitris N. Metaxas , Shiqing Ma

Evaluating object removal in images and videos remains challenging because the task is inherently one-to-many, yet existing metrics frequently disagree with human perception. Full-reference metrics reward copy-paste behaviors over genuine…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Fuhao Li , Shaofeng You , Jiagao Hu , Yu Liu , Yuxuan Chen , Zepeng Wang , Fei Wang , Daiguo Zhou , Jian Luan

Despite impressive visual fidelity, current text-to-image (T2I) diffusion models struggle to depict rare, complex, or culturally nuanced concepts due to training data limitations. We introduce RAVEL, a training-free framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Kavana Venkatesh , Yusuf Dalva , Ismini Lourentzou , Pinar Yanardag

The rise of text-to-image (T2I) models has increasingly raised concerns regarding the generation of risky content, such as sexual, violent, and copyright-protected images, highlighting the need for effective safeguards within the models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Chenyu Zhang

Pre-trained language models have achieved remarkable success across diverse applications but remain susceptible to spurious, concept-driven correlations that impair robustness and fairness. In this work, we introduce CURE, a novel and…

Computation and Language · Computer Science 2025-09-11 Aysenur Kocak , Shuo Yang , Bardh Prenkaj , Gjergji Kasneci

Despite the remarkable generation capabilities of diffusion models, recent studies have shown that they can memorize and create harmful content when given specific text prompts. Although fine-tuning approaches have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Siyi Chen , Yimeng Zhang , Sijia Liu , Qing Qu

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Diffusion models have revitalized the image generation domain, playing crucial roles in both academic research and artistic expression. With the emergence of new diffusion models, assessing the performance of text-to-image models has become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chutian Meng , Fan Ma , Jiaxu Miao , Chi Zhang , Yi Yang , Yueting Zhuang

Recent advancements in text-to-image diffusion models have brought them to the public spotlight, becoming widely accessible and embraced by everyday users. However, these models have been shown to generate harmful content such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Anubhav Jain , Yuya Kobayashi , Takashi Shibuya , Yuhta Takida , Nasir Memon , Julian Togelius , Yuki Mitsufuji

Video object removal aims to eliminate target objects from videos while plausibly completing missing regions and preserving spatio-temporal consistency. Although diffusion models have recently advanced this task, it remains challenging to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Dingming Liu , Wenjing Wang , Chen Li , Jing Lyu

Recently, autoregressive image generation models have wowed audiences with their remarkable capability in creating surprisingly realistic images. Models such as GPT-4o and LlamaGen can not only produce images that faithfully mimic renowned…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Chao Gong , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

Existing concept erasure methods for text-to-image diffusion models commonly rely on fixed anchor strategies, which often lead to critical issues such as concept re-emergence and erosion. To address this, we conduct causal tracing to reveal…

Artificial Intelligence · Computer Science 2025-10-21 Tong Zhang , Ru Zhang , Jianyi Liu , Zhen Yang , Gongshen Liu

Motivated by the superior performance of image diffusion models, more and more researchers strive to extend these models to the text-based video editing task. Nevertheless, current video editing tasks mainly suffer from the dilemma between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yutao Chen , Xingning Dong , Tian Gan , Chunluan Zhou , Ming Yang , Qingpei Guo

As large-scale diffusion models continue to advance, they excel at producing high-quality images but often generate unwanted content, such as sexually explicit or violent content. Existing methods for concept removal generally guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Lingyun Zhang , Yu Xie , Yanwei Fu , Ping Chen