English
Related papers

Related papers: Dark Miner: Defend against undesirable generation …

200 papers

Removing undesired concepts from large-scale text-to-image (T2I) and text-to-video (T2V) diffusion models while preserving overall generative quality remains a major challenge, particularly as modern models such as Stable Diffusion v3,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhaoxin Fan , Nanxiang Jiang , Daiheng Gao , Shiji Zhou , Wenjun Wu

Text-to-image (T2I) diffusion models (DMs) have shown promise in generating high-quality images from textual descriptions. The real-world applications of these models require particular attention to their safety and fidelity, but this has…

Cryptography and Security · Computer Science 2023-06-26 Hongcheng Gao , Hao Zhang , Yinpeng Dong , Zhijie Deng

In this work, we present DeepEraser, an effective deep network for generic text removal. DeepEraser utilizes a recurrent architecture that erases the text in an image via iterative operations. Our idea comes from the process of erasing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Hao Feng , Wendi Wang , Shaokai Liu , Jiajun Deng , Wengang Zhou , Houqiang Li

To protect image contents, most existing encryption algorithms are designed to transform an original image into a texture-like or noise-like image, which is, however, an obvious visual sign indicating the presence of an encrypted image,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Xintao Duan , Haoxian Song , En Zhang , Jingjing Liu

Generative models, especially text-to-image diffusion models, have significantly advanced in their ability to generate images, benefiting from enhanced architectures, increased computational power, and large-scale datasets. While the…

Cryptography and Security · Computer Science 2025-11-27 Jie Ren , Yingqian Cui , Chen Chen , Yue Xing , Hui Liu , Lingjuan Lyu

Motivated by ethical and legal concerns, the scientific community is actively developing methods to limit the misuse of Text-to-Image diffusion models for reproducing copyrighted, violent, explicit, or personal information in the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Vitali Petsiuk , Kate Saenko

The rise of deep learning models in the digital era has raised substantial concerns regarding the generation of Not-Safe-for-Work (NSFW) content. Existing defense methods primarily involve model fine-tuning and post-hoc content moderation.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xin Zhao , Xiaojun Chen , Yuexin Xuan , Zhendong Zhao , Xiaojun Jia , Xinfeng Li , Xiaofeng Wang

In the rapidly advancing realm of visual generation, diffusion models have revolutionized the landscape, marking a significant shift in capabilities with their impressive text-guided generative functions. However, relying solely on text for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Pu Cao , Feng Zhou , Qing Song , Lu Yang

Diffusion models build a new milestone for image generation yet raising public concerns, for they can be fine-tuned on unauthorized images for customization. Protection based on adversarial attacks rises to encounter this unauthorized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Boyang Zheng , Chumeng Liang , Xiaoyu Wu

Text-to-image diffusion models have achieved remarkable success in generating photorealistic images. However, the inclusion of sensitive information during pre-training poses significant risks. Machine Unlearning (MU) offers a promising…

Machine Learning · Computer Science 2025-03-19 Yongliang Wu , Shiji Zhou , Mingzhuo Yang , Lianzhe Wang , Heng Chang , Wenbo Zhu , Xinting Hu , Xiao Zhou , Xu Yang

Concept unlearning has emerged as a promising direction for reducing the risks of harmful content generation in text-to-image diffusion models by selectively erasing undesirable concepts from a model's parameters. Existing approaches…

Artificial Intelligence · Computer Science 2026-03-20 Duc Hao Pham , Van Duy Truong , Duy Khanh Dinh , Tien Cuong Nguyen , Dien Hy Ngo , Tuan Anh Bui

In recent years, significant progress has been made in the development of text-to-image generation models. However, these models still face limitations when it comes to achieving full controllability during the generation process. Often,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Salaheldin Mohamed

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

Multimedia · Computer Science 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Diffusion models (DMs) have demonstrated great potential in the field of adversarial robustness, where DM-based defense methods can achieve superior defense capability without adversarial training. However, they all require huge…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Hefei Mei , Minjing Dong , Chang Xu

Text-to-image (T2I) generative models such as Stable Diffusion and FLUX can synthesize realistic, high-quality images directly from textual prompts. The resulting image quality depends critically on well-crafted prompts that specify both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Mingzhe Li , Renhao Zhang , Zhiyang Wen , Siqi Pan , Bruno Castro da Silva , Juan Zhai , Shiqing Ma

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

Concept erasure has emerged as a promising technique for mitigating the risk of harmful content generation in diffusion models by selectively unlearning undesirable concepts. The common principle of previous works to remove a specific…

Machine Learning · Computer Science 2025-05-26 Anh Bui , Trang Vu , Long Vuong , Trung Le , Paul Montague , Tamas Abraham , Junae Kim , Dinh Phung

Modern neural models trained on textual data rely on pre-trained representations that emerge without direct supervision. As these representations are increasingly being used in real-world applications, the inability to \emph{control} their…

Machine Learning · Computer Science 2024-12-18 Shauli Ravfogel , Michael Twiton , Yoav Goldberg , Ryan Cotterell

Existing text-video retrieval solutions are, in essence, discriminant models focused on maximizing the conditional likelihood, i.e., p(candidates|query). While straightforward, this de facto paradigm overlooks the underlying data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Peng Jin , Hao Li , Zesen Cheng , Kehan Li , Xiangyang Ji , Chang Liu , Li Yuan , Jie Chen

Pretrained language models have significantly advanced performance across various natural language processing tasks. However, adversarial attacks continue to pose a critical challenge to systems built using these models, as they can be…

Computation and Language · Computer Science 2025-05-20 Zhenhao Li , Huichi Zhou , Marek Rei , Lucia Specia