English
Related papers

Related papers: SolidMark: Evaluating Image Memorization in Genera…

200 papers

Diffusion models, known for their tremendous ability to generate high-quality samples, have recently raised concerns due to their data memorization behavior, which poses privacy risks. Recent methods for memory mitigation have primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Xiaoliu Guan , Yu Wu , Huayang Huang , Xiao Liu , Jiaxu Miao , Yi Yang

Understanding how textual embeddings contribute to memorization in text-to-image diffusion models is crucial for both interpretability and safety. This paper investigates an unexpected behavior of CLIP embeddings in Stable Diffusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Bumjun Kim , Albert No

Memorization in large-scale text-to-image diffusion models poses significant security and intellectual property risks, enabling adversarial attribute extraction and the unauthorized reproduction of sensitive or proprietary features. While…

Machine Learning · Computer Science 2026-01-28 Divya Kothandaraman , Jaclyn Pytlarz

In this study, we investigate the vulnerability of image watermarks to diffusion-model-based image editing, a challenge exacerbated by the computational cost of accessing gradient information and the closed-source nature of many diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Minzhou Pan , Yi Zeng , Xue Lin , Ning Yu , Cho-Jui Hsieh , Peter Henderson , Ruoxi Jia

Pretrained diffusion models and their outputs are widely accessible due to their exceptional capacity for synthesizing high-quality images and their open-source nature. The users, however, may face litigation risks owing to the models'…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chen Chen , Daochang Liu , Chang Xu

Text-to-image diffusion models have achieved unprecedented proficiency in generating realistic images. However, their inherent tendency to memorize and replicate training data during inference raises significant concerns, including…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Chen Chen , Daochang Liu , Mubarak Shah , Chang Xu

When do diffusion models reproduce their training data, and when are they able to generate samples beyond it? A practically relevant theoretical understanding of this interplay between memorization and generalization may significantly…

Machine Learning · Computer Science 2025-08-26 Sam Buchanan , Druv Pai , Yi Ma , Valentin De Bortoli

Robust invisible watermarking aims to embed hidden information into images such that the watermark can survive various image manipulations. However, the rise of powerful diffusion-based image generation and editing techniques poses a new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Yunyi Ni , Finn Carter , Ze Niu , Emily Davis , Bo Zhang

Diffusion models are central to modern generative modeling, and understanding how they balance memorization and generalization is critical for reliable deployment. Recent work has shown that memorization in diffusion models is shaped by…

Machine Learning · Computer Science 2026-04-28 Bingqing Jiang , Difan Zou

Generative models are increasingly used in 3D vision to synthesize novel shapes, yet it remains unclear whether their generation relies on memorizing training shapes. Understanding their memorization could help prevent training data leakage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shu Pu , Boya Zeng , Kaichen Zhou , Mengyu Wang , Zhuang Liu

Image generative models are known to duplicate images from the training data as part of their outputs, which can lead to privacy concerns when used for medical image generation. We propose a calibrated per-sample metric for detecting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Yash Deo , Yan Jia , Toni Lassila , Victoria J Hodge , Alejandro F Frang , Chenghao Qian , Siyuan Kang , Ibrahim Habli

Multi-modal models, such as CLIP, have demonstrated strong performance in aligning visual and textual representations, excelling in tasks like image retrieval and zero-shot classification. Despite this success, the mechanisms by which these…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wenhao Wang , Adam Dziedzic , Grace C. Kim , Michael Backes , Franziska Boenisch

Diffusion models have achieved remarkable success across diverse domains, but they remain vulnerable to memorization -- reproducing training data rather than generating novel outputs. This not only limits their creative potential but also…

Machine Learning · Statistics 2025-11-10 Zeqi Ye , Qijie Zhu , Molei Tao , Minshuo Chen

Tabular data generation has attracted significant research interest in recent years, with the tabular diffusion models greatly improving the quality of synthetic data. However, while memorization, where models inadvertently replicate exact…

Machine Learning · Computer Science 2025-11-11 Zhengyu Fang , Zhimeng Jiang , Huiyuan Chen , Xiao Li , Jing Li

Recent advances in deep generative models have led to impressive results in a variety of application domains. Motivated by the possibility that deep learning models might memorize part of the input data, there have been increased efforts to…

Machine Learning · Computer Science 2021-12-30 Gerrit J. J. van den Burg , Christopher K. I. Williams

Robust invisible watermarking schemes aim to embed hidden information into images such that the watermark survives common manipulations. However, powerful diffusion-based image generation and editing techniques now pose a new threat to…

Cryptography and Security · Computer Science 2026-02-25 Fan Guo , Jiyu Kang , Qi Ming , Emily Davis , Finn Carter

Images generated by diffusion models like Stable Diffusion are increasingly widespread. Recent works and even lawsuits have shown that these models are prone to replicating their training data, unbeknownst to the user. In this paper, we…

Machine Learning · Computer Science 2023-06-01 Gowthami Somepalli , Vasu Singla , Micah Goldblum , Jonas Geiping , Tom Goldstein

Diffusion models have emerged as powerful generative models, but their high computation cost in iterative sampling remains a significant bottleneck. In this work, we present an in-depth and insightful study of state-of-the-art acceleration…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Weizhi Gao , Zhichao Hou , Junqi Yin , Feiyi Wang , Linyu Peng , Xiaorui Liu

Diffusion models excel in generating images that closely resemble their training data but are also susceptible to data memorization, raising privacy, ethical, and legal concerns, particularly in sensitive domains such as medical imaging. We…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Raman Dutt , Ondrej Bohdal , Pedro Sanchez , Sotirios A. Tsaftaris , Timothy Hospedales

Current image watermarking technologies are predominantly categorized into text watermarking techniques and image steganography; however, few methods can simultaneously handle text and image-based watermark data, which limits their…

Multimedia · Computer Science 2025-06-03 ZhongLi Fang , Yu Xie , Ping Chen