中文
相关论文

相关论文: Addressing Text Embedding Leakage in Diffusion-bas…

200 篇论文

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

Text-to-image diffusion models have shown unprecedented generative capability, but their ability to produce undesirable concepts (e.g.~pornographic content, sensitive identities, copyrighted styles) poses serious concerns for privacy,…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Finn Carter

Robust invisible watermarking embeds hidden information in images such that the watermark can survive various manipulations. However, the emergence of powerful diffusion-based image generation and editing techniques poses a new threat to…

密码学与安全 · 计算机科学 2025-11-17 Yunyi Ni , Ziyu Yang , Ze Niu , Emily Davis , Finn Carter

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

机器学习 · 计算机科学 2025-04-15 Lucas Beerens , Desmond J. Higham

Low light enhancement has gained increasing importance with the rapid development of visual creation and editing. However, most existing enhancement algorithms are designed to homogeneously increase the brightness of images to a pre-defined…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Yuyang Yin , Dejia Xu , Chuangchuang Tan , Ping Liu , Yao Zhao , Yunchao Wei

Deep neural networks for automatic image colorization often suffer from the color-bleeding artifact, a problematic color spreading near the boundaries between adjacent objects. Such color-bleeding artifacts debase the reality of generated…

计算机视觉与模式识别 · 计算机科学 2021-09-22 Eungyeup Kim , Sanghyeon Lee , Jeonghoon Park , Somi Choi , Choonghyun Seo , Jaegul Choo

Diffusion models have demonstrated impressive generative capabilities, but their \textit{exposure bias} problem, described as the input mismatch between training and sampling, lacks in-depth exploration. In this paper, we systematically…

机器学习 · 计算机科学 2024-04-12 Mang Ning , Mingxiao Li , Jianlin Su , Albert Ali Salah , Itir Onal Ertugrul

Remarkable progress in text-to-image diffusion models has brought a major concern about potentially generating images on inappropriate or trademarked concepts. Concept erasing has been investigated with the goals of deleting target concepts…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Byung Hyun Lee , Sungjin Lim , Seunggyu Lee , Dong Un Kang , Se Young Chun

Concept erasure aims to remove specified features from an embedding. It can improve fairness (e.g. preventing a classifier from using gender or race) and interpretability (e.g. removing a concept to observe changes in model behavior). We…

机器学习 · 计算机科学 2025-04-04 Nora Belrose , David Schneider-Joseph , Shauli Ravfogel , Ryan Cotterell , Edward Raff , Stella Biderman

Diffusion-based Image Editing (DIE) is an emerging research hot-spot, which often applies a semantic mask to control the target area for diffusion-based editing. However, most existing solutions obtain these masks via manual operations or…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Siyu Zou , Jiji Tang , Yiyi Zhou , Jing He , Chaoyi Zhao , Rongsheng Zhang , Zhipeng Hu , Xiaoshuai Sun

The evolution of Diffusion Models has dramatically improved image generation quality, making it increasingly difficult to differentiate between real and generated images. This development, while impressive, also raises significant privacy…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Yunpeng Luo , Junlong Du , Ke Yan , Shouhong Ding

Text-to-image (T2I) diffusion models have made remarkable strides in generating and editing high-fidelity images from text. Yet, these models remain fundamentally generic, failing to adapt to the nuanced aesthetic preferences of individual…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Connor Dunlop , Matthew Zheng , Kavana Venkatesh , Pinar Yanardag

Machine unlearning aims to remove specific concepts from pretrained text-to-image diffusion models, yet several white- and black-box attacks have been introduced to make the model generate such unlearned concepts. These attacks,…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Arian Komaei Koma , Seyed Amir Kasaei , AmirMahdi Sadeghzadeh , Mohammad Hossein Rohban

Existing attribute editing methods treat semantic attributes as binary, resulting in a single edit per attribute. However, attributes such as eyeglasses, smiles, or hairstyles exhibit a vast range of diversity. In this work, we formulate…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Rishubh Parihar , Prasanna Balaji , Raghav Magazine , Sarthak Vora , Tejan Karmali , Varun Jampani , R. Venkatesh Babu

We consider visual domains in which a class label specifies the content of an image, and class-irrelevant properties that differentiate instances constitute the style. We present a domain-independent method that permits the open-ended…

机器学习 · 计算机科学 2018-10-02 Karl Ridgeway , Michael C. Mozer

Text-to-image models, such as Stable Diffusion (SD), undergo iterative updates to improve image quality and address concerns such as safety. Improvements in image quality are straightforward to assess. However, how model updates resolve…

密码学与安全 · 计算机科学 2024-09-02 Yixin Wu , Yun Shen , Michael Backes , Yang Zhang

The growing sophistication of synthetic image and deepfake generation models has turned source attribution and authenticity verification into a critical challenge for modern computer vision systems. Recent studies suggest that diffusion…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Claudio Giusti , Luca Guarnera , Sebastiano Battiato

Recent advances in text-guided image synthesis has dramatically changed how creative professionals generate artistic and aesthetically pleasing visual assets. To fully support such creative endeavors, the process should possess the ability…

计算机视觉与模式识别 · 计算机科学 2023-10-31 K J Joseph , Prateksha Udhayanan , Tripti Shukla , Aishwarya Agarwal , Srikrishna Karanam , Koustava Goswami , Balaji Vasan Srinivasan

Text-to-image diffusion models have achieved unprecedented proficiency in generating realistic images. However, their inherent tendency to memorize and replicate training data during inference raises significant concerns, including…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Chen Chen , Daochang Liu , Mubarak Shah , Chang Xu

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka