中文
相关论文

相关论文: Personalization as a Shortcut for Few-Shot Backdoo…

200 篇论文

Text-to-image models (T2I) offer a new level of flexibility by allowing users to guide the creative process through natural language. However, personalizing these models to align with user-provided visual concepts remains a challenging…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Yoad Tewel , Rinon Gal , Gal Chechik , Yuval Atzmon

Recent advances in large text-conditional diffusion models have revolutionized image generation by enabling users to create realistic, high-quality images from textual prompts, significantly enhancing artistic creation and visual…

机器学习 · 计算机科学 2025-07-08 Ali Naseh , Jaechul Roh , Eugene Bagdasarian , Amir Houmansadr

Text-to-image (T2I) diffusion models have the ability to build high-quality pictures from text prompts, but they pose safety concerns because they can generate offensive or disturbing imagery when provided with harmful inputs. Existing…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Chi Zhang , Changjia Zhu , Xiaowen Li , Yao Liu , Zhuo Lu

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

Text-to-Image (T2I) diffusion models have rapidly advanced, enabling the generation of high-quality images that align closely with textual descriptions. However, this progress has also raised concerns about their misuse for propaganda and…

计算机视觉与模式识别 · 计算机科学 2024-12-25 Jaechul Roh , Andrew Yuan , Jinsong Mao

Recently, we have seen a surge of personalization methods for text-to-image (T2I) diffusion models to learn a concept using a few images. Existing approaches, when used for face personalization, suffer to achieve convincing inversion with…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Rishubh Parihar , Sachidanand VS , Sabariswaran Mani , Tejan Karmali , R. Venkatesh Babu

Text-to-image (T2I) models can be maliciously used to generate harmful content such as sexually explicit, unfaithful, and misleading or Not-Safe-for-Work (NSFW) images. Previous attacks largely depend on the availability of the diffusion…

密码学与安全 · 计算机科学 2025-05-27 Jiachen Ma , Yijiang Li , Zhiqing Xiao , Anda Cao , Jie Zhang , Chao Ye , Junbo Zhao

Despite the remarkable progress of diffusion models in image generation, recent studies reveal their vulnerability to backdoor attacks via covert visual or textual triggers. Although evolving defense mechanisms can detect most existing…

密码学与安全 · 计算机科学 2026-05-29 Jia Wu , Yu Pan , Junjun Yang , Yi Du

Text-to-image diffusion models are nothing but a revolution, allowing anyone, even without design skills, to create realistic images from simple text inputs. With powerful personalization tools like DreamBooth, they can generate images of a…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Thanh Van Le , Hao Phung , Thuan Hoang Nguyen , Quan Dao , Ngoc Tran , Anh Tran

The objective of text-to-image (T2I) personalization is to customize a diffusion model to a user-provided reference concept, generating diverse images of the concept aligned with the target prompts. Conventional methods representing the…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Jisu Nam , Heesu Kim , DongJae Lee , Siyoon Jin , Seungryong Kim , Seunggyu Chang

Text-to-image (T2I) diffusion models have made remarkable strides in generating and editing high-fidelity images from text. Yet, these models remain fundamentally generic, failing to adapt to the nuanced aesthetic preferences of individual…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Connor Dunlop , Matthew Zheng , Kavana Venkatesh , Pinar Yanardag

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , Kfir Aberman

In recent years, diffusion models have achieved remarkable success in the realm of high-quality image generation, garnering increased attention. This surge in interest is paralleled by a growing concern over the security threats associated…

机器学习 · 计算机科学 2024-06-04 Sen Li , Junchi Ma , Minhao Cheng

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Recent advances in diffusion models have enabled high-quality synthesis of specific subjects, such as identities or objects. This capability, while unlocking new possibilities in content creation, also introduces significant privacy risks,…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Tae-Young Lee , Juwon Seo , Jong Hwan Ko , Gyeong-Moon Park

With the development of diffusion-based customization methods like DreamBooth, individuals now have access to train the models that can generate their personalized images. Despite the convenience, malicious users have misused these…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Yisu Liu , Jinyang An , Wanqian Zhang , Dayan Wu , Jingzi Gu , Zheng Lin , Weiping Wang

While text-to-image synthesis currently enjoys great popularity among researchers and the general public, the security of these models has been neglected so far. Many text-guided image generation models rely on pre-trained text encoders…

机器学习 · 计算机科学 2023-08-10 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Text-to-image (T2I) diffusion models are widely adopted for their strong generative capabilities, yet remain vulnerable to backdoor attacks. Existing attacks typically rely on fixed textual triggers and single-entity backdoor targets,…

密码学与安全 · 计算机科学 2026-05-28 Tianxin Chen , Wenbo Jiang , Hongqiao Chen , Zhirun Zheng , Cheng Huang

Current text-to-image (T2I) synthesis diffusion models raise misuse concerns, particularly in creating prohibited or not-safe-for-work (NSFW) images. To address this, various safety mechanisms and red teaming attack methods are proposed to…

密码学与安全 · 计算机科学 2025-02-07 Pucheng Dang , Xing Hu , Dong Li , Rui Zhang , Qi Guo , Kaidi Xu