中文
相关论文

相关论文: Prompt Stealing Attacks Against Text-to-Image Gene…

200 篇论文

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

This work focuses on generating high-quality images with specific style of reference images and content of provided textual descriptions. Current leading algorithms, i.e., DreamBooth and LoRA, require fine-tuning for each style, leading to…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Zhouxia Wang , Xintao Wang , Liangbin Xie , Zhongang Qi , Ying Shan , Wenping Wang , Ping Luo

Recent works show that text-to-image generative models are surprisingly vulnerable to a variety of poisoning attacks. Empirical results find that these models can be corrupted by altering associations between individual text prompts and…

密码学与安全 · 计算机科学 2024-09-20 Wenxin Ding , Cathy Y. Li , Shawn Shan , Ben Y. Zhao , Haitao Zheng

Deepfake or synthetic images produced using deep generative models pose serious risks to online platforms. This has triggered several research efforts to accurately detect deepfake images, achieving excellent performance on publicly…

Recent large-scale text-driven synthesis models have attracted much attention thanks to their remarkable capabilities of generating highly diverse images that follow given text prompts. Such text-based synthesis methods are particularly…

计算机视觉与模式识别 · 计算机科学 2022-08-03 Amir Hertz , Ron Mokady , Jay Tenenbaum , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

Text-to-image diffusion models have achieved remarkable success in generating high-quality contents from text prompts. However, their reliance on publicly available data and the growing trend of data sharing for fine-tuning make these…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Sangwon Jang , June Suk Choi , Jaehyeong Jo , Kimin Lee , Sung Ju Hwang

The rise in popularity of text-to-image generative artificial intelligence (AI) has attracted widespread public interest. We demonstrate that this technology can be attacked to generate content that subtly manipulates its users. We propose…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

This paper examines the art practices, artwork, and motivations of prolific users of the latest generation of text-to-image models. Through interviews, observations, and a user survey, we present a sampling of the artistic styles and…

人机交互 · 计算机科学 2023-03-23 Minsuk Chang , Stefania Druga , Alex Fiannaca , Pedro Vergani , Chinmay Kulkarni , Carrie Cai , Michael Terry

Generative AI leaderboards are central to evaluating model capabilities, but remain vulnerable to manipulation. Among key adversarial objectives is rank manipulation, where an attacker must first deanonymize the models behind displayed…

机器学习 · 计算机科学 2025-10-09 Ali Naseh , Anshuman Suri , Yuefeng Peng , Harsh Chaudhari , Alina Oprea , Amir Houmansadr

We are witnessing a novel era of creativity where anyone can create digital content via prompt-based learning (known as prompt engineering). This paper investigates prompt engineering as a novel creative skill for creating AI art with…

人机交互 · 计算机科学 2024-07-08 Jonas Oppenlaender , Rhema Linder , Johanna Silvennoinen

Modern text-to-image (T2I) generation systems (e.g., DALL$\cdot$E 3) exploit the memory mechanism, which captures key information in multi-turn interactions for faithful generation. Despite its practicality, the security analyses of this…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Shiqian Zhao , Jiayang Liu , Yiming Li , Runyi Hu , Xiaojun Jia , Wenshu Fan , Xiao Bao , Xinfeng Li , Jie Zhang , Wei Dong , Tianwei Zhang , Luu Anh Tuan

Pretrained language models (PLMs) have made remarkable progress in text generation tasks via fine-tuning. While, it is challenging to fine-tune PLMs in a data-scarce situation. Therefore, it is non-trivial to develop a general and…

计算与语言 · 计算机科学 2022-05-17 Junyi Li , Tianyi Tang , Jian-Yun Nie , Ji-Rong Wen , Wayne Xin Zhao

Despite the notable advancements and versatility of multi-modal diffusion models, such as text-to-image models, their susceptibility to adversarial inputs remains underexplored. Contrary to expectations, our investigations reveal that the…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Xiaosen Wang , Zhijin Ge , Shaokang Wang

The rapid advancement of generative models has significantly enhanced the realism and customization of digital content creation. The increasing power of these tools, coupled with their ease of access, fuels the creation of photorealistic…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Francesco Laiti , Benedetta Liberatori , Thomas De Min , Elisa Ricci

The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Chang Yu , Junran Peng , Xiangyu Zhu , Zhaoxiang Zhang , Qi Tian , Zhen Lei

The practical use of text-to-image generation has evolved from simple, monolithic models to complex workflows that combine multiple specialized components. While workflow-based approaches can lead to improved image quality, crafting…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Rinon Gal , Adi Haviv , Yuval Alaluf , Amit H. Bermano , Daniel Cohen-Or , Gal Chechik

Diffusion-based models, such as the Stable Diffusion model, have revolutionized text-to-image synthesis with their ability to produce high-quality, high-resolution images. These advancements have prompted significant progress in image…

密码学与安全 · 计算机科学 2023-12-07 Ali Naseh , Jaechul Roh , Amir Houmansadr

Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts. However, developing effective prompts for desired images can be…

人工智能 · 计算机科学 2023-11-02 Yingchaojie Feng , Xingbo Wang , Kam Kwai Wong , Sijia Wang , Yuhong Lu , Minfeng Zhu , Baicheng Wang , Wei Chen

Recent studies show that text-to-image (T2I) models are vulnerable to adversarial attacks, especially with noun perturbations in text prompts. In this study, we investigate the impact of adversarial attacks on different POS tags within text…

计算与语言 · 计算机科学 2024-09-25 G M Shahariar , Jia Chen , Jiachen Li , Yue Dong

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

密码学与安全 · 计算机科学 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su