English
Related papers

Related papers: Prompt Stealing Attacks Against Text-to-Image Gene…

200 papers

The text generated by large language models is commonly controlled by prompting, where a prompt prepended to a user's query guides the model's output. The prompts used by companies to guide their models are often treated as secrets, to be…

Computation and Language · Computer Science 2024-08-09 Yiming Zhang , Nicholas Carlini , Daphne Ippolito

Many real-world data come in the form of graphs. Graph neural networks (GNNs), a new family of machine learning (ML) models, have been proposed to fully leverage graph data to build powerful applications. In particular, the inductive GNNs,…

Cryptography and Security · Computer Science 2021-12-16 Yun Shen , Xinlei He , Yufei Han , Yang Zhang

Recent developments in text-to-image models, particularly Stable Diffusion, have marked significant achievements in various applications. With these advancements, there are growing safety concerns about the vulnerability of the model that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chenyu Zhang , Lanjun Wang , Anan Liu

The rise of text-to-image (T2I) models has enabled the synthesis of photorealistic human portraits, raising serious concerns about identity misuse and the robustness of AIGC detectors. In this work, we propose an automated adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Run Hao , Peng Ying

Text-to-image generative models have recently garnered significant attention due to their ability to generate images based on prompt descriptions. While these models have shown promising performance, concerns have been raised regarding the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Meiling Li , Zhenxing Qian , Xinpeng Zhang

Model stealing attacks have become a serious concern for deep learning models, where an attacker can steal a trained model by querying its black-box API. This can lead to intellectual property theft and other security and privacy risks. The…

Machine Learning · Computer Science 2023-09-12 Kacem Khaled , Mouna Dhaouadi , Felipe Gohring de Magalhães , Gabriela Nicolescu

Recent studies have demonstrated the vulnerability of recommender systems to data privacy attacks. However, research on the threat to model privacy in recommender systems, such as model stealing attacks, is still in its infancy. Some…

Cryptography and Security · Computer Science 2023-12-27 Zhihao Zhu , Rui Fan , Chenwang Wu , Yi Yang , Defu Lian , Enhong Chen

Current image generation models can effortlessly produce high-quality, highly realistic images, but this also increases the risk of misuse. In various Text-to-Image or Image-to-Image tasks, attackers can generate a series of images…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Hao Cheng , Erjia Xiao , Jiayan Yang , Jiahang Cao , Qiang Zhang , Jize Zhang , Kaidi Xu , Jindong Gu , Renjing Xu

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

Recent developments in large language models (LLM) and generative AI have unleashed the astonishing capabilities of text-to-image generation systems to synthesize high-quality images that are faithful to a given reference text, known as a…

Human-Computer Interaction · Computer Science 2023-03-17 Yutong Xie , Zhaoying Pan , Jinge Ma , Luo Jie , Qiaozhu Mei

In recent years, there has been an explosive growth in multimodal learning. Image captioning, a classical multimodal task, has demonstrated promising applications and attracted extensive research attention. However, recent studies have…

Cryptography and Security · Computer Science 2024-06-11 Wenshu Fan , Hongwei Li , Wenbo Jiang , Meng Hao , Shui Yu , Xiao Zhang

Machine learning models were shown to be vulnerable to model stealing attacks, which lead to intellectual property infringement. Among other methods, substitute model training is an all-encompassing attack applicable to any machine learning…

Machine Learning · Computer Science 2025-03-11 Daryna Oliynyk , Rudolf Mayer , Andreas Rauber

Text-to-image generation has seen an explosion of interest since 2021. Today, beautiful and intriguing digital images and artworks can be synthesized from textual inputs ("prompts") with deep generative models. Online communities around…

Multimedia · Computer Science 2023-11-27 Jonas Oppenlaender

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

Human-Computer Interaction · Computer Science 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

Text-to-image generation model is able to generate images across a diverse range of subjects and styles based on a single prompt. Recent works have proposed a variety of interaction methods that help users understand the capabilities of…

Human-Computer Interaction · Computer Science 2023-07-19 Seungho Baek , Hyerin Im , Jiseung Ryu , Juhyeong Park , Takyeon Lee

Text-to-image (T2I) research has grown explosively in the past year, owing to the large-scale pre-trained diffusion models and many emerging personalization and editing approaches. Yet, one pain point persists: the text prompt engineering,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Xingqian Xu , Jiayi Guo , Zhangyang Wang , Gao Huang , Irfan Essa , Humphrey Shi

Large-scale pre-trained models are increasingly adapted to downstream tasks through a new paradigm called prompt learning. In contrast to fine-tuning, prompt learning does not update the pre-trained model's parameters. Instead, it only…

Cryptography and Security · Computer Science 2023-10-19 Yixin Wu , Rui Wen , Michael Backes , Pascal Berrang , Mathias Humbert , Yun Shen , Yang Zhang

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

Artificial Intelligence · Computer Science 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

Data poisoning attacks manipulate training data to introduce unexpected behaviors into machine learning models at training time. For text-to-image generative models with massive training datasets, current understanding of poisoning attacks…

Cryptography and Security · Computer Science 2024-04-30 Shawn Shan , Wenxin Ding , Josephine Passananti , Stanley Wu , Haitao Zheng , Ben Y. Zhao

Text-to-image generation models have recently attracted unprecedented attention as they unlatch imaginative applications in all areas of life. However, developing such models requires huge amounts of data that might contain…

Cryptography and Security · Computer Science 2022-10-04 Yixin Wu , Ning Yu , Zheng Li , Michael Backes , Yang Zhang