English
Related papers

Related papers: Red-Teaming the Stable Diffusion Safety Filter

200 papers

Recent progress in text-to-image (TTI) systems, such as StableDiffusion, Imagen, and DALL-E 2, have made it possible to create realistic images with simple text prompts. It is tempting to use these systems to eliminate the manual task of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 David Marwood , Shumeet Baluja , Yair Alon

Recently, there has been significant progress in the development of large models. Following the success of ChatGPT, numerous language models have been introduced, demonstrating remarkable performance. Similar advancements have also been…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Tianyi Zhang , Zheng Wang , Jing Huang , Mohiuddin Muhammad Tasnim , Wei Shi

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Recent advancements in text-to-image models, such as Stable Diffusion, show significant demographic biases. Existing de-biasing techniques rely heavily on additional training, which imposes high computational costs and risks of compromising…

Artificial Intelligence · Computer Science 2025-03-28 Eunji Kim , Siwon Kim , Minjun Park , Rahim Entezari , Sungroh Yoon

Diffusion-based models, such as the Stable Diffusion model, have revolutionized text-to-image synthesis with their ability to produce high-quality, high-resolution images. These advancements have prompted significant progress in image…

Cryptography and Security · Computer Science 2023-12-07 Ali Naseh , Jaechul Roh , Amir Houmansadr

Diffusion models have demonstrated remarkable performance in image generation tasks, paving the way for powerful AIGC applications. However, these widely-used generative models can also raise security and privacy concerns, such as copyright…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhengyue Zhao , Jinhao Duan , Xing Hu , Kaidi Xu , Chenan Wang , Rui Zhang , Zidong Du , Qi Guo , Yunji Chen

Diffusion models excel at generating visually striking content from text but can inadvertently produce undesirable or harmful content when trained on unfiltered internet data. A practical solution is to selectively removing target concepts…

Machine Learning · Computer Science 2025-05-26 Anh Bui , Long Vuong , Khanh Doan , Trung Le , Paul Montague , Tamas Abraham , Dinh Phung

Stable diffusion models have ushered in a new era of advancements in image generation, currently reigning as the state-of-the-art approach, exhibiting unparalleled performance. The process of diffusion, accompanied by denoising through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Andras Horvath

Diffusion models have achieved remarkable success in generating high-quality images. Recently, the open-source models represented by Stable Diffusion (SD) are thriving and are accessible for customization, giving rise to a vibrant community…

Cryptography and Security · Computer Science 2024-05-21 Weitao Feng , Wenbo Zhou , Jiyan He , Jie Zhang , Tianyi Wei , Guanlin Li , Tianwei Zhang , Weiming Zhang , Nenghai Yu

Diffusion models generate samples by reversing a fixed forward diffusion process. Despite already providing impressive empirical results, these diffusion models algorithms can be further improved by reducing the variance of the training…

Machine Learning · Computer Science 2023-02-20 Yilun Xu , Shangyuan Tong , Tommi Jaakkola

Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing…

Human-Computer Interaction · Computer Science 2023-01-06 Nassim Dehouche , Kullathida Dehouche

Diffusion models are the current state-of-the-art in image generation, synthesizing high-quality images by breaking down the generation process into many fine-grained denoising steps. Despite their good performance, diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Noam Elata , Bahjat Kawar , Tomer Michaeli , Michael Elad

Growing privacy concerns and regulations like GDPR and CCPA necessitate pseudonymization techniques that protect identity in image datasets. However, retaining utility is also essential. Traditional methods like masking and blurring degrade…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Kartik Patwari , David Schneider , Xiaoxiao Sun , Chen-Nee Chuah , Lingjuan Lyu , Vivek Sharma

Anonymization plays a key role in protecting sensible information of individuals in real world datasets. Self-driving cars for example need high resolution facial features to track people and their viewing direction to predict future…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Pascal Zwick , Kevin Roesch , Marvin Klemp , Oliver Bringmann

Text-to-image diffusion models have recently attracted the interest of many researchers, and inverting the diffusion process can play an important role in better understanding the generative process and how to engineer prompts in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

Stable Diffusion fine-tuning technique is tried to assist bridge-type innovation. The bridge real photo dataset is built, and Stable Diffusion is fine tuned by using four methods that are Textual Inversion, Dreambooth, Hypernetwork and…

Machine Learning · Computer Science 2024-09-25 Leye Zhang , Xiangxiang Tian , Chengli Zhang , Hongjun Zhang

Recent advances in diffusion models have significantly enhanced their ability to generate high-quality images and videos, but they have also increased the risk of producing unsafe content. Existing unlearning/editing-based methods for safe…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jaehong Yoon , Shoubin Yu , Vaidehi Patil , Huaxiu Yao , Mohit Bansal

Generative models have enabled easy creation and generation of images of all kinds given a single prompt. However, this has also raised ethical concerns about what is an actual piece of content created by humans or cameras compared to…

Cryptography and Security · Computer Science 2024-12-31 Aryaman Shaan , Garvit Banga , Raghav Mantri

As machine learning-enabled Text-to-Image (TTI) systems are becoming increasingly prevalent and seeing growing adoption as commercial services, characterizing the social biases they exhibit is a necessary first step to lowering their risk…

Computers and Society · Computer Science 2023-11-13 Alexandra Sasha Luccioni , Christopher Akiki , Margaret Mitchell , Yacine Jernite

Diffusion Transformers have become a powerful backbone for text-to-image generation, but their layered and cross-modal generation process makes safety control fundamentally different from prompt-level filtering or output-level detection.…

Artificial Intelligence · Computer Science 2026-05-29 Zihao Xue , Yan Wang , Zhen Bi , Long Ma , Zhonglong Zheng , Zeyu Yang , Bingyu Zhu , Longtao Huang , Jie Xiao , Jungang Lou