English
Related papers

Related papers: Repurposing Image Diffusion Models for Adversarial…

200 papers

Stable Diffusion fine-tuning technique is tried to assist bridge-type innovation. The bridge real photo dataset is built, and Stable Diffusion is fine tuned by using four methods that are Textual Inversion, Dreambooth, Hypernetwork and…

Machine Learning · Computer Science 2024-09-25 Leye Zhang , Xiangxiang Tian , Chengli Zhang , Hongjun Zhang

The pose-guided person image generation task requires synthesizing photorealistic images of humans in arbitrary poses. The existing approaches use generative adversarial networks that do not necessarily maintain realistic textures or need…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ankan Kumar Bhunia , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

The rapid advancement of Generative Artificial Intelligence (GenAI) capabilities is accompanied by a concerning rise in its misuse. In particular the generation of credible misinformation in the form of images poses a significant threat to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Sina Mavali , Jonas Ricker , David Pape , Asja Fischer , Lea Schönherr

Text-to-image diffusion models have recently attracted the interest of many researchers, and inverting the diffusion process can play an important role in better understanding the generative process and how to engineer prompts in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

Histopathology image classification is crucial for the accurate identification and diagnosis of various diseases but requires large and diverse datasets. Obtaining such datasets, however, is often costly and time-consuming due to the need…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Leire Benito-Del-Valle , Aitor Alvarez-Gila , Itziar Eguskiza , Cristina L. Saratxaga

Adversarial purification refers to a class of defense methods that remove adversarial perturbations using a generative model. These methods do not make assumptions on the form of attack and the classification model, and thus can defend…

Machine Learning · Computer Science 2022-05-17 Weili Nie , Brandon Guo , Yujia Huang , Chaowei Xiao , Arash Vahdat , Anima Anandkumar

Imbalanced datasets pose a difficulty in fraud detection, as classifiers are often biased toward the majority class and perform poorly on rare fraudulent transactions. Synthetic data generation is therefore commonly used to mitigate this…

Machine Learning · Statistics 2026-05-01 En-Ya Kuo , Sebastien Motsch

Artificial Intelligence (AI) based image analysis has an immense potential to support diagnostic histopathology, including cancer diagnostics. However, developing supervised AI methods requires large-scale annotated datasets. A potentially…

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

The utilization of large foundational models has a dilemma: while fine-tuning downstream tasks from them holds promise for making use of the well-generalized knowledge in practical applications, their open accessibility also poses threats…

Machine Learning · Computer Science 2025-04-22 Song Xia , Wenhan Yang , Yi Yu , Xun Lin , Henghui Ding , Ling-Yu Duan , Xudong Jiang

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals --…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Chicago Y. Park , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

Generative diffusion models have emerged as powerful tools to synthetically produce training data, offering potential solutions to data scarcity and reducing labelling costs for downstream supervised deep learning applications. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Nicolo Resmini , Eugenio Lomurno , Cristian Sbrolli , Matteo Matteucci

This study presents a novel approach to enhance the cost-to-quality ratio of image generation with diffusion models. We hypothesize that differences between distilled (e.g. FLUX.1-schnell) and baseline (e.g. FLUX.1-dev) models are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Jakub Wasala , Bartlomiej Wrzalski , Kornelia Noculak , Yuliia Tarasenko , Oliwer Krupa , Jan Kocon , Grzegorz Chodak

We present SinDiffusion, leveraging denoising diffusion models to capture internal distribution of patches from a single natural image. SinDiffusion significantly improves the quality and diversity of generated samples compared with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Weilun Wang , Jianmin Bao , Wengang Zhou , Dongdong Chen , Dong Chen , Lu Yuan , Houqiang Li

Synthetic data is becoming increasingly integral in data-scarce fields such as medical imaging, serving as a substitute for real data. However, its inherent statistical characteristics can significantly impact downstream tasks, potentially…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Krishan Agyakari Raja Babu , Rachana Sathish , Mrunal Pattanaik , Rahul Venkataramani

Adversarial attacks involve adding perturbations to the source image to cause misclassification by the target model, which demonstrates the potential of attacking face recognition models. Existing adversarial face image generation methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Decheng Liu , Xijun Wang , Chunlei Peng , Nannan Wang , Ruiming Hu , Xinbo Gao

With the rising adoption of Machine Learning across the domains like banking, pharmaceutical, ed-tech, etc, it has become utmost important to adopt responsible AI methods to ensure models are not unfairly discriminating against any group.…

Machine Learning · Computer Science 2022-12-02 Bhushan Chaudhari , Himanshu Chaudhary , Aakash Agarwal , Kamna Meena , Tanmoy Bhowmik

Diffusion models have revolutionized the field of content synthesis and editing. Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT), and employed flow-matching for improved training and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Omri Avrahami , Or Patashnik , Ohad Fried , Egor Nemchinov , Kfir Aberman , Dani Lischinski , Daniel Cohen-Or

The commercialization of text-to-image diffusion models (DMs) brings forth potential copyright concerns. Despite numerous attempts to protect DMs from copyright issues, the vulnerabilities of these solutions are underexplored. In this…

Cryptography and Security · Computer Science 2024-05-28 Haonan Wang , Qianli Shen , Yao Tong , Yang Zhang , Kenji Kawaguchi

Popularized by their strong image generation performance, diffusion and related methods for generative modeling have found widespread success in visual media applications. In particular, diffusion methods have enabled new approaches to data…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Yibo Yang , Stephan Mandt