English
Related papers

Related papers: Repurposing Image Diffusion Models for Adversarial…

200 papers

Diffusion models create data from noise by inverting the forward paths of data towards noise and have emerged as a powerful generative modeling technique for high-dimensional, perceptual data such as images and videos. Rectified flow is a…

Due to their powerful image generation capabilities, diffusion-based adversarial example generation methods through image editing are rapidly gaining popularity. However, due to reliance on the discriminative capability of the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Gaozheng Pei , Ke Ma , Dongpeng Zhang , Chengzhi Sun , Qianqian Xu , Qingming Huang

Generative text-to-image models enable us to synthesize unlimited amounts of images in a controllable manner, spurring many recent efforts to train vision models with synthetic data. However, every synthetic image ultimately originates from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Scott Geng , Cheng-Yu Hsieh , Vivek Ramanujan , Matthew Wallingford , Chun-Liang Li , Pang Wei Koh , Ranjay Krishna

Diffusion models have gained significant attention for high-fidelity image generation. Our work investigates the potential of exploiting diffusion models for adversarial robustness in image classification and object detection. Adversarial…

Image and Video Processing · Electrical Eng. & Systems 2025-11-05 Mika Yagoda , Shady Abu-Hussein , Raja Giryes

As synthetic data proliferates across the Internet, it is often reused to train successive generations of generative models. This creates a ``self-consuming loop" that can lead to training instability or \textit{model collapse}. Common…

Machine Learning · Computer Science 2025-11-18 Zhongteng Cai , Yaxuan Wang , Yang Liu , Xueru Zhang

Recent advancements in diffusion models have enabled high-fidelity and photorealistic image generation across diverse applications. However, these models also present security and privacy risks, including copyright violations, sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jiacheng Shi , Yanfu Zhang , Huajie Shao , Ashley Gao

Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift…

Machine Learning · Statistics 2026-02-19 Nail B. Khelifa , Richard E. Turner , Ramji Venkataramanan

Generating counterfactual explanations is one of the most effective approaches for uncovering the inner workings of black-box neural network models and building user trust. While remarkable strides have been made in generative modeling…

Machine Learning · Computer Science 2023-12-22 Nishtha Madaan , Srikanta Bedathur

Recently, detecting AI-generated images produced by diffusion-based models has attracted increasing attention due to their potential threat to safety. Among existing approaches, reconstruction-based methods have emerged as a prominent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Haoyang Jiang , Mingyang Yi , Shaolei Zhang , Junxian Cai , Qingbin Liu , Xi Chen , Ju Fan

Adversarial attacks exploiting unrestricted natural perturbations present severe security risks to deep learning systems, yet their transferability across models remains limited due to distribution mismatches between generated adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Yuhao Xue , Zhifei Zhang , Xinyang Jiang , Yifei Shen , Junyao Gao , Wentao Gu , Jiale Zhao , Miaojing Shi , Cairong Zhao

Growing privacy concerns and regulations like GDPR and CCPA necessitate pseudonymization techniques that protect identity in image datasets. However, retaining utility is also essential. Traditional methods like masking and blurring degrade…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Kartik Patwari , David Schneider , Xiaoxiao Sun , Chen-Nee Chuah , Lingjuan Lyu , Vivek Sharma

Foundation models in digital pathology use massive datasets to learn useful compact feature representations of complex histology images. However, there is limited transparency into what drives the correlation between dataset size and…

We establish rigorous benchmarks for visual perception robustness. Synthetic images such as ImageNet-C, ImageNet-9, and Stylized ImageNet provide specific type of evaluation over synthetic corruptions, backgrounds, and textures, yet those…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Chenshuang Zhang , Fei Pan , Junmo Kim , In So Kweon , Chengzhi Mao

We fine-tuned a foundational stable diffusion model using X-ray scattering images and their corresponding descriptions to generate new scientific images from given prompts. However, some of the generated images exhibit significant…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Zhuowen Zhao , Xiaoya Chong , Tanny Chavez , Alexander Hexemer

Data scarcity in medical imaging poses significant challenges due to privacy concerns. Diffusion models, a recent generative modeling technique, offer a potential solution by generating synthetic and realistic data. However, questions…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Abdullah al Nomaan Nafi , Md. Alamgir Hossain , Rakib Hossain Rifat , Md Mahabub Uz Zaman , Md Manjurul Ahsan , Shivakumar Raman

Text-to-image diffusion models have impactful applications in art, design, and entertainment, yet these technologies also pose significant risks by enabling the creation and dissemination of misinformation. Although recent advancements have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Anisha Pal , Julia Kruk , Mansi Phute , Manognya Bhattaram , Diyi Yang , Duen Horng Chau , Judy Hoffman

Microstructure reconstruction, a major component of inverse computational materials engineering, is currently advancing at an unprecedented rate. While various training-based and training-free approaches are developed, the majority of…

Materials Science · Physics 2022-11-28 Christian Düreth , Paul Seibert , Dennis Rücker , Stephanie Handford , Markus Kästner , Maik Gude

Despite the notable accomplishments of deep object detection models, a major challenge that persists is the requirement for extensive amounts of training data. The process of procuring such real-world data is a laborious undertaking, which…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Roy Voetman , Maya Aghaei , Klaas Dijkstra

Diffusion model has become a main paradigm for synthetic data generation in many subfields of modern machine learning, including computer vision, language model, or speech synthesis. In this paper, we leverage the power of diffusion model…

Machine Learning · Statistics 2023-11-20 Namjoon Suh , Xiaofeng Lin , Din-Yin Hsieh , Merhdad Honarkhah , Guang Cheng

In recent years, methods for producing highly realistic synthetic images have significantly advanced, allowing the creation of high-quality images from text prompts that describe the desired content. Even more impressively, Stable Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sara Mandelli , Paolo Bestagini , Stefano Tubaro