English
Related papers

Related papers: Diffusion Models are Robust Pretrainers

200 papers

It has been suggested that adversarial examples cause deep learning models to make incorrect predictions with high confidence. In this work, we take the opposite stance: an overly confident model is more likely to be vulnerable to…

Machine Learning · Computer Science 2018-02-14 Angus Galloway , Graham W. Taylor , Medhat Moussa

Adversarial robust models have been shown to learn more robust and interpretable features than standard trained models. As shown in [\cite{tsipras2018robustness}], such robust models inherit useful interpretable properties where the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Gunjan Aggarwal , Abhishek Sinha , Nupur Kumari , Mayank Singh

We propose a framework for adversarial training that relies on a sample rather than a single sample point as the fundamental unit of discrimination. Inspired by discrepancy measures and two-sample tests between probability distributions, we…

Machine Learning · Computer Science 2017-07-11 Chengtao Li , David Alvarez-Melis , Keyulu Xu , Stefanie Jegelka , Suvrit Sra

Can a diffusion model trained on bedrooms recover human faces? Diffusion models are widely used as priors for inverse problems, but standard approaches usually assume a high-fidelity model trained on data that closely match the unknown…

Machine Learning · Computer Science 2026-02-02 Jing Jia , Wei Yuan , Sifan Liu , Liyue Shen , Guanyang Wang

Diffusion models (DMs) have revolutionized image generation, producing high-quality images with applications spanning various fields. However, their ability to create hyper-realistic images poses significant challenges in distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Santosh , Li Lin , Irene Amerini , Xin Wang , Shu Hu

Deep neural networks (DNNs) are shown to be vulnerable to adversarial examples. A well-trained model can be easily attacked by adding small perturbations to the original data. One of the hypotheses of the existence of the adversarial…

Machine Learning · Computer Science 2022-10-04 Jiancong Xiao , Liusha Yang , Yanbo Fan , Jue Wang , Zhi-Quan Luo

Deep neural networks have been proved that they are vulnerable to adversarial examples, which are generated by adding human-imperceptible perturbations to images. To defend these adversarial examples, various detection based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Kejiang Chen , Yuefeng Chen , Hang Zhou , Chuan Qin , Xiaofeng Mao , Weiming Zhang , Nenghai Yu

Diffusion models are powerful, but they require a lot of time and data to train. We propose Patch Diffusion, a generic patch-wise training framework, to significantly reduce the training time costs while improving data efficiency, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhendong Wang , Yifan Jiang , Huangjie Zheng , Peihao Wang , Pengcheng He , Zhangyang Wang , Weizhu Chen , Mingyuan Zhou

The Vision Transformer has emerged as a powerful tool for image classification tasks, surpassing the performance of convolutional neural networks (CNNs). Recently, many researchers have attempted to understand the robustness of Transformers…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Gihyun Kim , Juyeop Kim , Jong-Seok Lee

We introduce a new general-purpose approach to deep learning on 3D surfaces, based on the insight that a simple diffusion layer is highly effective for spatial communication. The resulting networks are automatically robust to changes in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Nicholas Sharp , Souhaib Attaiki , Keenan Crane , Maks Ovsjanikov

In recent years, diffusion models have achieved remarkable success in the realm of high-quality image generation, garnering increased attention. This surge in interest is paralleled by a growing concern over the security threats associated…

Machine Learning · Computer Science 2024-06-04 Sen Li , Junchi Ma , Minhao Cheng

Design of adversarial attacks for deep neural networks, as well as methods of adversarial training against them, are subject of intense research. In this paper, we propose methods to train against distributional attack threats, extending…

Machine Learning · Computer Science 2025-02-14 Xingjian Bai , Guangyi He , Yifan Jiang , Jan Obloj

Object detection is fundamental to various real-world applications, such as security monitoring and surveillance video analysis. Despite their advancements, state-of-the-art object detectors are still vulnerable to adversarial patch…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jin Ma , Mohammed Aldeen , Christopher Salas , Feng Luo , Mashrur Chowdhury , Mert Pesé , Long Cheng

Text-to-image diffusion models have demonstrated remarkable effectiveness in rapid and high-fidelity personalization, even when provided with only a few user images. However, the effectiveness of personalization techniques has lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Naresh Kumar Devulapally , Shruti Agarwal , Tejas Gokhale , Vishnu Suresh Lokhande

Image attribution -- matching an image back to a trusted source -- is an emerging tool in the fight against online misinformation. Deep visual fingerprinting models have recently been explored for this purpose. However, they are not robust…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Maksym Andriushchenko , Xiaoyang Rebecca Li , Geoffrey Oxholm , Thomas Gittings , Tu Bui , Nicolas Flammarion , John Collomosse

Despite unconditional feature inversion being the foundation of many image synthesis applications, training an inverter demands a high computational budget, large decoding capacity and imposing conditions such as autoregressive priors. To…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Renan A. Rojas-Gomez , Raymond A. Yeh , Minh N. Do , Anh Nguyen

Distributed diffusion is a powerful algorithm for multi-task state estimation which enables networked agents to interact with neighbors to process input data and diffuse information across the network. Compared to a centralized approach,…

Multiagent Systems · Computer Science 2020-03-27 Jiani Li , Xenofon Koutsoukos

Deep neural networks are vulnerable to adversarial examples, which becomes one of the most important research problems in the development of deep learning. While a lot of efforts have been made in recent years, it is of great significance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yinpeng Dong , Qi-An Fu , Xiao Yang , Tianyu Pang , Hang Su , Zihao Xiao , Jun Zhu

Recently, large pre-trained foundation models have become widely adopted by machine learning practitioners for a multitude of tasks. Given that such models are publicly available, relying on their use as backbone models for downstream tasks…

Machine Learning · Computer Science 2025-03-14 Brian Pulfer , Yury Belousov , Slava Voloshynovskiy

Diffusion models have achieved great success in a range of tasks, such as image synthesis and molecule design. As such successes hinge on large-scale training data collected from diverse sources, the trustworthiness of these collected data…

Machine Learning · Computer Science 2023-03-13 Weixin Chen , Dawn Song , Bo Li