中文
相关论文

相关论文: Expanding the Role of Diffusion Models for Robust …

200 篇论文

Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible…

机器学习 · 计算机科学 2024-04-12 Minshuo Chen , Song Mei , Jianqing Fan , Mengdi Wang

Adversarial training (AT) is among the most effective techniques to improve model robustness by augmenting training data with adversarial examples. However, most existing AT methods adopt a specific attack to craft adversarial examples,…

机器学习 · 计算机科学 2020-11-20 Yinpeng Dong , Zhijie Deng , Tianyu Pang , Hang Su , Jun Zhu

We leverage diffusion models to study the robustness-performance tradeoff of robust classifiers. Our approach introduces a simple, pretrained diffusion method to generate low-norm counterfactual examples (CEs): semantically altered data…

机器学习 · 计算机科学 2024-04-18 Eric Yeats , Cameron Darwin , Eduardo Ortega , Frank Liu , Hai Li

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

机器学习 · 计算机科学 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Randomness is an unavoidable part of training deep learning models, yet something that traditional training data attribution algorithms fail to rigorously account for. They ignore the fact that, due to stochasticity in the initialisation…

机器学习 · 计算机科学 2025-10-28 Bruno Mlodozeniec , Isaac Reid , Sam Power , David Krueger , Murat Erdogdu , Richard E. Turner , Roger Grosse

Diffusion models are powerful, but they require a lot of time and data to train. We propose Patch Diffusion, a generic patch-wise training framework, to significantly reduce the training time costs while improving data efficiency, which…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Zhendong Wang , Yifan Jiang , Huangjie Zheng , Peihao Wang , Pengcheng He , Zhangyang Wang , Weizhu Chen , Mingyuan Zhou

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For…

机器学习 · 计算机科学 2021-06-02 Prafulla Dhariwal , Alex Nichol

To protect deep neural networks (DNNs) from adversarial attacks, adversarial training (AT) is developed by incorporating adversarial examples (AEs) into model training. Recent studies show that adversarial attacks disproportionately impact…

机器学习 · 计算机科学 2024-10-17 Fengpeng Li , Kemou Li , Haiwei Wu , Jinyu Tian , Jiantao Zhou

Deep generative models are becoming increasingly powerful, now generating diverse high fidelity photo-realistic samples given text prompts. Have they reached the point where models of natural images can be used for generative data…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Shekoofeh Azizi , Simon Kornblith , Chitwan Saharia , Mohammad Norouzi , David J. Fleet

Deep learning-based food image classification enables precise identification of food categories, further facilitating accurate nutritional analysis. However, real-world food images often show a skewed distribution, with some food types…

计算机视觉与模式识别 · 计算机科学 2025-06-03 GaYeon Koh , Hyun-Jic Oh , Jeonghyun Noh , Won-Ki Jeong

Recent progress in generative modeling has enabled high-quality visual synthesis with diffusion-based frameworks, supporting controllable sampling and large-scale training. Inference-time guidance methods such as classifier-free and…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Wenqiang Zu , Shenghao Xie , Bo Lei , Lei Ma

A critical factor in trustworthy machine learning is to develop robust representations of the training data. Only under this guarantee methods are legitimate to artificially generate data, for example, to counteract imbalanced datasets or…

机器学习 · 计算机科学 2024-12-12 Leon Scharwächter , Sebastian Otte

Recently, large-scale diffusion models, e.g., Stable diffusion and DallE2, have shown remarkable results on image synthesis. On the other hand, large-scale cross-modal pre-trained models (e.g., CLIP, ALIGN, and FILIP) are competent for…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Runhui Huang , Jianhua Han , Guansong Lu , Xiaodan Liang , Yihan Zeng , Wei Zhang , Hang Xu

Despite the remarkable generation capabilities of Diffusion Models (DMs), conducting training and inference remains computationally expensive. Previous works have been devoted to accelerating diffusion sampling, but achieving data-efficient…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Yize Li , Yihua Zhang , Sijia Liu , Xue Lin

Adversarial Training (AT) is one of the most effective methods to train robust Deep Neural Networks (DNNs). However, AT creates an inherent trade-off between clean accuracy and adversarial robustness, which is commonly attributed to the…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yanyun Wang , Li Liu

Deep learning model effectiveness in classification tasks is often challenged by the quality and quantity of training data whenever they are affected by strong spurious correlations between specific attributes and target labels. This…

Diffusion Models are popular generative modeling methods in various vision tasks, attracting significant attention. They can be considered a unique instance of self-supervised learning methods due to their independence from label…

计算机视觉与模式识别 · 计算机科学 2025-01-19 Michael Fuest , Pingchuan Ma , Ming Gui , Johannes Schusterbauer , Vincent Tao Hu , Bjorn Ommer

Diffusion models have demonstrated remarkable capabilities in synthesizing realistic images, spurring interest in using their representations for various downstream tasks. To better understand the robustness of these representations, we…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Jonas Loos , Lorenz Linhardt

Accurately interpreting cardiac auscultation signals plays a crucial role in diagnosing and managing cardiovascular diseases. However, the paucity of labelled data inhibits classification models' training. Researchers have turned to…

声音 · 计算机科学 2025-06-18 Leigh Abbott , Milan Marocchi , Matthew Fynn , Yue Rong , Sven Nordholm