中文
相关论文

相关论文: Robustness to corruption in pre-trained Bayesian n…

200 篇论文

Deep neural networks are susceptible to adversarially crafted, small and imperceptible changes in the natural inputs. The most effective defense mechanism against these examples is adversarial training which constructs adversarial examples…

机器学习 · 计算机科学 2021-11-10 Muhammad Awais , Fengwei Zhou , Chuanlong Xie , Jiawei Li , Sung-Ho Bae , Zhenguo Li

The robustness of deep neural networks is usually lacking under adversarial examples, common corruptions, and distribution shifts, which becomes an important research problem in the development of deep learning. Although new deep learning…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Chang Liu , Yinpeng Dong , Wenzhao Xiang , Xiao Yang , Hang Su , Jun Zhu , Yuefeng Chen , Yuan He , Hui Xue , Shibao Zheng

Fine-tuning pretrained models is a standard and effective workflow in modern machine learning. However, robust fine-tuning (RFT), which aims to simultaneously achieve adaptation to a downstream task and robustness to adversarial examples,…

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

机器学习 · 计算机科学 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

计算机视觉与模式识别 · 计算机科学 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

机器学习 · 统计学 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Real-world offline datasets are often subject to data corruptions (such as noise or adversarial attacks) due to sensor failures or malicious attacks. Despite advances in robust offline reinforcement learning (RL), existing methods struggle…

机器学习 · 计算机科学 2024-11-04 Rui Yang , Jie Wang , Guoping Wu , Bin Li

Despite their theoretical appealingness, Bayesian neural networks (BNNs) are left behind in real-world adoption, mainly due to persistent concerns on their scalability, accessibility, and reliability. In this work, we develop the…

机器学习 · 计算机科学 2022-10-14 Zhijie Deng , Jun Zhu

Training certifiably robust neural networks is an important but challenging task. While many algorithms for (deterministic) certified training have been proposed, they are often evaluated on different training schedules, certification…

机器学习 · 计算机科学 2025-05-29 Yuhao Mao , Stefan Balauca , Martin Vechev

(Non-)robustness of neural networks to small, adversarial pixel-wise perturbations, and as more recently shown, to even random spatial transformations (e.g., translations, rotations) entreats both theoretical and empirical understanding.…

机器学习 · 计算机科学 2021-11-11 Sandesh Kamath , Amit Deshpande , K V Subrahmanyam , Vineeth N Balasubramanian

Because of the widespread existence of noise and data corruption, recovering the true regression parameters with a certain proportion of corrupted response variables is an essential task. Methods to overcome this problem often involve…

机器学习 · 计算机科学 2023-01-10 Zheyi Fan , Zhaohui Li , Jingyan Wang , Dennis K. J. Lin , Xiao Xiong , Qingpei Hu

In this paper we establish rigorous benchmarks for image classifier robustness. Our first benchmark, ImageNet-C, standardizes and expands the corruption robustness topic, while showing which classifiers are preferable in safety-critical…

机器学习 · 计算机科学 2019-04-30 Dan Hendrycks , Thomas G. Dietterich

In recent years, there has been a growing interest in using Machine Learning (ML), especially Deep Learning (DL) to solve Network Intrusion Detection (NID) problems. However, the feature distribution shift problem remains a difficulty,…

Bayesian model comparison (BMC) offers a principled approach for assessing the relative merits of competing computational models and propagating uncertainty into model selection decisions. However, BMC is often intractable for the popular…

机器学习 · 统计学 2023-11-27 Lasse Elsemüller , Martin Schnuerch , Paul-Christian Bürkner , Stefan T. Radev

Bayesian approaches for learning deep neural networks (BNN) have been received much attention and successfully applied to various applications. Particularly, BNNs have the merit of having better generalization ability as well as better…

机器学习 · 统计学 2023-05-25 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Gyuseung Baek , Yongdai Kim

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in many computer vision tasks. However, high computational and storage demands hinder their deployment into resource-constrained environments, such as embedded…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Pallavi Mitra , Gesina Schwalbe , Nadja Klein

Neural networks have revolutionized various domains, exhibiting remarkable accuracy in tasks like natural language processing and computer vision. However, their vulnerability to slight alterations in input samples poses challenges,…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Shashank Kotyan , Danilo Vasconcellos Vargas

The superior performance of some of today's state-of-the-art deep learning models is to some extent owed to extensive (self-)supervised contrastive pretraining on large-scale datasets. In contrastive learning, the network is presented with…

机器学习 · 计算机科学 2022-07-20 Shervin Ardeshir , Navid Azizan

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

机器学习 · 计算机科学 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

We propose Evolutionary Dynamic Loss (EDL), a framework that learns a transferable classification loss in the probability space using unlimited synthetic prediction-label pairs, without accessing real samples during the main loss…

机器学习 · 计算机科学 2026-05-06 Meng Xiang , Yan Pei