English
Related papers

Related papers: Adversarial Robustness Guarantees for Classificati…

200 papers

Energy-based learning algorithms, such as predictive coding (PC), have garnered significant attention in the machine learning community due to their theoretical properties, such as local operations and biologically plausible mechanisms for…

Machine Learning · Computer Science 2024-10-08 Ankur Mali , Tommaso Salvatori , Alexander Ororbia

Neural networks are frequently used for image classification, but can be vulnerable to misclassification caused by adversarial images. Attempts to make neural network image classification more robust have included variations on…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Basemah Alshemali , Alta Graham , Jugal Kalita

Adversarial training is a principled approach for training robust neural networks. Despite of tremendous successes in practice, its theoretical properties still remain largely unexplored. In this paper, we provide new theoretical insights…

Machine Learning · Computer Science 2019-07-29 Yan Li , Ethan X. Fang , Huan Xu , Tuo Zhao

Model selection aims to find the best model in terms of accuracy, interpretability or simplicity, preferably all at once. In this work, we focus on evaluating model performance of Gaussian process models, i.e. finding a metric that provides…

Machine Learning · Computer Science 2024-03-15 Andreas Besginow , Jan David Hüwel , Thomas Pawellek , Christian Beecks , Markus Lange-Hegermann

Despite their numerous successes, there are many scenarios where adversarial risk metrics do not provide an appropriate measure of robustness. For example, test-time perturbations may occur in a probabilistic manner rather than being…

Machine Learning · Statistics 2021-08-03 Benjie Wang , Stefan Webb , Tom Rainforth

We introduce a new scalable approximation for Gaussian processes with provable guarantees which hold simultaneously over its entire parameter space. Our approximation is obtained from an improved sample complexity analysis for sparse…

Machine Learning · Computer Science 2020-11-18 Quang Minh Hoang , Trong Nghia Hoang , Hai Pham , David P. Woodruff

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

Gaussian process (GP) regression is a non-parametric, Bayesian framework to approximate complex models. Standard GP regression can lead to an unbounded model in which some points can take infeasible values. We introduce a new GP method that…

Machine Learning · Statistics 2024-04-04 Didem Kochan , Xiu Yang

The problem of adversarial robustness has been studied extensively for neural networks. However, for boosted decision trees and decision stumps there are almost no results, even though they are widely used in practice (e.g. XGBoost) due to…

Machine Learning · Computer Science 2019-11-01 Maksym Andriushchenko , Matthias Hein

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Convolutional neural networks (CNNs) have achieved state-of-the-art performance on various tasks in computer vision. However, recent studies demonstrate that these models are vulnerable to carefully crafted adversarial samples and suffer…

Machine Learning · Computer Science 2020-12-15 Xin Li , Xiangrui Li , Deng Pan , Dongxiao Zhu

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

Gaussian Process Regression (GPR) is a nonparametric supervised learning method, widely valued for its ability to quantify uncertainty. Despite its advantages and broad applications, classical GPR implementations face significant…

Quantum Physics · Physics 2025-03-25 Junpeng Hu , Jinglai Li , Lei Zhang , Shi Jin

We propose a method to learn deep ReLU-based classifiers that are provably robust against norm-bounded adversarial perturbations on the training data. For previously unseen examples, the approach is guaranteed to detect all adversarial…

Machine Learning · Computer Science 2018-06-12 Eric Wong , J. Zico Kolter

Current remote sensing image classification problems have to deal with an unprecedented amount of heterogeneous and complex data sources. Upcoming missions will soon provide large data streams that will make land cover/use classification…

Machine Learning · Computer Science 2017-10-04 Pablo Morales-Alvarez , Adrian Perez-Suay , Rafael Molina , Gustau Camps-Valls

Learning using privileged information is an attractive problem setting that helps many learning scenarios in the real world. A state-of-the-art method of Gaussian process classification (GPC) with privileged information is GPC+, which…

Machine Learning · Statistics 2018-02-13 Ryosuke Kamesawa , Issei Sato , Masashi Sugiyama

The study of adversarial robustness has so far largely focused on perturbations bound in p-norms. However, state-of-the-art models turn out to be also vulnerable to other, more natural classes of perturbations such as translations and…

Machine Learning · Computer Science 2019-09-17 Logan Engstrom , Brandon Tran , Dimitris Tsipras , Ludwig Schmidt , Aleksander Madry

Smoothing classifiers and probability density functions with Gaussian kernels appear unrelated, but in this work, they are unified for the problem of robust classification. The key building block is approximating the $\textit{energy…

Machine Learning · Statistics 2020-05-12 Saeed Saremi , Rupesh Srivastava

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

Machine Learning · Computer Science 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

The learning with privileged information setting has recently attracted a lot of attention within the machine learning community, as it allows the integration of additional knowledge into the training process of a classifier, even when this…