English
Related papers

Related papers: Adversarially Robust PAC Learnability of Real-Valu…

200 papers

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

Machine Learning · Computer Science 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

Statistical learning theory chiefly studies restricted hypothesis classes, particularly those with finite Vapnik-Chervonenkis (VC) dimension. The fundamental quantity of interest is the sample complexity: the number of samples required to…

Machine Learning · Computer Science 2008-07-10 David Soloveichik

Neural networks are proven to be remarkably successful for classification and diagnosis in medical applications. However, the ambiguity in the decision-making process and the interpretability of the learned features is a matter of concern.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Ashkan Khakzar , Shadi Albarqouni , Nassir Navab

Machine learning models are often susceptible to adversarial perturbations of their inputs. Even small perturbations can cause state-of-the-art classifiers with high "standard" accuracy to produce an incorrect prediction with high…

Machine Learning · Computer Science 2018-05-03 Ludwig Schmidt , Shibani Santurkar , Dimitris Tsipras , Kunal Talwar , Aleksander Mądry

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. One of the fundamental problems in adversarial machine learning is to quantify how much training data is needed in the…

Machine Learning · Computer Science 2023-08-24 Pascale Gourdeau

Collective learning methods exploit relations among data points to enhance classification performance. However, such relations, represented as edges in the underlying graphical model, expose an extra attack surface to the adversaries. We…

Machine Learning · Computer Science 2020-07-28 Kai Zhou , Yevgeniy Vorobeychik

This paper analyzes $\ell_1$ regularized linear regression under the challenging scenario of having only adversarially corrupted data for training. We use the primal-dual witness paradigm to provide provable performance guarantees for the…

Machine Learning · Computer Science 2022-12-23 Deepak Maurya , Jean Honorio

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

Machine Learning · Statistics 2019-09-30 Logan Engstrom , Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Brandon Tran , Aleksander Madry

Adversarial training is one of the most effective approaches to improve model robustness against adversarial examples. However, previous works mainly focus on the overall robustness of the model, and the in-depth analysis on the role of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Qi Tian , Kun Kuang , Kelu Jiang , Fei Wu , Yisen Wang

Representation learning has emerged as a powerful paradigm for extracting valuable latent features from complex, high-dimensional data. In financial domains, learning informative representations for assets can be used for tasks like sector…

Machine Learning · Computer Science 2024-07-29 Rian Dolphin , Barry Smyth , Ruihai Dong

Making learners robust to adversarial perturbation at test time (i.e., evasion attacks) or training time (i.e., poisoning attacks) has emerged as a challenging task. It is known that for some natural settings, sublinear perturbations in the…

Machine Learning · Computer Science 2018-11-07 Saeed Mahloujifar , Mohammad Mahmoody

Provably sample-efficient Reinforcement Learning (RL) with rich observations and function approximation has witnessed tremendous recent progress, particularly when the underlying function approximators are linear. In this linear regime,…

Machine Learning · Computer Science 2024-08-09 Alekh Agarwal , Tong Zhang

We study the problem of PAC learning halfspaces in the reliable agnostic model of Kalai et al. (2012). The reliable PAC model captures learning scenarios where one type of error is costlier than the others. Our main positive result is a new…

Machine Learning · Computer Science 2024-11-19 Ilias Diakonikolas , Lisheng Ren , Nikos Zarifis

Adversarial training aims to defend against adversaries: malicious opponents whose sole aim is to harm predictive performance in any way possible. This presents a rather harsh perspective, which we assert results in unnecessarily…

Machine Learning · Computer Science 2025-06-10 Maayan Ehrenberg , Roy Ganz , Nir Rosenfeld

A fundamental question in reinforcement learning theory is: suppose the optimal value functions are linear in given features, can we learn them efficiently? This problem's counterpart in supervised learning, linear regression, can be solved…

Machine Learning · Computer Science 2023-02-28 Daniel Kane , Sihan Liu , Shachar Lovett , Gaurav Mahajan , Csaba Szepesvári , Gellért Weisz

Reinforcement learning has shown promise in learning policies that can solve complex problems. However, manually specifying a good reward function can be difficult, especially for intricate tasks. Inverse reinforcement learning offers a…

Machine Learning · Computer Science 2017-11-28 Peter Henderson , Wei-Di Chang , Pierre-Luc Bacon , David Meger , Joelle Pineau , Doina Precup

Valiant's 1984 paper is widely credited with introducing the PAC learning model, but it, in fact, introduced a different model: unlike PAC learning, the learner receives only positives, may issue membership queries, and must output a…

Machine Learning · Statistics 2026-05-14 Steve Hanneke , Anay Mehrotra , Grigoris Velegkas , Manolis Zampetakis

Machine learning is now ubiquitous in societal decision-making, for example in evaluating job candidates or loan applications, and it is increasingly important to take into account how classified agents will react to the learning…

Machine Learning · Computer Science 2025-08-08 Dravyansh Sharma , Alec Sun

The concept class of low-degree polynomial threshold functions (PTFs) plays a fundamental role in machine learning. In this paper, we study PAC learning of $K$-sparse degree-$d$ PTFs on $\mathbb{R}^n$, where any such concept depends only on…

Data Structures and Algorithms · Computer Science 2024-03-20 Shiwei Zeng , Jie Shen