English
Related papers

Related papers: Adaptive and oblivious statistical adversaries are…

200 papers

The robustness of neural networks to intended perturbations has recently attracted significant attention. In this paper, we propose a new method, \emph{learning with a strong adversary}, that learns robust classifiers from supervised data.…

Machine Learning · Computer Science 2016-01-19 Ruitong Huang , Bing Xu , Dale Schuurmans , Csaba Szepesvari

Conformal prediction (CP) provides distribution-free, finite-sample coverage guarantees but critically relies on exchangeability, a condition often violated under distribution shift. We study the robustness of split conformal prediction…

Machine Learning · Statistics 2025-12-23 Xunlei Qian , Yue Xing

In this paper we propose a novel method for detecting adversarial examples by training a binary classifier with both origin data and saliency data. In the case of image classification model, saliency simply explain how the model make…

Machine Learning · Computer Science 2018-03-26 Chiliang Zhang , Zhimou Yang , Zuochang Ye

Adversarial machine learning concerns situations in which learners face attacks from active adversaries. Such scenarios arise in applications such as spam email filtering, malware detection and fake-image generation, where security methods…

Machine Learning · Computer Science 2024-10-29 David Benfield , Stefano Coniglio , Martin Kunc , Phan Tu Vuong , Alain Zemkoho

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with…

Machine Learning · Computer Science 2018-12-19 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

Despite the great success achieved in machine learning (ML), adversarial examples have caused concerns with regards to its trustworthiness: A small perturbation of an input results in an arbitrary failure of an otherwise seemingly…

Machine Learning · Computer Science 2018-10-24 Jingkang Wang , Ruoxi Jia , Gerald Friedland , Bo Li , Costas Spanos

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

Machine Learning · Computer Science 2023-06-14 Omar Montasser

Algorithmic robust statistics has traditionally focused on the contamination model where a small fraction of the samples are arbitrarily corrupted. We consider a recent contamination model that combines two kinds of corruptions: (i) small…

Data Structures and Algorithms · Computer Science 2024-10-23 Thanasis Pittas , Ankit Pensia

Neural networks are known to be vulnerable to adversarial examples: inputs that are close to natural inputs but classified incorrectly. In order to better understand the space of adversarial examples, we survey ten recent proposals that are…

Machine Learning · Computer Science 2017-11-02 Nicholas Carlini , David Wagner

Random samples are lossy summaries which allow queries posed over the data to be approximated by applying an appropriate estimator to the sample. The effectiveness of sampling, however, hinges on estimator selection. The choice of…

Statistics Theory · Mathematics 2014-04-10 Edith Cohen

Adversarial examples have raised several open questions, such as why they can deceive classifiers and transfer between different models. A prevailing hypothesis to explain these phenomena suggests that adversarial perturbations appear as…

Machine Learning · Computer Science 2025-01-22 Soichiro Kumano , Hiroshi Kera , Toshihiko Yamasaki

There has been much recent interest in understanding the continuum from adversarial to stochastic settings in online learning, with various frameworks including smoothed settings proposed to bridge this gap. We consider the more general and…

Machine Learning · Statistics 2025-06-19 Moïse Blanchard , Samory Kpotufe

We examine the relationship between learnability and robust (or agnostic) learnability for the problem of distribution learning. We show that, contrary to other learning settings (e.g., PAC learning of function classes), realizable…

Machine Learning · Statistics 2024-06-27 Shai Ben-David , Alex Bie , Gautam Kamath , Tosca Lechner

Despite the remarkable advances that have been made in continual learning, the adversarial vulnerability of such methods has not been fully discussed. We delve into the adversarial robustness of memory-based continual learning algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoyue Mi , Fan Tang , Zonghan Yang , Danding Wang , Juan Cao , Peng Li , Yang Liu

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

In recent years, the topic of explainable machine learning (ML) has been extensively researched. Up until now, this research focused on regular ML users use-cases such as debugging a ML model. This paper takes a different posture and show…

Cryptography and Security · Computer Science 2022-06-02 Ishai Rosenberg , Shai Meir , Jonathan Berrebi , Ilay Gordon , Guillaume Sicard , Eli David

We investigate the challenge of establishing stochastic-like guarantees when sequentially learning from a stream of i.i.d. data that includes an unknown quantity of clean-label adversarial samples. We permit the learner to abstain from…

Machine Learning · Computer Science 2025-04-22 Carolin Heinzler

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

Machine Learning · Computer Science 2023-10-05 Matan Levi , Aryeh Kontorovich

Poisoning attacks have emerged as a significant security threat to machine learning algorithms. It has been demonstrated that adversaries who make small changes to the training set, such as adding specially crafted data points, can hurt the…

Machine Learning · Computer Science 2021-12-14 Samuel Deng , Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody , Abhradeep Thakurta

Despite achieving impressive performance, state-of-the-art classifiers remain highly vulnerable to small, imperceptible, adversarial perturbations. This vulnerability has proven empirically to be very intricate to address. In this paper, we…

Machine Learning · Computer Science 2018-12-03 Alhussein Fawzi , Hamza Fawzi , Omar Fawzi