English
Related papers

Related papers: Robust Algorithms under Adversarial Injections

200 papers

The Hybrid Online Learning Problem, where features are drawn i.i.d. from an unknown distribution but labels are generated adversarially, is a well-motivated setting positioned between statistical and fully-adversarial online learning. Prior…

Machine Learning · Computer Science 2026-03-06 Princewill Okoroafor , Robert Kleinberg , Michael P. Kim

A technique introduced by Indyk and Woodruff [STOC 2005] has inspired several recent advances in data-stream algorithms. We show that a number of these results follow easily from the application of a single probabilistic method called…

Data Structures and Algorithms · Computer Science 2011-04-26 Alexandr Andoni , Robert Krauthgamer , Krzysztof Onak

We study the problem of computing an approximate maximum cardinality matching in the semi-streaming model when edges arrive in a \emph{random} order. In the semi-streaming model, the edges of the input graph G = (V,E) are given as a stream…

Data Structures and Algorithms · Computer Science 2020-05-04 Aaron Bernstein

The recent advancement in real-world critical infrastructure networks has led to an exponential growth in the use of automated devices which in turn has created new security challenges. In this paper, we study the robust and adaptive…

Computer Science and Game Theory · Computer Science 2020-11-10 Supriyo Ghosh , Patrick Jaillet

We present a streaming problem for which every adversarially-robust streaming algorithm must use polynomial space, while there exists a classical (oblivious) streaming algorithm that uses only polylogarithmic space. This is the first…

Data Structures and Algorithms · Computer Science 2021-02-18 Haim Kaplan , Yishay Mansour , Kobbi Nissim , Uri Stemmer

Many interventions, such as vaccines in clinical trials or coupons in online marketplaces, must be assigned sequentially without full knowledge of their effects. Multi-armed bandit algorithms have proven successful in such settings.…

Machine Learning · Statistics 2026-05-07 Aidan Gleich , Eric Laber , Alexander Volfovsky

Many sequential decision making problems can be formulated as an adaptive submodular maximization problem. However, most of existing studies in this field focus on pool-based setting, where one can pick items in any order, and there have…

Artificial Intelligence · Computer Science 2022-08-18 Shaojie Tang , Jing Yuan

In this work we present an overview of statistical learning, followed by a survey of robust streaming techniques and challenges, culminating in several rigorous results proving the relationship that we motivate and hint at throughout the…

Machine Learning · Computer Science 2023-12-05 Evan Dogariu , Jiatong Yu

Adversarial training is so far the most effective strategy in defending against adversarial examples. However, it suffers from high computational costs due to the iterative adversarial attacks in each training step. Recent studies show that…

Machine Learning · Computer Science 2022-01-03 Jinghui Chen , Yu Cheng , Zhe Gan , Quanquan Gu , Jingjing Liu

Randomization is a powerful tool that endows algorithms with remarkable properties. For instance, randomized algorithms excel in adversarial settings, often surpassing the worst-case performance of deterministic algorithms with large…

Machine Learning · Computer Science 2024-08-21 Johannes von Oswald , Seijin Kobayashi , Yassir Akram , Angelika Steger

In Packet Scheduling with Adversarial Jamming packets of arbitrary sizes arrive over time to be transmitted over a channel in which instantaneous jamming errors occur at times chosen by the adversary and not known to the algorithm. The…

Data Structures and Algorithms · Computer Science 2018-08-07 Martin Böhm , Łukasz Jeż , Jiří Sgall , Pavel Veselý

Despite the enormous success of machine learning models in various applications, most of these models lack resilience to (even small) perturbations in their input data. Hence, new methods to robustify machine learning models seem very…

Machine Learning · Computer Science 2020-10-30 Fariborz Salehi , Babak Hassibi

The blessing of ubiquitous data also comes with a curse: the communication, storage, and labeling of massive, mostly redundant datasets. We seek to solve this problem at its core, collecting only valuable data and throwing out the rest via…

Machine Learning · Computer Science 2023-12-18 Mariel Werner , Anastasios Angelopoulos , Stephen Bates , Michael I. Jordan

Complex autonomous control systems are subjected to sensor failures, cyber-attacks, sensor noise, communication channel failures, etc. that introduce errors in the measurements. The corrupted information, if used for making decisions, can…

Machine Learning · Computer Science 2018-09-19 Abhishek Gupta , Zhaoyuan Yang

This paper investigates the theory of robustness against adversarial attacks. It focuses on the family of randomization techniques that consist in injecting noise in the network at inference time. These techniques have proven effective in…

Machine Learning · Computer Science 2019-06-12 Rafael Pinot , Laurent Meunier , Alexandre Araujo , Hisashi Kashima , Florian Yger , Cédric Gouy-Pailler , Jamal Atif

We investigate the concept of algorithmic replicability introduced by Impagliazzo et al. 2022, Ghazi et al. 2021, Ahn et al. 2024 in an online setting. In our model, the input sequence received by the online learner is generated from…

Machine Learning · Computer Science 2024-11-22 Saba Ahmadi , Siddharth Bhandari , Avrim Blum

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making…

Machine Learning · Statistics 2021-11-17 Takeru Miyato , Andrew M. Dai , Ian Goodfellow

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

We propose a streaming algorithm for the binary classification of data based on crowdsourcing. The algorithm learns the competence of each labeller by comparing her labels to those of other labellers on the same tasks and uses this…

Machine Learning · Statistics 2016-02-24 Thomas Bonald , Richard Combes

This paper considers minimax optimization $\min_x \max_y f(x, y)$ in the challenging setting where $f$ can be both nonconvex in $x$ and nonconcave in $y$. Though such optimization problems arise in many machine learning paradigms including…

Machine Learning · Computer Science 2021-06-04 Tanner Fiez , Chi Jin , Praneeth Netrapalli , Lillian J. Ratliff