English
Related papers

Related papers: Memory Constrained Adversarial Hypothesis Testing

200 papers

We study online learning in constrained Markov decision processes (CMDPs) with adversarial losses and stochastic hard constraints, under bandit feedback. We consider three scenarios. In the first one, we address general CMDPs, where we…

Machine Learning · Computer Science 2025-02-10 Francesco Emanuele Stradi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Machine learning models are usually evaluated according to the average case performance on the test set. However, this is not always ideal, because in some sensitive domains (e.g. autonomous driving), it is the worst case performance that…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Michelle Shu , Chenxi Liu , Weichao Qiu , Alan Yuille

The Adversarially Learned Mixture Model (AMM) is a generative model for unsupervised or semi-supervised data clustering. The AMM is the first adversarially optimized method to model the conditional dependence between inferred continuous and…

Machine Learning · Statistics 2022-04-26 Andrew Jesson , Cécile Low-Kam , Tanya Nair , Florian Soudan , Florent Chandelier , Nicolas Chapados

This paper gives tight logarithmic lower bounds on the solo step complexity of leader election in an asynchronous shared-memory model with single-writer multi-reader (SWMR) registers, for randomized obstruction-free algorithms. The approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-28 Dan Alistarh , Rati Gelashvili , Giorgi Nadiradze

Designing bounded-memory algorithms is becoming increasingly important nowadays. Previous works studying bounded-memory algorithms focused on proving impossibility results, while the design of bounded-memory algorithms was left relatively…

Machine Learning · Computer Science 2019-10-15 Michal Moshkovitz , Naftali Tishby

In this work, which is based on the family of Fractional Iterated Ornstein Uhlenbeck processes, we propose a new hypothesis test to contrast short memory versus long memory in time series. This family includes short memory and long memory…

Statistics Theory · Mathematics 2021-12-22 Juan Kalemkerian , Andrés Sosa

This paper investigates symmetric composite binary quantum hypothesis testing (QHT), where the goal is to determine which of two uncertainty sets contains an unknown quantum state. While asymptotic error exponents for this problem are…

Quantum Physics · Physics 2026-04-13 Jacob Paul Simpson , Efstratios Palias , Sharu Theresa Jose

Two alternative exact characterizations of the minimum error probability of Bayesian M-ary hypothesis testing are derived. The first expression corresponds to the error probability of an induced binary hypothesis test and implies the…

Information Theory · Computer Science 2016-04-07 Gonzalo Vazquez-Vilar , Adrià Tauste Campo , Albert Guillén i Fàbregas , Alfonso Martinez

We study the error of linear regression in the face of adversarial attacks. In this framework, an adversary changes the input to the regression model in order to maximize the prediction error. We provide bounds on the prediction error in…

Machine Learning · Statistics 2023-03-29 Antônio H. Ribeiro , Thomas B. Schön

The problem of universally predicting an individual continuous sequence using a deterministic finite-state machine (FSM) is considered. The empirical mean is used as a reference as it is the constant that fits a given sequence within a…

Information Theory · Computer Science 2013-02-07 Ronen Dar , Meir feder

Neural networks work remarkably well in practice and theoretically they can be universal approximators. However, they still make mistakes and a specific type of them called adversarial errors seem inexcusable to humans. In this work, we…

Machine Learning · Computer Science 2022-04-27 Pieter-Jan Kindermans , Charles Staats

A measurement strategy is developed for a new kind of hypothesis testing. It assigns, with minimum probability of error, the state of a quantum system to one or the other of two complementary subsets of a set of N given non-orthogonal…

Quantum Physics · Physics 2009-11-07 Ulrike Herzog , Janos A. Bergou

Multi-agent consensus problems can often be seen as a sequence of autonomous and independent local choices between a finite set of decision options, with each local choice undertaken simultaneously, and with a shared goal of achieving a…

Artificial Intelligence · Computer Science 2021-05-12 David Kohan Marzagão , Luciana Basualdo Bonatto , Tiago Madeira , Marcelo Matheus Gauy , Peter McBurney

The problem of simultaneously testing the marginal distributions of sequentially monitored, independent data streams is considered. The decisions for the various testing problems can be made at different times, using data from all streams,…

Methodology · Statistics 2023-04-21 Yiming Xing , Georgios Fellouris

We study the constrained variant of the \emph{multi-armed bandit} (MAB) problem, in which the learner aims not only at minimizing the total loss incurred during the learning dynamic, but also at controlling the violation of multiple…

Machine Learning · Computer Science 2026-02-17 Francesco Emanuele Stradi , Kalana Kalupahana , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

We consider the problem of binary classification with abstention in the relatively less studied \emph{bounded-rate} setting. We begin by obtaining a characterization of the Bayes optimal classifier for an arbitrary input-label distribution…

Machine Learning · Computer Science 2019-05-24 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

Deep convolutional neural networks can be highly vulnerable to small perturbations of their inputs, potentially a major issue or limitation on system robustness when using deep networks as classifiers. In this paper we propose a low-cost…

Machine Learning · Computer Science 2019-12-16 Amir Nazemi , Paul Fieguth

Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Uriya Pesso , Koby Bibas , Meir Feder

We study a distributed hypothesis testing setup where peripheral nodes send quantized data to the fusion center in a memoryless fashion. The \emph{expected} number of bits sent by each node under the null hypothesis is kept limited. We…

Information Theory · Computer Science 2022-06-27 Yunus Inan , Mert Kayaalp , Ali H. Sayed , Emre Telatar

We study a class of distributed hypothesis testing against conditional independence problems. Under the criterion that stipulates minimization of the Type II error rate subject to a (constant) upper bound $\epsilon$ on the Type I error…

Information Theory · Computer Science 2019-04-08 Abdellatif Zaidi , Inaki Estella Aguerri