English
Related papers

Related papers: Robust Hypothesis Testing with a Relative Entropy …

200 papers

We study the problem of mismatched likelihood ratio test. We analyze the type-\RNum{1} and \RNum{2} error exponents when the actual distributions generating the observation are different from the distributions used in the test. We derive…

Information Theory · Computer Science 2020-01-14 Parham Boroumand , Albert Guillen i Fabregas

Rejecting the null hypothesis in two-sample testing is a fundamental tool for scientific discovery. Yet, aside from concluding that two samples do not come from the same probability distribution, it is often of interest to characterize how…

Statistics Theory · Mathematics 2021-09-08 Boris Landa , Rihao Qu , Joseph Chang , Yuval Kluger

We consider settings in which the distribution of a multivariate random variable is partly ambiguous. We assume the ambiguity lies on the level of the dependence structure, and that the marginal distributions are known. Furthermore, a…

Mathematical Finance · Quantitative Finance 2020-05-27 Stephan Eckstein , Michael Kupper , Mathias Pohl

The concept of biased data is well known and its practical applications range from social sciences and biology to economics and quality control. These observations arise when a sampling procedure chooses an observation with probability that…

Statistics Theory · Mathematics 2007-06-13 Sam Efromovich

Study samples often differ from the target populations of inference and policy decisions in non-random ways. Researchers typically believe that such departures from random sampling -- due to changes in the population over time and space, or…

Methodology · Statistics 2023-07-20 Tamara Broderick , Ryan Giordano , Rachael Meager

We study the problem of hypothesis testing between two discrete distributions, where we only have access to samples after the action of a known reversible Markov chain, playing the role of noise. We derive instance-dependent minimax rates…

Statistics Theory · Mathematics 2018-08-15 Quentin Berthet , Varun Kanade

We study robust testing and estimation of discrete distributions in the strong contamination model. We consider both the "centralized setting" and the "distributed setting with information constraints" including communication and local…

Information Theory · Computer Science 2021-04-23 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

While neural networks have achieved high performance in different learning tasks, their accuracy drops significantly in the presence of small adversarial perturbations to inputs. Defenses based on regularization and adversarial training are…

Machine Learning · Computer Science 2019-02-07 Sahil Singla , Soheil Feizi

We consider a compound testing problem within the Gaussian sequence model in which the null and alternative are specified by a pair of closed, convex cones. Such cone testing problem arise in various applications, including detection of…

Statistics Theory · Mathematics 2018-03-28 Yuting Wei , Martin J. Wainwright , Adityanand Guntuboyina

Machine learning models are known to be susceptible to adversarial attacks which can cause misclassification by introducing small but well designed perturbations. In this paper, we consider a classical hypothesis testing problem in order to…

Machine Learning · Statistics 2022-09-07 Bhagyashree Puranik , Upamanyu Madhow , Ramtin Pedarsani

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

Machine Learning · Computer Science 2021-01-06 Jaeho Lee , Maxim Raginsky

Robust Bayesian analysis has been mainly devoted to detecting and measuring robustness w.r.t. the prior distribution. Many contributions in the literature aim to define suitable classes of priors which allow the computation of variations of…

Statistics Theory · Mathematics 2025-09-04 Antonio Di Noia , Fabrizio Ruggeri , Antonietta Mira

Despite the many recent advances in reinforcement learning (RL), the question of learning policies that robustly satisfy state constraints under unknown disturbances remains open. In this paper, we offer a new perspective on achieving…

Machine Learning · Computer Science 2025-12-23 Pierre-François Massiani , Alexander von Rohr , Lukas Haverbeck , Sebastian Trimpe

We present a local density estimator based on first order statistics. To estimate the density at a point, $x$, the original sample is divided into subsets and the average minimum sample distance to $x$ over all such subsets is used to…

Methodology · Statistics 2014-12-10 Vikram V. Garg , Luis Tenorio , Karen Willcox

We study maximum-entropy inference for finite-dimensional quantum states under linear moment constraints. Given expectation values of finitely many observables, the feasible set of states is convex but typically non-unique. The…

Quantum Physics · Physics 2025-10-27 James Tian

A safety verification task involves verifying a system against a desired safety property under certain assumptions about the environment. However, these environmental assumptions may occasionally be violated due to modeling errors or…

Systems and Control · Electrical Eng. & Systems 2023-06-05 Rômulo Meira-Góes , Ian Dardik , Eunsuk Kang , Stéphane Lafortune , Stavros Tripakis

We consider a distributionally robust stochastic optimization problem and formulate it as a stochastic two-level composition optimization problem with the use of the mean--semideviation risk measure. In this setting, we consider a single…

Optimization and Control · Mathematics 2023-06-12 Landi Zhu , Mert Gürbüzbalaban , Andrzej Ruszczyński

Experimental designs that are minimax in the presence of model misspecifications have been constructed so as to minimize the maximum, over classes of alternate response models, of the integrated mean squared error of the predicted values.…

Statistics Theory · Mathematics 2026-04-27 Rui Hu , Douglas P. Wiens

The statistics and machine learning communities have recently seen a growing interest in classification-based approaches to two-sample testing. The outcome of a classification-based two-sample test remains a rejection decision, which is not…

Statistics Theory · Mathematics 2022-11-15 Loris Michel , Jeffrey Näf , Nicolai Meinshausen

We consider the problem of sequentially testing a simple null hypothesis versus a composite alternative hypothesis that consists of a finite set of densities. We study sequential tests that are based on thresholding of mixture-based…

Statistics Theory · Mathematics 2013-01-23 Georgios Fellouris , Alexander G. Tartakovsky