English
Related papers

Related papers: Statistical Classification via Robust Hypothesis T…

200 papers

Two-sample testing is a fundamental problem in statistics. Despite its long history, there has been renewed interest in this problem with the advent of high-dimensional and complex data. Specifically, in the machine learning literature,…

Methodology · Statistics 2019-11-19 Ilmun Kim , Ann B. Lee , Jing Lei

Hypothesis tests are a crucial statistical tool for data mining and are the workhorse of scientific research in many fields. Here we study differentially private tests of independence between a categorical and a continuous variable. We take…

Methodology · Statistics 2019-03-25 Simon Couch , Zeki Kazan , Kaiyan Shi , Andrew Bray , Adam Groce

In this work, we revisit the problem of uniformity testing of discrete probability distributions. A fundamental problem in distribution testing, testing uniformity over a known domain has been addressed over a significant line of works, and…

Data Structures and Algorithms · Computer Science 2017-08-17 Tuğkan Batu , Clément L. Canonne

In this paper a robust version of the classical Wald test statistics for linear hypothesis in the logistic regression model is introduced and its properties are explored. We study the problem under the assumption of random covariates…

Statistics Theory · Mathematics 2019-05-09 Ayandrendanath Basu , Abhik Ghosh , Abhijit Mandal , Nirian Martin , Leandro Pardo

Adaptivity is an important feature of data analysis---the choice of questions to ask about a dataset often depends on previous interactions with the same dataset. However, statistical validity is typically studied in a nonadaptive model,…

Machine Learning · Computer Science 2015-11-10 Raef Bassily , Kobbi Nissim , Adam Smith , Thomas Steinke , Uri Stemmer , Jonathan Ullman

Real-life data are often non-IID due to complex distributions and interactions, and the sensitivity to the distribution of samples can differ among learning models. Accordingly, a key question for any supervised or unsupervised model is…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao

This paper introduces a new method for testing the statistical significance of estimated parameters in predictive regressions. The approach features a new family of test statistics that are robust to the degree of persistence of the…

Econometrics · Economics 2025-02-04 Jean-Yves Pitarakis

We study a variant of the simple hypothesis testing problem where observed samples do not necessarily come from either of the specified distributions, but rather from a close variant of them. In this setting, we require a test that is…

Statistics Theory · Mathematics 2026-04-21 Eeshan Modak , Sivaraman Balakrishnan , Ananda Theertha Suresh

Testing practices within the machine learning (ML) community have centered around assessing a learned model's predictive performance measured against a test dataset, often drawn from the same distribution as the training dataset. While…

Machine Learning · Computer Science 2021-12-07 Negar Rostamzadeh , Ben Hutchinson , Christina Greer , Vinodkumar Prabhakaran

The ``sample amplification'' problem formalizes the following question: Given $n$ i.i.d. samples drawn from an unknown distribution $P$, when is it possible to produce a larger set of $n+m$ samples which cannot be distinguished from $n+m$…

Statistics Theory · Mathematics 2024-09-19 Brian Axelrod , Shivam Garg , Yanjun Han , Vatsal Sharan , Gregory Valiant

Deep learning models are known to be overconfident in their predictions on out of distribution inputs. There have been several pieces of work to address this issue, including a number of approaches for building Bayesian neural networks, as…

Machine Learning · Statistics 2018-12-04 Kumar Sricharan , Ashok Srivastava

This paper considers a problem of distributed hypothesis testing and social learning. Individual nodes in a network receive noisy local (private) observations whose distribution is parameterized by a discrete parameter (hypotheses). The…

Statistics Theory · Mathematics 2016-05-17 Anusha Lalitha , Tara Javidi , Anand Sarwate

Distribution shifts remain a fundamental problem for the safe application of machine learning systems. If undetected, they may impact the real-world performance of such systems or will at least render original performance claims invalid. In…

Machine Learning · Computer Science 2023-03-10 Lisa M. Koch , Christian M. Schürch , Christian F. Baumgartner , Arthur Gretton , Philipp Berens

The huge amount of available data nowadays is a challenge for kernel-based machine learning algorithms like SVMs with respect to runtime and storage capacities. Local approaches might help to relieve these issues and to improve statistical…

Machine Learning · Statistics 2019-03-05 Florian Dumpert

There is a well-known problem in Null Hypothesis Significance Testing: many statistically significant results fail to replicate in subsequent experiments. We show that this problem arises because standard `point-form null' significance…

Methodology · Statistics 2025-02-06 Fintan Costello , Paul Watts

We are interested in the problem of robust parametric estimation of a density from $n$ i.i.d. observations. By using a practice-oriented procedure based on robust tests, we build an estimator for which we establish non-asymptotic risk…

Statistics Theory · Mathematics 2016-03-31 Mathieu Sart

Consider $n$ independent measurements, with the additional information of the times at which measurements are performed. This paper deals with testing statistical hypotheses when $n$ is large and only a small amount of observations…

Methodology · Statistics 2018-09-26 Emanuele Dolera , Stefano Favaro , Andrea Bulgarelli , Alessio Aboudan

We study a robust alternative to empirical risk minimization called distributionally robust learning (DRL), in which one learns to perform against an adversary who can choose the data distribution from a specified set of distributions. We…

Machine Learning · Computer Science 2019-12-19 Charlie Frogner , Sebastian Claici , Edward Chien , Justin Solomon

Testing hypotheses of goodness-of-fit about mixture distributions on the basis of independent but not necessarily identically distributed random vectors is considered. The hypotheses are given by a specific distribution or by a family of…

Statistics Theory · Mathematics 2016-04-21 Daniel Gaigall

Deep learning methods have proved highly effective for classification and image recognition problems. In this paper, we ask whether this success can be transferred to hypothesis testing: if a neural network can distinguish, for example, an…

Machine Learning · Statistics 2026-04-30 Gery Geenens , Pierre Lafaye de Micheaux , Ivan Muyun Zou