中文
相关论文

相关论文: Robust Hypothesis Testing with a Relative Entropy …

200 篇论文

Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that…

机器学习 · 统计学 2022-02-17 Shixiang Zhu , Liyan Xie , Minghe Zhang , Rui Gao , Yao Xie

This paper investigates probabilistic robustness of nonconvex-nonconcave minimax problems via the scenario approach. Specifically, under convex strategy sets for all players, inspired by recent advances in scenario optimization, we first…

计算机科学与博弈论 · 计算机科学 2026-05-14 Huan Peng , Guanpu Chen , Karl Henrik Johansson

We consider exact asymptotics of the minimax risk for global testing against sparse alternatives in the context of high dimensional linear regression. Our results characterize the leading order behavior of this minimax risk in several…

统计理论 · 数学 2020-03-03 Rajarshi Mukherjee , Subhabrata Sen

Given observations from a circular random variable contaminated by an additive measurement error, we consider the problem of minimax optimal goodness-of-fit testing in a non-asymptotic framework. We propose direct and indirect testing…

统计理论 · 数学 2020-07-14 Sandra Schluttenhofer , Jan Johannes

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

统计方法学 · 统计学 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

Based on two independent samples X_1,...,X_m and X_{m+1},...,X_n drawn from multivariate distributions with unknown Lebesgue densities p and q respectively, we propose an exact multiple test in order to identify simultaneously regions of…

统计理论 · 数学 2009-08-12 Angelika Rohde

The problem of detecting a wide-sense stationary Gaussian signal process embedded in white Gaussian noise, where the power spectral density of the signal process exhibits uncertainty, is investigated. The performance of minimax robust…

信息论 · 计算机科学 2010-05-03 Wenyi Zhang , H. Vincent Poor

We observe a $n$-sample, the distribution of which is assumed to belong, or at least to be close enough, to a given mixture model. We propose an estimator of this distribution that belongs to our model and possesses some robustness…

统计理论 · 数学 2025-02-06 Alexandre Lecestre

We study the relative entropy between the empirical estimate of a discrete distribution and the true underlying distribution. If the minimum value of the probability mass function exceeds an $\alpha > 0$ (i.e. when the true underlying…

统计理论 · 数学 2021-09-21 Alankrita Bhatt , Ankit Pensia

The design of asymptotically minimax robust hypothesis testing is formalized for the Bayesian and Neyman-Pearson tests of Type-I and Type-II. The uncertainty classes based on the KL-divergence, $\alpha$-divergence, symmetrized…

信息论 · 计算机科学 2026-04-08 Gökhan Gül

This paper presents a procedure for testing the hypothesis that the underlying distribution of the data is elliptical when using robust location and scatter estimators instead of the sample mean and covariance matrix. Under mild assumptions…

统计方法学 · 统计学 2015-02-20 Ana M. Bianco , Graciela Boente , Isabel M. Rodrigues

We analyze the problem of discrete distribution estimation under $\ell_1$ loss. We provide non-asymptotic upper and lower bounds on the maximum risk of the empirical distribution (the maximum likelihood estimator), and the minimax risk in…

信息论 · 计算机科学 2015-12-31 Yanjun Han , Jiantao Jiao , Tsachy Weissman

We propose a simple robust hypothesis test that has the same sample complexity as that of the optimal Neyman-Pearson test up to constants, but robust to distribution perturbations under Hellinger distance. We discuss the applicability of…

统计理论 · 数学 2020-11-04 Ananda Theertha Suresh

In testing of hypothesis the robustness of the tests is an important concern. Generally, the maximum likelihood based tests are most efficient under standard regularity conditions, but they are highly non-robust even under small deviations…

统计方法学 · 统计学 2018-05-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

Suppose we observe a Poisson process in real time for which the intensity may take on two possible values $\lambda_0$ and $\lambda_1$. Suppose further that the priori probability of the true intensity is not given. We solve a minimax…

统计理论 · 数学 2025-04-25 Hongwei Mei

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

机器学习 · 计算机科学 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density…

统计理论 · 数学 2024-01-05 Y. Baraud , H. Halconruy , G. Maillard

We introduce a robust and fully adaptive method for pointwise estimation in heteroscedastic regression. We allow for noise and design distributions that are unknown and fulfill very weak assumptions only. In particular, we do not impose…

统计理论 · 数学 2014-07-10 Michaël Chichignoud , Johannes Lederer

We give a method for proactively identifying small, plausible shifts in distribution which lead to large differences in model performance. These shifts are defined via parametric changes in the causal mechanisms of observed variables, where…

机器学习 · 计算机科学 2023-01-18 Nikolaj Thams , Michael Oberst , David Sontag

Robust Bayesian inference is the calculation of posterior probability bounds given perturbations in a probabilistic model. This paper focuses on perturbations that can be expressed locally in Bayesian networks through convex sets of…

人工智能 · 计算机科学 2013-02-08 Fabio Gagliardi Cozman