English
Related papers

Related papers: Constructing Bayes Minimax Estimators through Inte…

200 papers

The Bayesian approach to machine learning amounts to computing posterior distributions of random variables from a probabilistic model of how the variables are related (that is, a prior distribution) and a set of observations of variables.…

Logic in Computer Science · Computer Science 2015-07-01 Johannes Borgström , Andrew D Gordon , Michael Greenberg , James Margetson , Jurgen Van Gael

For normal canonical models, and more generally a vast array of general spherically symmetric location-scale models with a residual vector, we consider estimating the (univariate) location parameter when it is lower bounded. We provide…

Statistics Theory · Mathematics 2012-07-24 Mohammad Jafari Jozani , Eric Marchand , William Strawderman

This paper provides a general technique for lower bounding the Bayes risk of statistical estimation, applicable to arbitrary loss functions and arbitrary prior distributions. A lower bound on the Bayes risk not only serves as a lower bound…

Statistics Theory · Mathematics 2016-12-26 Xi Chen , Adityanand Guntuboyina , Yuchen Zhang

In this work, we delve into the nonparametric empirical Bayes theory and approximate the classical Bayes estimator by a truncation of the generalized Laguerre series and then estimate its coefficients by minimizing the prior risk of the…

Statistics Theory · Mathematics 2021-12-17 Rida Benhaddou , Matthew Connell

Model estimates obtained from traditional subspace identification methods may be subject to significant variance. This elevated variance is aggravated in the cases of large models or of a limited sample size. Common solutions to reduce the…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Alexandre Rodrigues Mesquita

We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics,…

Statistics Theory · Mathematics 2023-12-27 Akifumi Okuno , Masaaki Imaizumi

When dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data-driven solution to this problem by estimating the prior itself from an ensemble of data. In the…

Methodology · Statistics 2020-05-13 Ilja Klebanov , Alexander Sikorski , Christof Schütte , Susanna Röblitz

We investigate minimax estimators for quantum state tomography under general Bregman divergences. First, generalizing the work of Komaki et al. $\href{http://dx.doi.org/10.3390/e19110618}{\textrm{[Entropy 19, 618 (2017)]}}$ for relative…

Quantum Physics · Physics 2019-03-12 Maria Quadeer , Marco Tomamichel , Christopher Ferrie

Bayesian methods for low-rank matrix completion with noise have been shown to be very efficient computationally. While the behaviour of penalized minimization methods is well understood both from the theoretical and computational points of…

Statistics Theory · Mathematics 2015-04-08 The Tien Mai , Pierre Alquier

A common way of characterizing minimax estimators in point estimation is by moving the problem into the Bayesian estimation domain and finding a least favorable prior distribution. The Bayesian estimator induced by a least favorable prior,…

Machine Learning · Statistics 2022-02-24 Alex Dytso , Mario Goldenbaum , H. Vincent Poor , Shlomo Shamai

We consider the problem of estimating the error variance in a general linear model when the error distribution is assumed to be spherically symmetric, but not necessary Gaussian. In particular we study the case of a scale mixture of…

Statistics Theory · Mathematics 2013-03-18 Yuzo Maruyama , William E. Strawderman

This paper proposes consistent estimators for transformation parameters in semiparametric models. The problem is to find the optimal transformation into the space of models with a predetermined regression structure like additive or…

Statistics Theory · Mathematics 2008-12-18 Oliver Linton , Stefan Sperlich , Ingrid Van Keilegom

This article discusses estimation of a multivariate normal mean based on heteroscedastic observations. Under heteroscedasticity, estimators shrinking more on the coordinates with larger variances, seem desirable. Although they are not…

Statistics Theory · Mathematics 2022-06-23 Yuzo Maruyama , Lawrence D. Brown , Edward I. George

Bayes estimators are well known to provide a means to incorporate prior knowledge that can be expressed in terms of a single prior distribution. However, when this knowledge is too vague to express with a single prior, an alternative…

Methodology · Statistics 2023-09-04 Hongxiang Qiu , Alex Luedtke

Inference about dependencies in a multiway data array can be made using the array normal model, which corresponds to the class of multivariate normal distributions with separable covariance matrices. Maximum likelihood and Bayesian methods…

Statistics Theory · Mathematics 2018-06-20 David Gerard , Peter Hoff

This article presents new methodology for sample-based Bayesian inference when data are partitioned and communication between the parts is expensive, as arises by necessity in the context of "big data" or by choice in order to take…

Methodology · Statistics 2022-11-01 Marc Box

The Robbins estimator is the most iconic and widely used procedure in the empirical Bayes literature for the Poisson model. On one hand, this method has been recently shown to be minimax optimal in terms of the regret (excess risk over the…

Statistics Theory · Mathematics 2025-09-16 Soham Jana , Yury Polyanskiy , Yihong Wu

We consider nonparametric Bayesian inference in a multidimensional diffusion model with reflecting boundary conditions based on discrete high-frequency observations. We prove a general posterior contraction rate theorem in $L^2$-loss, which…

Statistics Theory · Mathematics 2025-08-12 Marc Hoffmann , Kolyan Ray

This paper discusses regularized estimators in the multivariate statistical model as tools naturally arising within a Bayesian framework. First, a link is established between Bayesian estimation and inference under parameter rounding…

Methodology · Statistics 2025-09-15 Jan Kalina

In this paper, decision theory was used to derive Bayes and minimax decision rules to estimate allelic frequencies and to explore their admissibility. Decision rules with uniformly smallest risk usually do not exist and one approach to…

Quantitative Methods · Quantitative Biology 2015-08-25 Carlos Alberto Martínez , Kshitij Khare , Mauricio A. Elzo