English
Related papers

Related papers: Shrinkage Estimation in Multilevel Normal Models

200 papers

Stein operators allow to characterise probability distributions via differential operators. Based on these characterisations, we develop a new method of point estimation for marginal parameters of strictly stationary and ergodic processes,…

Statistics Theory · Mathematics 2024-12-05 Bruno Ebner , Adrian Fischer , Robert E. Gaunt , Babette Picker , Yvik Swan

Isotonic regression or monotone function estimation is a problem of estimating function values under monotonicity constraints, which appears naturally in many scientific fields. This paper proposes a new Bayesian method with global-local…

Methodology · Statistics 2024-02-07 Ryo Okano , Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

The sample selection bias problem arises when a variable of interest is correlated with a latent variable, and involves situations in which the response variable had part of its observations censored. Heckman (1976) proposed a sample…

Methodology · Statistics 2022-06-22 Helton Saulo , Roberto Vila , Shayane S. Cordeiro

The advent of large-scale inference has spurred reexamination of conventional statistical thinking. In a Gaussian model for $n$ many $z$-scores with at most $k < \frac{n}{2}$ nonnulls, Efron suggests estimating the location and scale…

Statistics Theory · Mathematics 2025-01-15 Subhodh Kotekal , Chao Gao

This is a follow-up paper of Polson and Scott (2012, Bayesian Analysis), which claimed that the half-Cauchy prior is a sensible default prior for a scale parameter in hierarchical models. For estimation of a p-variate normal mean under the…

Statistics Theory · Mathematics 2024-06-14 Yuzo Maruyama , Takeru Matsuda

This paper studies the sparse normal mean models under the empirical Bayes framework. We focus on the mixture priors with an atom at zero and a density component centered at a data driven location determined by maximizing the marginal…

Methodology · Statistics 2017-02-20 Xianyang Zhang , Anirban Bhattacharya

The quickest change detection problem is considered in the context of monitoring large-scale independent normal distributed data streams with possible changes in some of the means. It is assumed that for each individual local data stream,…

Statistics Theory · Mathematics 2016-03-18 Yuan Wang , Yajun Mei

We present a de Bruijn type approximation for quantifying the content of m smooth numbers, derived from samples obtained through a probability measure over the set of integers less than or equal to n, with point mass function at k inversely…

Probability · Mathematics 2025-03-04 Arturo Jaramillo , Xiaochuan Yang

We consider Bayesian shrinkage predictions for the Normal regression problem under the frequentist Kullback-Leibler risk function. Firstly, we consider the multivariate Normal model with an unknown mean and a known covariance. While the…

Statistics Theory · Mathematics 2007-06-13 Kei Kobayashi , Fumiyasu Komaki

Many statistical settings call for estimating a population parameter, most typically the population mean, based on a sample of matrices. The most natural estimate of the population mean is the arithmetic mean, but there are many other…

Statistics Theory · Mathematics 2021-07-16 Asad Lodhia , Keith Levin , Elizaveta Levina

A priori error bounds have been derived for different balancing-related model reduction methods. The most classical result is a bound for balanced truncation and singular perturbation approximation that is applicable for asymptotically…

Numerical Analysis · Mathematics 2022-01-19 Björn Liljegren-Sailer

We consider time-dependent dynamical systems arising as sequential compositions of self-maps of a probability space. We establish conditions under which the Birkhoff sums for multivariate observations, given a centering and a general…

Dynamical Systems · Mathematics 2020-10-28 Juho Leppänen , Mikko Stenlund

Peng (2008)(\cite{P08b}) proved the Central Limit Theorem under a sublinear expectation: \textit{Let $(X_i)_{i\ge 1}$ be a sequence of i.i.d random variables under a sublinear expectation $\hat{\mathbf{E}}$ with…

Probability · Mathematics 2017-11-16 Yongsheng Song

In a linear regression model with random design, we consider a family of candidate models from which we want to select a `good' model for prediction out-of-sample. We fit the models using block shrinkage estimators, and we focus on the…

Statistics Theory · Mathematics 2018-09-13 Hannes Leeb , Nina Senitschnig

Ever since the proof of asymptotic normality of maximum likelihood estimator by Cramer (1946), it has been understood that a basic technique of the Taylor series expansion suffices for asymptotics of $M$-estimators with…

Statistics Theory · Mathematics 2018-09-17 Arun Kumar Kuchibhotla

Let $X$ be a random vector with distribution $P_{\theta}$ where $\theta$ is an unknown parameter. When estimating $\theta$ by some estimator $\varphi(X)$ under a loss function $L(\theta,\varphi)$, classical decision theory advocates that…

Methodology · Statistics 2012-03-23 Dominique Fourdrinier , Martin T. Wells

We propose a generalized double Pareto prior for Bayesian shrinkage estimation and inferences in linear models. The prior can be obtained via a scale mixture of Laplace or normal distributions, forming a bridge between the Laplace and…

Methodology · Statistics 2015-03-19 Artin Armagan , David Dunson , Jaeyong Lee

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

Machine Learning · Statistics 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

We consider the estimation of the $p$-variate normal mean of $X\sim N_p(\theta,I)$ under the quadratic loss function. We investigate the decision theoretic properties of debiased shrinkage estimator, the estimator which shrinks towards the…

Statistics Theory · Mathematics 2023-06-08 Yuzo Maruyama , Akimichi Takemura

In this article, we develop Stein characterization for two-sided tempered stable distribution. Stein characterizations for normal, gamma, Laplace, and variance-gamma distributions already known in the literature follow easily. One can also…

Probability · Mathematics 2022-01-06 Kalyan Barman , N. S. Upadhye