English
Related papers

Related papers: A Geometrical Explanation of Stein Shrinkage

200 papers

We give an intuitive geometric explanation for the apparent breakdown of standard finite-size scaling in systems with periodic boundaries above the upper critical dimension. The Ising model and self-avoiding walk are simulated on…

Statistical Mechanics · Physics 2017-03-17 Jens Grimm , Eren Metin Elçi , Zongzheng Zhou , Timothy M. Garoni , Youjin Deng

We consider estimation of a multivariate normal mean vector under sum of squared error loss. We propose a new class of smooth estimators parameterized by \alpha dominating the James-Stein estimator. The estimator for \alpha=1 corresponds to…

Statistics Theory · Mathematics 2010-09-14 Yuzo Maruyama

We isolate a geometric mechanism that complements the dynamical suppression of macroscopic interference: In a high-dimensional Hilbert space, almost all state vectors are nearly orthogonal, accommodating an exponentially large reservoir of…

Quantum Physics · Physics 2026-05-06 Karl Svozil

We extend Stein's lemma for averages that explicitly contain the Gaussian random variable at a power. We present two proofs for this extension of Stein's lemma, with the first being a rigorous proof by mathematical induction. The…

Probability · Mathematics 2022-06-27 Konstantinos Mamis

In this paper, we study inference for high-dimensional data characterized by small sample sizes relative to the dimension of the data. In particular, we provide an infinite-dimensional framework to study statistical models that involve…

Statistics Theory · Mathematics 2010-02-25 Jim Kuelbs , Anand N. Vidyashankar

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

The James-Stein estimator's dominance over maximum likelihood in terms of mean square error (MSE) has been one of the most celebrated results in modern statistics, suggesting that biased estimators can systematically outperform unbiased…

Statistics Theory · Mathematics 2025-08-12 Paul W. Vos

We introduce a novel approach to learn geometries such as depth and surface normal from images while incorporating geometric context. The difficulty of reliably capturing geometric context in existing methods impedes their ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xiaoxiao Long , Yuhang Zheng , Yupeng Zheng , Beiwen Tian , Cheng Lin , Lingjie Liu , Hao Zhao , Guyue Zhou , Wenping Wang

The asymptotic expansion method is generalized from the periodic setting to stationary ergodic stochastic geometries. This will demonstrate that results from periodic asymptotic expansion also apply to non-periodic structures of a certain…

Mathematical Physics · Physics 2015-03-17 Martin Heida

The estimation of the mean matrix of the multivariate normal distribution is addressed in the high dimensional setting. Efron-Morris-type linear shrinkage estimators based on ridge estimators for the precision matrix instead of the…

Statistics Theory · Mathematics 2020-07-07 Ryota Yuasa , Tatsuya Kubokawa

Jarnik's identity plays a major role in classical simultaneous approximation to two real numbers. O. German [2] has shown a generalization to the weighted setting in which the identity has to be replaced by two inequalities. His methods…

Number Theory · Mathematics 2019-12-11 Leonhard Summerer

In this article, we derive Stein's method for approximating a spatial random graph by a generalised random geometric graph, which has vertices given by a finite Gibbs point process and edges based on a general connection function. Our main…

Probability · Mathematics 2024-11-06 Dominic Schuhmacher , Leoni Carla Wirth

Consider a convex function that is invariant under an group of transformations. If it has a minimizer, does it also have an invariant minimizer? Variants of this problem appear in nonparametric statistics and in a number of adjacent fields.…

Statistics Theory · Mathematics 2024-07-22 Peter Orbanz

We consider the estimation of the mixing distribution of a normal distribution where both the shift and scale are unobserved random variables. We argue that in general, the model is not identifiable. We give an elegant non-constructive…

Statistics Theory · Mathematics 2024-08-20 Ya'acov Ritov

We propose Stein-type estimators for zero-inflated Bell regression models by incorporating information on model parameters. These estimators combine the advantages of unrestricted and restricted estimators. We derive the asymptotic…

Computation · Statistics 2024-03-04 Solmaz Seifollahi , Hossein Bevrani , Zakariya Yahya Algamal

Normal multi-scale transform [4] is a nonlinear multi-scale transform for representing geometric objects that has been recently investigated [1, 7, 10]. The restrictive role of the exact order of polynomial reproduction $P_e$ of the…

Numerical Analysis · Mathematics 2013-11-19 Stanislav Harizanov

Stein's method is a powerful technique for proving central limit theorems in probability theory when more straightforward approaches cannot be implemented easily. This article begins with a survey of the historical development of Stein's…

Probability · Mathematics 2014-04-08 Sourav Chatterjee

Suppose that two large, multi-dimensional data sets are each noisy measurements of the same underlying random process, and principle components analysis is performed separately on the data sets to reduce their dimensionality. In some…

Machine Learning · Statistics 2024-06-27 Donniell E. Fishkind , Cencheng Shen , Youngser Park , Carey E. Priebe

Hanika, Schneider, and Stumme introduced geometric data set as a generalization of metric measure space for the computation of the observable diameter, and extended the observable distance between metric measure spaces to that between…

Metric Geometry · Mathematics 2026-03-25 Shigeaki Yokota

The curse of dimensionality is a longstanding challenge in Bayesian inference in high dimensions. In this work, we propose a projected Stein variational gradient descent (pSVGD) method to overcome this challenge by exploiting the…

Machine Learning · Computer Science 2020-06-11 Peng Chen , Omar Ghattas