English
Related papers

Related papers: Invariant Bayesian estimation on manifolds

200 papers

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

We consider the problem of signal estimation in generalized linear models defined via rotationally invariant design matrices. Since these matrices can have an arbitrary spectral distribution, this model is well suited for capturing complex…

Machine Learning · Statistics 2022-06-10 Ramji Venkataramanan , Kevin Kögler , Marco Mondelli

The parametrisation method for invariant manifolds is a powerful technique for deriving reduced-order models in the context of nonlinear vibrating systems, allowing accurate computations of nonlinear normal modes. Thanks to arbitrary order…

Numerical Analysis · Mathematics 2026-03-19 André de Figueiredo Stabile , Aurélien Grolet , Alessandra Vizzaccaro , Cyril Touzé

We establish a universal framework for concentration inequalities based on invariance under diffeomorphism groups. Given a probability measure $\mu$ on a space $E$ and a diffeomorphism $\psi: E \to F$, concentration properties transfer…

Statistics Theory · Mathematics 2025-12-12 Jocelyn Nembé

One of the tasks of the Bayesian inverse problem is to find a good estimate based on the posterior probability density. The most common point estimators are the conditional mean (CM) and maximum a posteriori (MAP) estimates, which…

Numerical Analysis · Mathematics 2016-08-29 Martin Burger , Yiqiu Dong , Federica Sciacchitano

Covariance estimation and selection for multivariate datasets in a high-dimensional regime is a fundamental problem in modern statistics. Gaussian graphical models are a popular class of models used for this purpose. Current Bayesian…

Methodology · Statistics 2019-03-06 Xuan Cao , Shaojun Zhang

In this paper we leverage on probability over Riemannian manifolds to rethink the interpretation of priors and posteriors in Bayesian inference. The main mindshift is to move away from the idea that "a prior distribution establishes a…

Statistics Theory · Mathematics 2021-06-03 Jesus Cerquides

Gauge symmetries lead to first-class constraints. This assertion is of course true only for non trivial gauge symmetries, i.e., gauge symmetries that act non trivially on-shell on the dynamical variables. We illustrate this well-appreciated…

High Energy Physics - Theory · Physics 2010-04-22 Marc Henneaux , Axel Kleinschmidt , Gustavo Lucena Gómez

Maximum A Posteriori (MAP) estimation is a cornerstone framework for blind inverse problems, where an image and a forward operator are jointly estimated as the maximizers of a posterior distribution. In this paper, we analyze the recovery…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Minh-Hai Nguyen , Edouard Pauwels , Pierre Weiss

Invariants withstand transformations and, therefore, represent the essence of objects or phenomena. In mathematics, transformations often constitute a group action. Since the 19th century, studying the structure of various types of…

Symbolic Computation · Computer Science 2024-12-19 Irina A. Kogan

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem…

Machine Learning · Statistics 2013-07-19 Qiang Liu , Alexander Ihler

Estimation of a vector from quantized linear measurements is a common problem for which simple linear techniques are suboptimal -- sometimes greatly so. This paper develops generalized approximate message passing (GAMP) algorithms for…

Information Theory · Computer Science 2015-03-24 Ulugbek Kamilov , Vivek K. Goyal , Sundeep Rangan

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative…

Machine Learning · Statistics 2022-12-06 Yizhou Xu , TianQi Hou , ShanSuo Liang , Marco Mondelli

We define a new class of Bayesian point estimators, which we refer to as risk averse. Using this definition, we formulate axioms that provide natural requirements for inference, e.g. in a scientific setting, and show that for well-behaved…

Machine Learning · Statistics 2019-03-08 Michael Brand

A central theme in classical algorithms for the reconstruction of discontinuous functions from observational data is perimeter regularization via the use of the total variation. On the other hand, sparse or noisy data often demands a…

Optimization and Control · Mathematics 2020-04-13 Oliver R. A. Dunbar , Matthew M. Dunlop , Charles M. Elliott , Viet Ha Hoang , Andrew M. Stuart

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

Information Theory · Computer Science 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

Starting from the De Witt supermetric and limiting ourselves to a family of geometries characterized by a finite number of geometric invariants we extract the unique integration measure. Such a measure turns out to be a geometric invariant,…

High Energy Physics - Lattice · Physics 2009-10-30 Pietro Menotti

In his 2005 paper, S.T. Smith proposed an intrinsic Cram\'er-Rao bound on the variance of estimators of a parameter defined on a Riemannian manifold. In the present technical note, we consider the special case where the parameter lives in a…

Systems and Control · Computer Science 2015-09-17 Silvère Bonnabel , Axel Barrau

Blind deconvolution involves the estimation of a sharp signal or image given only a blurry observation. Because this problem is fundamentally ill-posed, strong priors on both the sharp image and blur kernel are required to regularize the…

Computer Vision and Pattern Recognition · Computer Science 2013-05-13 David Wipf , Haichao Zhang

Gaussian graphical models are a popular tool to learn the dependence structure in the form of a graph among variables of interest. Bayesian methods have gained in popularity in the last two decades due to their ability to simultaneously…

Statistics Theory · Mathematics 2019-04-02 Yabo Niu , Debdeep Pati , Bani Mallick