English
Related papers

Related papers: Strong replica symmetry in high-dimensional optima…

200 papers

We consider models of Bayesian inference of signals with vectorial components of finite dimensionality. We show that, under a proper perturbation, these models are replica symmetric in the sense that the overlap matrix concentrates. The…

Information Theory · Computer Science 2020-01-27 Jean Barbier

Formulating a statistical inverse problem as one of inference in a Bayesian model has great appeal, notably for what this brings in terms of coherence, the interpretability of regularisation penalties, the integration of all uncertainties,…

Statistics Theory · Mathematics 2012-12-19 Natalia A. Bochkina , Peter J. Green

In this short note, we consider models of optimal Bayesian inference of finite-rank tensor products. We add to the model a linear channel parametrized by $h$. We show that at every interior differentiable point $h$ of the free energy…

Probability · Mathematics 2025-01-16 Hong-Bin Chen , Victor Issa

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

We use statistical mechanics to study model-based Bayesian data clustering. In this approach, each partition of the data into clusters is regarded as a microscopic system state, the negative data log-likelihood gives the energy of each…

Disordered Systems and Neural Networks · Physics 2019-11-19 Alexander Mozeika , Anthony CC Coolen

We consider a generic class of log-concave, possibly random, (Gibbs) measures. We prove the concentration of an infinite family of order parameters called multioverlaps. Because they completely parametrise the quenched Gibbs measure of the…

Probability · Mathematics 2022-12-22 Jean Barbier , Dmitry Panchenko , Manuel Sáenz

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

We introduce a method for analyzing radio interferometry data which produces maps which are optimal in the Bayesian sense of maximum posterior probability density, given certain prior assumptions. It is similar to maximum entropy…

Astrophysics · Physics 2009-11-11 Edmund C. Sutton , Benjamin D. Wandelt

We study the behavior of the posterior distribution in high-dimensional Bayesian Gaussian linear regression models having $p\gg n$, with $p$ the number of predictors and $n$ the sample size. Our focus is on obtaining quantitative finite…

Statistics Theory · Mathematics 2014-01-06 Nate Strawn , Artin Armagan , Rayan Saab , Lawrence Carin , David Dunson

Motivated by the need to analyze large, decentralized datasets, distributed Bayesian inference has become a critical research area across multiple fields, including statistics, electrical engineering, and economics. This paper establishes…

Statistics Theory · Mathematics 2025-07-08 Bohan Wu , César A. Uribe

We study frequentist properties of a Bayesian high-dimensional multivariate linear regression model with correlated responses. The predictors are separated into many groups and the group structure is pre-determined. Two features of the…

Statistics Theory · Mathematics 2019-06-13 Bo Ning , Seonghyun Jeong , Subhashis Ghosal

We study the asymptotic behaviour of the posterior distribution in a broad class of statistical models where the "true" solution occurs on the boundary of the parameter space. We show that in this case Bayesian inference is consistent, and…

Statistics Theory · Mathematics 2014-10-02 Natalia A. Bochkina , Peter J. Green

We consider Bayesian nonparametric inference in the right-censoring survival model, where modeling is made at the level of the hazard rate. We derive posterior limiting distributions for linear functionals of the hazard, and then for `many'…

Statistics Theory · Mathematics 2021-06-01 Ismaël Castillo , Stéphanie van der Pas

Bayesian model comparison is often based on the posterior distribution over the set of compared models. This distribution is often observed to concentrate on a single model even when other measures of model fit or forecasting ability…

Statistics Theory · Mathematics 2020-03-10 Oscar Oelrich , Shutong Ding , Måns Magnusson , Aki Vehtari , Mattias Villani

We consider nonparametric Bayesian inference in a multidimensional diffusion model with reflecting boundary conditions based on discrete high-frequency observations. We prove a general posterior contraction rate theorem in $L^2$-loss, which…

Statistics Theory · Mathematics 2025-08-12 Marc Hoffmann , Kolyan Ray

Approximate Bayesian inference typically revolves around computing the posterior parameter distribution. In practice, however, the main object of interest is often a model's predictions rather than its parameters. In this work, we propose…

Machine Learning · Statistics 2026-05-29 Julian Rodemann , Alexander Marquard , Thomas Augustin , Michele Caprio

We describe different Bayesian ensemble refinement methods, examine their interrelation, and discuss their practical application. With ensemble refinement, the properties of dynamic and partially disordered (bio)molecular structures can be…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Gerhard Hummer , Jürgen Köfinger

Unlike the classical linear model, nonlinear generative models have been addressed sparsely in the literature of statistical learning. This work aims to bringing attention to these models and their secrecy potential. To this end, we invoke…

Information Theory · Computer Science 2022-07-15 Ali Bereyhi , Bruno Loureiro , Florent Krzakala , Ralf R. Müller , Hermann Schulz-Baldes

An efficient Bayesian inference method for problems that can be mapped onto dense graphs is presented. The approach is based on message passing where messages are averaged over a large number of replicated variable systems exposed to the…

Disordered Systems and Neural Networks · Physics 2009-11-13 Juan P Neirotti , David Saad

The problem of joint estimation of multiple graphical models from high dimensional data has been studied in the statistics and machine learning literature, due to its importance in diverse fields including molecular biology, neuroscience…

Methodology · Statistics 2019-07-04 Peyman Jalali , Kshitij Khare , George Michailidis
‹ Prev 1 2 3 10 Next ›