English
Related papers

Related papers: Inner Regularization of Log-Concave Measures and S…

200 papers

We introduce a theoretical framework for sampling from unnormalized densities based on a smoothing scheme that uses an isotropic Gaussian kernel with a single fixed noise scale. We prove one can decompose sampling from a density (minimal…

Machine Learning · Statistics 2023-10-02 Saeed Saremi , Ji Won Park , Francis Bach

We consider the problem of sampling from the posterior distribution of a $d$-dimensional coefficient vector $\boldsymbol{\theta}$, given linear observations $\boldsymbol{y} = \boldsymbol{X}\boldsymbol{\theta}+\boldsymbol{\varepsilon}$. In…

Methodology · Statistics 2024-07-01 Andrea Montanari , Yuchen Wu

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau, 2016)…

Methodology · Statistics 2017-05-26 Nicolas Brosse , Alain Durmus , Éric Moulines , Marcelo Pereyra

We develop a numerical approach for computing the additive, multiplicative and compressive convolution operations from free probability theory. We utilize the regularity properties of free convolution to identify (pairs of) `admissible'…

Probability · Mathematics 2013-07-22 Sheehan Olver , Raj Rao Nadakuditi

This paper aims to address the phase retrieval problem from subgaussian measurements with arbitrary noise, with a focus on devising robust and efficient algorithms for solving non-convex problems. To ensure uniqueness of solutions in the…

Optimization and Control · Mathematics 2024-12-11 Haiyang Peng , Deren Han , Linbin Li , Meng Huang

We prove a sharp moment inequality for a log-concave or a log-convex function, on Gaussian random vectors. As an application we take a stability result for the classical logarithmic Sobolev inequality of L. Gross in the case where the…

Probability · Mathematics 2016-10-17 Nikos Dafnis , Grigoris Paouris

The properties of black-hole and neutron-star binaries are extracted from gravitational-wave signals using Bayesian inference. This involves evaluating a multi-dimensional posterior probability function with stochastic sampling. The…

General Relativity and Quantum Cosmology · Physics 2021-09-29 Virginia D'Emilio , Rhys Green , Vivien Raymond

The accuracy of Bayesian inference can be negatively affected by the use of inaccurate forward models. In the case of gravitational-wave inference, accurate but computationally expensive waveform models are sometimes substituted with faster…

Instrumentation and Methods for Astrophysics · Physics 2024-04-02 Miaoxin Liu , Xiao-Dong Li , Alvin J. K. Chua

As Gaussian processes are used to answer increasingly complex questions, analytic solutions become scarcer and scarcer. Monte Carlo methods act as a convenient bridge for connecting intractable mathematical expressions with actionable…

In this note, we derive concentration inequalities for random vectors with subGaussian norm (a generalization of both subGaussian random vectors and norm bounded random vectors), which are tight up to logarithmic factors.

Probability · Mathematics 2019-02-12 Chi Jin , Praneeth Netrapalli , Rong Ge , Sham M. Kakade , Michael I. Jordan

In this paper, we investigate the problem of computing Bayesian estimators using Langevin Monte-Carlo type approximation. The novelty of this paper is to consider together the statistical and numerical counterparts (in a general log-concave…

Probability · Mathematics 2022-02-15 Sébastien Gadat , Fabien Panloup , Clément Pellegrini

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

Numerical Analysis · Mathematics 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

The main challenges that arise when adopting Gaussian Process priors in probabilistic modeling are how to carry out exact Bayesian inference and how to account for uncertainty on model parameters when making model-based predictions on…

Machine Learning · Statistics 2014-04-08 Maurizio Filippone , Mark Girolami

Bi-log-concavity of probability measures is a univariate extension of the notion of log-concavity that has been recently proposed in a statistical literature. Among other things, it has the nice property from a modelisation perspective to…

Probability · Mathematics 2019-03-20 Adrien Saumard

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

In this work, we consider the inverse problem of reconstructing the internal structure of an object from limited x-ray projections. We use a Gaussian process prior to model the target function and estimate its (hyper)parameters from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Zenith Purisha , Carl Jidling , Niklas Wahlström , Simo Särkkä , Thomas B. Schön

We derive first-order (in the stepsize) bounds on the bias in Wasserstein distances of the invariant measure of stochastic gradient kinetic Langevin dynamics with minimal assumptions on the stochastic gradient noise. These bounds sharpen…

Computation · Statistics 2026-04-28 Daniel Paulin , Peter A. Whalley

We construct a transport map from Poisson point processes onto ultra-log-concave measures over the natural numbers, and show that this map is a contraction. Our approach overcomes the known obstacles to transferring functional inequalities…

Probability · Mathematics 2025-02-07 Pablo López-Rivera , Yair Shenfeld

We find the logarithmic $L_2$-small ball asymptotics for a class of zero mean Gaussian fields with covariances having the structure of "tensor product". The main condition imposed on marginal covariances is slow growth at the origin of…

Probability · Mathematics 2010-11-18 Andrei I. Karol' , Alexander I. Nazarov

We solve the inverse problem of deblurring a pixelized image of Jupiter using regularized deconvolution and by sample-based Bayesian inference. By efficiently sampling the marginal posterior distribution for hyperparameters, then the full…

Computation · Statistics 2016-02-24 Colin Fox , Richard A. Norton