English
Related papers

Related papers: Mean field approximations via log-concavity

200 papers

We show a general phenomenon of the constrained functional value for densities satisfying general convexity conditions, which generalizes the observation in Bobkov and Madiman (2011) that the entropy per coordinate in a log-concave random…

Information Theory · Computer Science 2020-10-27 Yanjun Han

We conduct non-asymptotic analysis on the mean-field variational inference for approximating posterior distributions in complex Bayesian models that may involve latent variables. We show that the mean-field approximation to the posterior…

Statistics Theory · Mathematics 2019-11-06 Wei Han , Yun Yang

Given a convex function $f\colon\mathbb{R}^{d}\to\mathbb{R}$, the problem of sampling from a distribution $\propto e^{-f(x)}$ is called log-concave sampling. This task has wide applications in machine learning, physics, statistics, etc. In…

Quantum Physics · Physics 2023-12-11 Andrew M. Childs , Tongyang Li , Jin-Peng Liu , Chunhao Wang , Ruizhe Zhang

Mean-field models approximate large stochastic systems by simpler differential equations that are supposed to approximate the mean of the larger system. It is generally assumed that as the stochastic systems get larger (i.e., more people or…

Probability · Mathematics 2016-03-01 Benjamin Armbruster

We study the approximability of general convex sets in $\mathbb{R}^n$ by intersections of halfspaces, where the approximation quality is measured with respect to the standard Gaussian distribution $N(0,I_n)$ and the complexity of an…

Computational Complexity · Computer Science 2023-11-16 Anindya De , Shivam Nadimpalli , Rocco A. Servedio

We consider the problem of function approximation by two-layer neural nets with random weights that are "nearly Gaussian" in the sense of Kullback-Leibler divergence. Our setting is the mean-field limit, where the finite population of…

Machine Learning · Computer Science 2024-06-25 Belinda Tzen , Maxim Raginsky

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on…

Statistics Theory · Mathematics 2018-12-06 Timothy Carpenter , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

This dissertation studies the statistics and modeling of a quantum system probed by a coherent laser field. We focus on an ensemble of qubits dispersively coupled to a traveling wave light field. The first research topic explores the…

Quantum Physics · Physics 2013-01-29 Robert L. Cook

Bounds on the log partition function are important in a variety of contexts, including approximate inference, model fitting, decision theory, and large deviations analysis. We introduce a new class of upper bounds on the log partition…

Machine Learning · Computer Science 2013-01-07 Martin Wainwright , Tommi S. Jaakkola , Alan Willsky

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

This paper aims to systematically solve stochastic team optimization of large-scale system, in a rather general framework. Concretely, the underlying large-scale system involves considerable weakly-coupled cooperative agents for which the…

Optimization and Control · Mathematics 2021-05-18 Xinwei Feng , Ying Hu , Jianhui Huang

We prove structure theorems for measures on the discrete cube and on Gaussian space, which provide sufficient conditions for mean-field behavior. These conditions rely on a new notion of complexity for such measures, namely the…

Probability · Mathematics 2018-07-02 Ronen Eldan

This paper studies numerical methods for the approximation of elliptic PDEs with lognormal coefficients of the form $-{\rm div}(a\nabla u)=f$ where $a=\exp(b)$ and $b$ is a Gaussian random field. The approximant of the solution $u$ is an…

Numerical Analysis · Mathematics 2021-03-26 Albert Cohen , Giovanni Migliorati

Let X_1, ..., X_n be independent and identically distributed random vectors with a log-concave (Lebesgue) density f. We first prove that, with probability one, there exists a unique maximum likelihood estimator of f. The use of this…

Methodology · Statistics 2008-04-25 Madeleine Cule , Richard Samworth , Michael Stewart

In recent works - both experimental and theoretical - it has been shown how to use computational geometry to efficently construct approximations to the optimal transport map between two given probability measures on Euclidean space, by…

Numerical Analysis · Mathematics 2020-09-14 Robert J. Berman

The entropy per coordinate in a log-concave random vector of any dimension with given density at the mode is shown to have a range of just 1. Uniform distributions on convex bodies are at the lower end of this range, the distribution with…

Information Theory · Computer Science 2024-05-07 Sergey Bobkov , Mokshay Madiman

The formulation of Mean Field Games (MFG) typically requires continuous differentiability of the Hamiltonian in order to determine the advective term in the Kolmogorov--Fokker--Planck equation for the density of players. However, in many…

Numerical Analysis · Mathematics 2024-04-03 Yohance A. P. Osborne , Iain Smears

The assumption of log-concavity is a flexible and appealing nonparametric shape constraint in distribution modelling. In this work, we study the log-concave maximum likelihood estimator (MLE) of a probability mass function (pmf). We show…

Methodology · Statistics 2023-04-17 Fadoua Balabdaoui , Hanna Jankowski , Kaspar Rufibach , Marios Pavlides

Mean field approximation is a popular method to study the behaviour of stochastic models composed of a large number of interacting objects. When the objects are asynchronous, the mean field approximation of a population model can be…

Performance · Computer Science 2018-07-24 Nicolas Gast , Diego Latella , Mieke Massink

We study nonparametric maximum likelihood estimation of a log-concave density function $f_0$ which is known to satisfy further constraints, where either (a) the mode $m$ of $f_0$ is known, or (b) $f_0$ is known to be symmetric about a fixed…

Statistics Theory · Mathematics 2019-05-15 Charles R. Doss , Jon A. Wellner