English
Related papers

Related papers: Normalizing constants of log-concave densities

200 papers

We derive normal approximation bounds in the Wasserstein distance for sums of weighted U-statistics, based on a general distance bound for functionals of independent random variables of arbitrary distributions. Those bounds are applied to…

Probability · Mathematics 2020-07-28 Nicolas Privault , Grzegorz Serafin

Normalizing flows are a popular class of models for approximating probability distributions. However, their invertible nature limits their ability to model target distributions whose support have a complex topological structure, such as…

Machine Learning · Statistics 2022-02-25 Vincent Stimper , Bernhard Schölkopf , José Miguel Hernández-Lobato

In this paper we consider uniformly random lozenge tilings of arbitrary domains approximating (after suitable normalization) a closed, simply-connected subset of $\mathbb{R}^2$ with piecewise smooth, simple boundary. We show that the local…

Probability · Mathematics 2023-10-02 Amol Aggarwal

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

Machine Learning · Statistics 2025-11-20 Gábor Balázs

We consider nonparametric maximum-likelihood estimation of a log-concave density in case of interval-censored, right-censored and binned data. We allow for the possibility of a subprobability density with an additional mass at $+\infty$,…

Methodology · Statistics 2014-08-15 Lutz Duembgen , Kaspar Rufibach , Dominic Schuhmacher

We study the problem of estimating multivariate log-concave probability density functions. We prove the first sample complexity upper bound for learning log-concave densities on $\mathbb{R}^d$, for all $d \geq 1$. Prior to our work, no…

Machine Learning · Computer Science 2017-06-07 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

The Lipschitz constant of neural networks plays an important role in several contexts of deep learning ranging from robustness certification and regularization to stability analysis of systems with neural network controllers. Obtaining…

Machine Learning · Computer Science 2021-07-07 Aritra Bhowmick , Meenakshi D'Souza , G. Srinivasa Raghavan

We establish a log-Sobolev inequality for the stationary distribution of mean-field Langevin dynamics with a constant that is independent of the number of particles $N$. Our proof proceeds by establishing the existence of a Lipschitz…

Probability · Mathematics 2024-09-17 Sinho Chewi , Atsushi Nitanda , Matthew S. Zhang

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, it seems to be a considerable restriction when the potentials are often required to be smooth (gradient Lipschitz). This paper…

Computation · Statistics 2022-02-23 Dao Nguyen

We develop a constant-tracking likelihood theory for two nonregular models: the folded normal and finite Gaussian mixtures. For the folded normal, we prove boundary coercivity for the profiled likelihood, show that the profile path of the…

Statistics Theory · Mathematics 2026-02-02 Koustav Mallik

This paper deals with the problem of density estimation. We aim at building an estimate of an unknown density as a linear combination of functions of a dictionary. Inspired by Cand\`es and Tao's approach, we propose an $\ell_1$-minimization…

Statistics Theory · Mathematics 2009-05-07 Karine Bertin , Erwan Le Pennec , Vincent Rivoirard

The Lipschitz constant of the map between the input and output space represented by a neural network is a natural metric for assessing the robustness of the model. We present a new method to constrain the Lipschitz constant of dense deep…

Machine Learning · Computer Science 2023-08-22 Ouail Kitouni , Niklas Nolte , Mike Williams

The behavior of the self diffusion constant of Langevin particles interacting via a pairwise interaction is considered. The diffusion constant is calculated approximately within a perturbation theory in the potential strength about the bare…

Soft Condensed Matter · Physics 2009-11-10 D. S. Dean , A. Lefèvre

Lipschitz constants are connected to many properties of neural networks, such as robustness, fairness, and generalization. Existing methods for computing Lipschitz constants either produce relatively loose upper bounds or are limited to…

Machine Learning · Computer Science 2022-10-17 Zhouxing Shi , Yihan Wang , Huan Zhang , Zico Kolter , Cho-Jui Hsieh

We consider a generic class of log-concave, possibly random, (Gibbs) measures. We prove the concentration of an infinite family of order parameters called multioverlaps. Because they completely parametrise the quenched Gibbs measure of the…

Probability · Mathematics 2022-12-22 Jean Barbier , Dmitry Panchenko , Manuel Sáenz

We consider the non-parametric maximum likelihood estimation in the class of Polya frequency functions of order two, viz. the densities with a concave logarithm. This is a subclass of unimodal densities and fairly rich in general. The NPMLE…

Statistics Theory · Mathematics 2007-08-22 Jayanta Kumar Pal , Michael Woodroofe , Mary Meyer

An invertible function is bi-Lipschitz if both the function and its inverse have bounded Lipschitz constants. Nowadays, most Normalizing Flows are bi-Lipschitz by design or by training to limit numerical errors (among other things). In this…

Machine Learning · Computer Science 2024-03-08 Alexandre Verine , Benjamin Negrevergne , Fabrice Rossi , Yann Chevaleyre

We study nonparametric maximum likelihood estimation of a log-concave probability density and its distribution and hazard function. Some general properties of these estimators are derived from two characterizations. It is shown that the…

Statistics Theory · Mathematics 2023-04-17 Lutz Duembgen , Kaspar Rufibach

We establish generic uniform convergence guarantees for Gaussian data in terms of the Rademacher complexity of the hypothesis class and the Lipschitz constant of the square root of the scalar loss function. We show how these guarantees…

Machine Learning · Statistics 2023-06-26 Lijia Zhou , Zhen Dai , Frederic Koehler , Nathan Srebro

We consider the evolution of a quantity advected by a compressible flow and subject to diffusion. When this quantity is scalar it can be, for instance, the temperature of the flow or the concentration of some pollutants. Because of the…

Analysis of PDEs · Mathematics 2007-05-23 A. Mellet , A. Vasseur