English
Related papers

Related papers: Log-concave Density Estimation with Independent Co…

200 papers

Bi-log-concavity of probability measures is a univariate extension of the notion of log-concavity that has been recently proposed in a statistical literature. Among other things, it has the nice property from a modelisation perspective to…

Probability · Mathematics 2019-03-20 Adrien Saumard

We study probability density functions that are log-concave. Despite the space of all such densities being infinite-dimensional, the maximum likelihood estimate is the exponential of a piecewise linear function determined by finitely many…

We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density…

Statistics Theory · Mathematics 2024-01-05 Y. Baraud , H. Halconruy , G. Maillard

A popular class of problem in statistics deals with estimating the support of a density from $n$ observations drawn at random from a $d$-dimensional distribution. The one-dimensional case reduces to estimating the end points of a univariate…

Statistics Theory · Mathematics 2018-04-27 Victor-Emmanuel Brunel , Jason M. Klusowski , Dana Yang

We derive explicit bounds for the computation of normalizing constants $Z$ for log-concave densities $\pi = \exp(-U)/Z$ with respect to the Lebesgue measure on $\mathbb{R}^d$. Our approach relies on a Gaussian annealing combined with recent…

Methodology · Statistics 2018-03-01 Nicolas Brosse , Alain Durmus , Éric Moulines

We consider sampling from composite densities on $\mathbb{R}^d$ of the form $d\pi(x) \propto \exp(-f(x) - g(x))dx$ for well-conditioned $f$ and convex (but possibly non-smooth) $g$, a family generalizing restrictions to a convex set,…

Machine Learning · Computer Science 2020-06-11 Ruoqi Shen , Kevin Tian , Yin Tat Lee

We estimate the support of a uniform density, when it is assumed to be a convex polytope or, more generally, a convex body in $\R^d$. In the polytopal case, we construct an estimator achieving a rate which does not depend on the dimension…

Statistics Theory · Mathematics 2013-09-26 Victor-Emmanuel Brunel

We analyze four different approaches to estimate a multivariate probability density (or the log-density) and its first and second order derivatives. Two methods, local log-likelihood and local Hyv\"arinen score estimation, are in terms of…

Statistics Theory · Mathematics 2020-08-11 Christof Strähl , Johanna F. Ziegel , Lutz Duembgen

Motivated by studies in biological sciences to detect differentially expressed genes, a semiparametric two-component mixture model with one known component is being studied in this paper. Assuming the density of the unknown component to be…

Methodology · Statistics 2019-03-28 Yangmei Zhou , Weixin Yao

We derive a formula to calculate the local change to the log of any density of states for smooth real observables. Using this in Monte-Carlo simulations, we are able to calculate the expectation value of the observable with a precision…

High Energy Physics - Lattice · Physics 2024-01-03 Rasmus Normann Larsen

We propose a fast stochastic Hamilton Monte Carlo (HMC) method, for sampling from a smooth and strongly log-concave distribution. At the core of our proposed method is a variance reduction technique inspired by the recent advance in…

Machine Learning · Statistics 2020-10-20 Difan Zou , Pan Xu , Quanquan Gu

We present a faster algorithm to generate a warm start for sampling an arbitrary logconcave density specified by an evaluation oracle, leading to the first sub-cubic sampling algorithms for inputs in (near-)isotropic position. A long line…

Data Structures and Algorithms · Computer Science 2025-05-06 Yunbum Kook , Santosh S. Vempala

We study the problem of maximum likelihood estimation of densities that are log-concave and lie in the graphical model corresponding to a given undirected graph $G$. We show that the maximum likelihood estimate (MLE) is the product of the…

Statistics Theory · Mathematics 2025-12-02 Kaie Kubjas , Olga Kuznetsova , Elina Robeva , Pardis Semnani , Luca Sodomaco

We consider the problem of sampling from a strongly log-concave density in $\mathbb{R}^d$, and prove an information theoretic lower bound on the number of stochastic gradient queries of the log density needed. Several popular sampling…

Machine Learning · Statistics 2021-07-06 Niladri S. Chatterji , Peter L. Bartlett , Philip M. Long

We study the problem of sampling from a $d$-dimensional distribution with density $p(x)\propto e^{-f(x)}$, which does not necessarily satisfy good isoperimetric conditions. Specifically, we show that for any $L,M$ satisfying $LM\ge d\ge 5$,…

Data Structures and Algorithms · Computer Science 2025-06-04 Yuchen He , Chihao Zhang

We study the probabilistic sampling of a random variable, in which the variable is sampled only if it falls outside a given set, which is called the silence set. This helps us to understand optimal event-based sampling for the special case…

Optimization and Control · Mathematics 2023-03-17 Maben Rabi , Junfeng Wu , Vyoma Singh , Karl Henrik Johansson

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Computation · Statistics 2016-12-06 Arnak S. Dalalyan

A recently proposed convolution technique for the calculation of local density of states is described more thouroughly and new results of its application are presented. For separable systems the exposed method allows to construct the ldos…

Condensed Matter · Physics 2009-11-07 A. Losev , S. Vlaev

We give algorithms for sampling several structured logconcave families to high accuracy. We further develop a reduction framework, inspired by proximal point methods in convex optimization, which bootstraps samplers for regularized…

Data Structures and Algorithms · Computer Science 2021-10-25 Yin Tat Lee , Ruoqi Shen , Kevin Tian

Estimating the unknown density from which a given independent sample originates is more difficult than estimating the mean, in the sense that for the best popular non-parametric density estimators, the mean integrated square error converges…

Statistics Theory · Mathematics 2021-09-08 Pierre L'Ecuyer , Florian Puchhammer , Amal Ben Abdellah