English
Related papers

Related papers: Log-concave Density Estimation with Independent Co…

200 papers

A novel computational approach to log-concave density estimation is proposed. Previous approaches utilize the piecewise-affine parametrization of the density induced by the given sample set. The number of parameters as well as non-smooth…

Computation · Statistics 2019-02-21 Fabian Rathke , Christoph Schnörr

In Statistics, log-concave density estimation is a central problem within the field of nonparametric inference under shape constraints. Despite great progress in recent years on the statistical theory of the canonical estimator, namely the…

Computation · Statistics 2023-03-01 Wenyu Chen , Rahul Mazumder , Richard J. Samworth

In this paper, we study two problems: (1) estimation of a $d$-dimensional log-concave distribution and (2) bounded multivariate convex regression with random design with an underlying log-concave density or a compactly supported…

Statistics Theory · Mathematics 2020-02-21 Gil Kur , Yuval Dagan , Alexander Rakhlin

In recent years, log-concave density estimation via maximum likelihood estimation has emerged as a fascinating alternative to traditional nonparametric smoothing techniques, such as kernel density estimation, which require the choice of one…

Methodology · Statistics 2017-09-12 Richard J. Samworth

We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in $\mathbb{R}^d$. Our study covers both the case where the true underlying density is…

Statistics Theory · Mathematics 2009-09-01 Madeleine Cule , Richard Samworth

The log-concave maximum likelihood estimator of a density on the real line based on a sample of size $n$ is known to attain the minimax optimal rate of convergence of $O(n^{-4/5})$ with respect to, e.g., squared Hellinger distance. In this…

Statistics Theory · Mathematics 2016-09-06 Arlene K. H. Kim , Adityanand Guntuboyina , Richard J. Samworth

We study the problem of estimating multivariate log-concave probability density functions. We prove the first sample complexity upper bound for learning log-concave densities on $\mathbb{R}^d$, for all $d \geq 1$. Prior to our work, no…

Machine Learning · Computer Science 2017-06-07 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

The estimation of a log-concave density on $\mathbb{R}^d$ represents a central problem in the area of nonparametric inference under shape constraints. In this paper, we study the performance of log-concave density estimators with respect to…

Statistics Theory · Mathematics 2015-09-29 Arlene K. H. Kim , Richard J. Samworth

We tackle the problem of high-dimensional nonparametric density estimation by taking the class of log-concave densities on $\mathbb{R}^p$ and incorporating within it symmetry assumptions, which facilitate scalable estimation algorithms and…

Statistics Theory · Mathematics 2019-03-15 Min Xu , Richard J. Samworth

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

Machine Learning · Statistics 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

We study the smoothed log-concave maximum likelihood estimator of a probability distribution on $\mathbb{R}^d$. This is a fully automatic nonparametric density estimator, obtained as a canonical smoothing of the log-concave maximum…

Statistics Theory · Mathematics 2014-04-11 Yining Chen , Richard J. Samworth

We introduce a new smooth estimator of the ROC curve based on log-concave density estimates of the constituent distributions. We show that our estimate is asymptotically equivalent to the empirical ROC curve if the underlying densities are…

Methodology · Statistics 2023-04-17 Kaspar Rufibach

Let X_1, ..., X_n be independent and identically distributed random vectors with a log-concave (Lebesgue) density f. We first prove that, with probability one, there exists a unique maximum likelihood estimator of f. The use of this…

Methodology · Statistics 2008-04-25 Madeleine Cule , Richard Samworth , Michael Stewart

The estimation of a log-concave density on $\mathbb{R}$ is a canonical problem in the area of shape-constrained nonparametric inference. We present a Bayesian nonparametric approach to this problem based on an exponentiated Dirichlet…

Statistics Theory · Mathematics 2020-07-14 Ester Mariucci , Kolyan Ray , Botond Szabo

Maximum likelihood estimation of a log-concave probability density is formulated as a convex optimization problem and shown to have an equivalent dual formulation as a constrained maximum Shannon entropy problem. Closely related maximum…

Methodology · Statistics 2010-11-16 Roger Koenker , Ivan Mizera

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on…

Statistics Theory · Mathematics 2018-12-06 Timothy Carpenter , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

We propose an algorithm to sample from composite log-concave distributions over $\mathbb{R}^d$, i.e., densities of the form $\pi\propto e^{-f-g}$, assuming access to gradient evaluations of $f$ and a restricted Gaussian oracle (RGO) for…

Statistics Theory · Mathematics 2026-05-13 Linghai Liu , Sinho Chewi

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

Statistics Theory · Mathematics 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

We study the problem of computing the maximum likelihood estimator (MLE) of multivariate log-concave densities. Our main result is the first computationally efficient algorithm for this problem. In more detail, we give an algorithm that, on…

Data Structures and Algorithms · Computer Science 2018-12-14 Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

We study nonparametric maximum likelihood estimation of a log-concave probability density and its distribution and hazard function. Some general properties of these estimators are derived from two characterizations. It is shown that the…

Statistics Theory · Mathematics 2023-04-17 Lutz Duembgen , Kaspar Rufibach
‹ Prev 1 2 3 10 Next ›