English
Related papers

Related papers: Geometry of Log-Concave Density Estimation

200 papers

In this paper, we study two problems: (1) estimation of a $d$-dimensional log-concave distribution and (2) bounded multivariate convex regression with random design with an underlying log-concave density or a compactly supported…

Statistics Theory · Mathematics 2020-02-21 Gil Kur , Yuval Dagan , Alexander Rakhlin

In this article, we revisit the problem of fitting a mixture model under the assumption that the mixture components are symmetric and log-concave. To this end, we first study the nonparametric maximum likelihood estimation (NPMLE) of a…

Methodology · Statistics 2018-02-28 Xiao Pu , Ery Arias-Castro

We propose a method for estimating a log-concave density on $\mathbb R^d$ from samples, under the assumption that there exists an orthogonal transformation that makes the components of the random vector independent. While log-concave…

Statistics Theory · Mathematics 2024-12-20 Sharvaj Kubal , Christian Campbell , Elina Robeva

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on…

Statistics Theory · Mathematics 2018-12-06 Timothy Carpenter , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

The estimation of a log-concave density on $\mathbb{R}$ is a canonical problem in the area of shape-constrained nonparametric inference. We present a Bayesian nonparametric approach to this problem based on an exponentiated Dirichlet…

Statistics Theory · Mathematics 2020-07-14 Ester Mariucci , Kolyan Ray , Botond Szabo

Statistical inference based on optimal transport offers a different perspective from that of maximum likelihood, and has increasingly gained attention in recent years. In this paper, we study univariate nonparametric shape-constrained…

Statistics Theory · Mathematics 2026-04-13 Takeru Matsuda , Ting-Kam Leonard Wong

We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in $\mathbb{R}^d$. Our study covers both the case where the true underlying density is…

Statistics Theory · Mathematics 2009-09-01 Madeleine Cule , Richard Samworth

In this paper, we study a class of non-parametric density estimators under Bayesian settings. The estimators are piecewise constant functions on binary partitions. We analyze the concentration rate of the posterior distribution under a…

Statistics Theory · Mathematics 2015-08-21 Linxi Liu , Wing Hung Wong

We introduce and analyse a new nonparametric estimator of a multi-dimensional density. Our smooth projection estimator (SPE) is defined by a least squares projection of the sample onto an infinite dimensional mixture class via an…

Methodology · Statistics 2014-11-25 Heather Battey , Han Liu

We study the adaptation properties of the multivariate log-concave maximum likelihood estimator over three subclasses of log-concave densities. The first consists of densities with polyhedral support whose logarithms are piecewise affine.…

Statistics Theory · Mathematics 2019-10-21 Oliver Y. Feng , Adityanand Guntuboyina , Arlene K. H. Kim , Richard J. Samworth

While the problem of estimating a probability density function (pdf) from its observations is classical, the estimation under additional shape constraints is both important and challenging. We introduce an efficient, geometric approach for…

Methodology · Statistics 2018-04-05 Sutanoy Dasgupta , Debdeep Pati , Ian H. Jermyn , Anuj Srivastava

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

Machine Learning · Statistics 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

We study the problem of maximum likelihood (ML) estimation for statistical models defined by reflexive polytopes. Our focus is on the maximum likelihood degree of these models as an algebraic measure of complexity of the corresponding…

Statistics Theory · Mathematics 2024-07-24 Carlos Améndola , Janike Oldekop

We consider two connected aspects of maximum likelihood estimation of the parameter for high-dimensional discrete graphical models: the existence of the maximum likelihood estimate (mle) and its computation. When the data is sparse, there…

Machine Learning · Statistics 2015-04-22 Helene Massam , Nanwei Wang

In many instances, imposing a constraint on the shape of a density is a reasonable and flexible assumption. It offers an alternative to parametric models which can be too rigid and to other nonparametric methods requiring the choice of…

Computation · Statistics 2021-06-21 Lutz Duembgen , Alexandre Moesching , Christof Straehl

Sampling from Gibbs distributions and computing their log-partition function are fundamental tasks in statistics, machine learning, and statistical physics. While efficient algorithms are known for log-concave densities, the worst-case…

Machine Learning · Statistics 2026-04-24 David Holzmüller , Francis Bach

Constraining the maximum likelihood density estimator to satisfy a sufficiently strong constraint, $\log-$concavity being a common example, has the effect of restoring consistency without requiring additional parameters. Since many results…

Econometrics · Economics 2018-11-26 Ryan Cumings-Menon

Log-concave distributions are an attractive choice for modeling and inference, for several reasons: The class of log-concave distributions contains most of the commonly used parametric distributions and thus is a rich and flexible…

Methodology · Statistics 2010-10-05 Guenther Walther

We study nonparametric maximum likelihood estimation of a log-concave probability density and its distribution and hazard function. Some general properties of these estimators are derived from two characterizations. It is shown that the…

Statistics Theory · Mathematics 2023-04-17 Lutz Duembgen , Kaspar Rufibach

Bi-log-concavity of probability measures is a univariate extension of the notion of log-concavity that has been recently proposed in a statistical literature. Among other things, it has the nice property from a modelisation perspective to…

Probability · Mathematics 2019-03-20 Adrien Saumard