English
Related papers

Related papers: Geometry of Log-Concave Density Estimation

200 papers

We establish a new comparison between the Legendre transform of the cumulant generating function and the half-space depth of an arbitrary log-concave probability distribution on the real line, that carries on to the multidimensional…

Probability · Mathematics 2025-06-17 Silouanos Brazitikos , Giorgos Chasapis

The isoperimetric problem with a density or weighting seeks to enclose prescribed weighted area with minimum weighted perimeter. According to Chambers' recent proof of the Log Convex Density Conjecture, for many densities on $\mathbb{R}^n$…

Metric Geometry · Mathematics 2016-10-25 Leonardo Di Giosia , Jahangir Habib , Lea Kenigsberg , Dylanger Pittman , Weitao Zhu

In this work, we present a sampling algorithm for single hidden layer neural networks. This algorithm is built upon a recursive series of Bayesian posteriors using a method we call Greedy Bayes. Sampling of the Bayesian posterior for neuron…

Machine Learning · Statistics 2024-07-29 Curtis McDonald , Andrew R Barron

Classical least squares estimators are well-known to be robust with respect to moment assumptions concerning the error distribution in a wide variety of finite-dimensional statistical problems; generally only a second moment assumption is…

Statistics Theory · Mathematics 2018-05-08 Qiyang Han , Jon A. Wellner

We consider the problem of sampling from the posterior distribution of a $d$-dimensional coefficient vector $\boldsymbol{\theta}$, given linear observations $\boldsymbol{y} = \boldsymbol{X}\boldsymbol{\theta}+\boldsymbol{\varepsilon}$. In…

Methodology · Statistics 2024-07-01 Andrea Montanari , Yuchen Wu

We study the expected volume of random polytopes generated by taking the convex hull of independent identically distributed points from a given distribution. We show that for log-concave distributions supported on convex bodies, we need at…

Metric Geometry · Mathematics 2021-11-16 Debsoumya Chakraborti , Tomasz Tkocz , Beatrice-Helen Vritsiou

We show that a mixture of Beta distributions has log-concave density whenever the mixing weights are themselves log-concave. Some economic and statistical applications are provided in the last section.

Probability · Mathematics 2013-12-10 Xiaosheng Mu

Theoretical guarantees are established for a standard estimator in a semi-parametric finite mixture model, where each component density is modeled as a product of univariate densities under a conditional independence assumption. The focus…

Statistics Theory · Mathematics 2025-11-07 Marie Du Roy de Chaumaray , Michael Levine , Matthieu Marbac

One of the basic problems in discrete geometry is to determine the most efficient packing of congruent replicas of a given convex set $K$ in the plane or in space. The most commonly used measure of efficiency is density. Several types of…

Metric Geometry · Mathematics 2016-08-14 András Bezdek , Włodzimierz Kuperberg

The estimation of a log-concave density on $\mathbb{R}^d$ represents a central problem in the area of nonparametric inference under shape constraints. In this paper, we study the performance of log-concave density estimators with respect to…

Statistics Theory · Mathematics 2015-09-29 Arlene K. H. Kim , Richard J. Samworth

Nonparametric statistics for distribution functions F or densities f=F' under qualitative shape constraints provides an interesting alternative to classical parametric or entirely nonparametric approaches. We contribute to this area by…

Methodology · Statistics 2016-10-31 Lutz Duembgen , Petro Kolesnyk , Ralf A. Wilke

We prove that the convex least squares estimator (LSE) attains a $n^{-1/2}$ pointwise rate of convergence in any region where the truth is linear. In addition, the asymptotic distribution can be characterized by a modified invelope process.…

Statistics Theory · Mathematics 2018-01-30 Yining Chen , Jon A. Wellner

We establish global rates of convergence for the Maximum Likelihood Estimators (MLEs) of log-concave and $s$-concave densities on $\mathbb{R}$. The main finding is that the rate of convergence of the MLE in the Hellinger metric is no worse…

Statistics Theory · Mathematics 2015-09-16 Charles R. Doss , Jon A. Wellner

We study multivariate normal models that are described by linear constraints on the inverse of the covariance matrix. Maximum likelihood estimation for such models leads to the problem of maximizing the determinant function over a…

Statistics Theory · Mathematics 2009-06-22 Bernd Sturmfels , Caroline Uhler

The problem of efficiently generating random samples from high-dimensional and non-log-concave posterior measures arising from nonlinear regression problems is considered. Extending investigations from arXiv:2009.05298, local and global…

Statistics Theory · Mathematics 2023-04-18 Jan Bohr , Richard Nickl

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

Density level sets can be estimated using plug-in methods, excess mass algorithms or a hybrid of the two previous methodologies. The plug-in algorithms are based on replacing the unknown density by some nonparametric estimator, usually the…

Statistics Theory · Mathematics 2016-11-26 A. Rodríguez-Casal , P. Saavedra-Nieves

Maximum regularized likelihood estimators (MRLEs) are arguably the most established class of estimators in high-dimensional statistics. In this paper, we derive guarantees for MRLEs in Kullback-Leibler divergence, a general measure of…

Machine Learning · Statistics 2018-10-18 Rui Zhuang , Johannes Lederer

We consider the non-parametric maximum likelihood estimation in the class of Polya frequency functions of order two, viz. the densities with a concave logarithm. This is a subclass of unimodal densities and fairly rich in general. The NPMLE…

Statistics Theory · Mathematics 2007-08-22 Jayanta Kumar Pal , Michael Woodroofe , Mary Meyer

Maximum likelihood estimation (MLE) is a fundamental problem in statistics. Characteristics of the MLE problem for discrete algebraic statistical models are reflected in the geometry of the $\textit{likelihood correspondence}$, a variety…

Statistics Theory · Mathematics 2024-11-19 David Barnhill , John Cobb , Matthew Faust