English
Related papers

Related papers: Nonparametric Estimation for a Log-concave Distrib…

200 papers

Non-parametric maximum likelihood estimation encompasses a group of classic methods to estimate distribution-associated functions from potentially censored and truncated data, with extensive applications in survival analysis. These methods,…

Methodology · Statistics 2021-08-05 Justin D. Tubbs , Lane Guolan Chen , Thuan Quoc Thach , Pak C. Sham

We consider two nonparametric procedures for estimating a concave distribution function based on data corrupted with additive noise generated by a bounded decreasing density on $(0,\infty)$. For the maximum likelihood (ML) estimator and…

Statistics Theory · Mathematics 2009-04-02 Geurt Jongbloed , Frank H. van der Meulen

Nonparametric statistics for distribution functions F or densities f=F' under qualitative shape constraints provides an interesting alternative to classical parametric or entirely nonparametric approaches. We contribute to this area by…

Methodology · Statistics 2016-10-31 Lutz Duembgen , Petro Kolesnyk , Ralf A. Wilke

We study the problem of maximum likelihood estimation of densities that are log-concave and lie in the graphical model corresponding to a given undirected graph $G$. We show that the maximum likelihood estimate (MLE) is the product of the…

Statistics Theory · Mathematics 2025-12-02 Kaie Kubjas , Olga Kuznetsova , Elina Robeva , Pardis Semnani , Luca Sodomaco

Log-concave distributions are an attractive choice for modeling and inference, for several reasons: The class of log-concave distributions contains most of the commonly used parametric distributions and thus is a rich and flexible…

Methodology · Statistics 2010-10-05 Guenther Walther

We study probability density functions that are log-concave. Despite the space of all such densities being infinite-dimensional, the maximum likelihood estimate is the exponential of a piecewise linear function determined by finitely many…

Sampling from Gibbs distributions and computing their log-partition function are fundamental tasks in statistics, machine learning, and statistical physics. While efficient algorithms are known for log-concave densities, the worst-case…

Machine Learning · Statistics 2026-04-24 David Holzmüller , Francis Bach

Most work in neural networks focuses on estimating the conditional mean of a continuous response variable given a set of covariates.In this article, we consider estimating the conditional distribution function using neural networks for both…

Methodology · Statistics 2022-07-07 Bingqing Hu , Bin Nan

A key task in Bayesian statistics is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). However, without any assumptions, sampling (even approximately) can be #P-hard, and few…

Machine Learning · Computer Science 2018-12-03 Rong Ge , Holden Lee , Andrej Risteski

We study a likelihood ratio test for the location of the mode of a log-concave density. Our test is based on comparison of the log-likelihoods corresponding to the unconstrained maximum likelihood estimator of a log-concave density and the…

Statistics Theory · Mathematics 2018-06-05 Charles R. Doss , Jon A. Wellner

In many instances, imposing a constraint on the shape of a density is a reasonable and flexible assumption. It offers an alternative to parametric models which can be too rigid and to other nonparametric methods requiring the choice of…

Computation · Statistics 2021-06-21 Lutz Duembgen , Alexandre Moesching , Christof Straehl

We develop an active set algorithm for the maximum likelihood estimation of a log-concave density based on complete data. Building on this fast algorithm, we indidate an EM algorithm to treat arbitrarily censored or binned data.

Methodology · Statistics 2011-03-21 Lutz Duembgen , Andre Huesler , Kaspar Rufibach

We propose a likelihood ratio statistic for forming hypothesis tests and confidence intervals for a nonparametrically estimated univariate regression function, based on the shape restriction of concavity (alternatively, convexity). Dealing…

Statistics Theory · Mathematics 2018-09-11 Charles R. Doss

We study the {\em robust proper learning} of univariate log-concave distributions (over continuous and discrete domains). Given a set of samples drawn from an unknown target distribution, we want to compute a log-concave hypothesis…

Data Structures and Algorithms · Computer Science 2016-06-10 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

In recent years, log-concave density estimation via maximum likelihood estimation has emerged as a fascinating alternative to traditional nonparametric smoothing techniques, such as kernel density estimation, which require the choice of one…

Methodology · Statistics 2017-09-12 Richard J. Samworth

Filtering and parameter estimation under partial information for multiscale problems is studied in this paper. After proving mean square convergence of the nonlinear filter to a filter of reduced dimension, we establish that the conditional…

Probability · Mathematics 2014-09-09 Andrew Papanicolaou , Konstantinos Spiliopoulos

Survival analysis aims at modeling the relationship between covariates and event occurrence with some untracked (censored) samples. In implementation, existing methods model the survival distribution with strong assumptions or in a discrete…

Machine Learning · Computer Science 2023-05-25 Yu Ling , Weimin Tan , Bo Yan

We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in $\mathbb{R}^d$. Our study covers both the case where the true underlying density is…

Statistics Theory · Mathematics 2009-09-01 Madeleine Cule , Richard Samworth

We propose an estimator of a concave cumulative distribution function under the measurement error model, where the non-negative variables of interest are perturbed by additive independent random noise. The estimator is defined as the least…

Statistics Theory · Mathematics 2026-03-03 Mohammed Es-Salih Benjrada , Cecile Durot , Tommaso Lando

There is a growing gap between the impressive results of deep image generative models and classical algorithms that offer theoretical guarantees. The former suffer from mode collapse or memorization issues, limiting their application to…

Machine Learning · Statistics 2023-06-02 Florentin Guth , Etienne Lempereur , Joan Bruna , Stéphane Mallat