English
Related papers

Related papers: Geometry of Log-Concave Density Estimation

200 papers

We investigate the problem of density estimation on the unit circle and the unit sphere from a computational perspective. Our primary goal is to develop new density estimators that are both rate-optimal and computationally efficient for…

Statistics Theory · Mathematics 2026-05-08 Athanasios G. Georgiadis , Andrew P. Percival

We estimate the density and its derivatives using a local polynomial approximation to the logarithm of an unknown density $f$. The estimator is guaranteed to be nonnegative and achieves the same optimal rate of convergence in the interior…

Econometrics · Economics 2020-06-03 Joris Pinkse , Karl Schurter

The aim of this research is to make a step towards providing a tool for model selection for log-density estimation. The author revisits the procedure for local log-density estimation suggested by Clive Loader (1996) and extends the…

Statistics Theory · Mathematics 2016-07-05 Sergey Dovgal

Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods…

Computation · Statistics 2021-09-09 Pierre L'Ecuyer , Florian Puchhammer

Accurate density estimation methodologies play an integral role in a variety of scientific disciplines, with applications including simulation models, decision support tools, and exploratory data analysis. In the past, histograms and kernel…

Statistics Theory · Mathematics 2012-06-14 Judson B. Locke , Adrian M. Peter

Although Bayesian density estimation using discrete mixtures has good performance in modest dimensions, there is a lack of statistical and computational scalability to high-dimensional multivariate cases. To combat the curse of…

Methodology · Statistics 2014-10-29 Ye Wang , Antonio Canale , David Dunson

We prove Wasserstein contraction of simple slice sampling for approximate sampling w.r.t. distributions with log-concave and rotational invariant Lebesgue densities. This yields, in particular, an explicit quantitative lower bound of the…

Probability · Mathematics 2020-09-17 Viacheslav Natarovskii , Daniel Rudolf , Björn Sprungk

We discuss properties of two methods for ascribing probabilities to the shape of a probability distribution. One is based on the idea of counting the number of modes of a bootstrap version of a standard kernel density estimator. We argue…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Hong Ooi

Density functions that represent sample data are often multimodal, i.e. they exhibit more than one maximum. Typically this behavior is taken to indicate that the underlying data deserves a more detailed representation as a mixture of…

Methodology · Statistics 2018-06-04 Steve Huntsman

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Computation · Statistics 2016-12-06 Arnak S. Dalalyan

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

For the task of sampling from a density $\pi \propto \exp(-V)$ on $\mathbb{R}^d$, where $V$ is possibly non-convex but $L$-gradient Lipschitz, we prove that averaged Langevin Monte Carlo outputs a sample with $\varepsilon$-relative Fisher…

Statistics Theory · Mathematics 2022-02-11 Krishnakumar Balasubramanian , Sinho Chewi , Murat A. Erdogdu , Adil Salim , Matthew Zhang

This work is concerned with the formulation of a general framework for the analysis of meshfree approximation schemes and with the convergence analysis of the Local Maximum-Entropy (LME) scheme as a particular example. We provide conditions…

Numerical Analysis · Mathematics 2011-08-01 Agustin Bompadre , Bernd Schmidt , Michael Ortiz

Sampling from high-dimensional probability distributions is fundamental in machine learning and statistics. As datasets grow larger, computational efficiency becomes increasingly important, particularly in reducing adaptive complexity,…

Data Structures and Algorithms · Computer Science 2025-09-23 Huanjian Zhou , Masashi Sugiyama

Multivariate distributions often carry latent structures that are difficult to identify and estimate, and which better reflect the data generating mechanism than extrinsic structures exhibited simply by the raw data. In this paper, we…

Methodology · Statistics 2025-04-16 Bryon Aragam , Ruiyi Yang

In this paper, we propose a maximum smoothed likelihood method to estimate the component density functions of mixture models, in which the mixing proportions are known and may differ among observations. The proposed estimates maximize a…

Methodology · Statistics 2014-07-14 Tao Yu , Pengfei Li , Jing Qin

Sumset estimates, which provide bounds on the cardinality of sumsets of finite sets in a group, form an essential part of the toolkit of additive combinatorics. In recent years, probabilistic or entropic analogs of many of these…

Metric Geometry · Mathematics 2022-06-06 Matthieu Fradelizi , Mokshay Madiman , Artem Zvavitch

We consider the problem of sampling from a $d$-dimensional log-concave distribution $\pi(\theta) \propto \exp(-f(\theta))$ for $L$-Lipschitz $f$, constrained to a convex body with an efficiently computable self-concordant barrier function,…

Data Structures and Algorithms · Computer Science 2024-11-14 Yuzhou Gu , Nikki Lijing Kuang , Yi-An Ma , Zhao Song , Lichen Zhang

This paper develops a nonparametric density estimator with parametric overtones. Suppose $f(x,\theta)$ is some family of densities, indexed by a vector of parameters $\theta$. We define a local kernel smoothed likelihood function which for…

Methodology · Statistics 2026-04-22 Nils Lid Hjort , M. C. Jones

If the log likelihood is approximately quadratic with constant Hessian, then the maximum likelihood estimator (MLE) is approximately normally distributed. No other assumptions are required. We do not need independent and identically…

Statistics Theory · Mathematics 2012-07-06 Charles J. Geyer