English
Related papers

Related papers: Marshall's lemma for convex density estimation

200 papers

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

We consider a generalization of the classifier-based density-ratio estimation task to a quasiprobabilistic setting where probability densities can be negative. The problem with most loss functions used for this task is that they implicitly…

Machine Learning · Statistics 2025-12-24 Matthew Drnevich , Stephen Jiggins , Kyle Cranmer

This paper addresses the problem of an efficient predictive density estimation for the density $q(\|y-\theta\|^2)$ of $Y$ based on $X \sim p(\|x-\theta\|^2)$ for $y, x, \theta \in \mathbb{R}^d$. The chosen criteria are integrated $L_1$ loss…

Statistics Theory · Mathematics 2022-10-04 Pankaj Bhagwat , Eric Marchand

In this paper we integrate isotonic regression with Stone's cross-validation-based method to estimate a distribution with a general countable support with a partial order relation defined on it. We prove that the estimator is strongly…

Statistics Theory · Mathematics 2024-11-05 Vladimir Pastukhov

We study non-parametric regression estimates for random fields. The data satisfies certain strong mixing conditions and is defined on the regular $N$-dimensional lattice structure. We show consistency and obtain rates of convergence. The…

Statistics Theory · Mathematics 2018-07-06 Johannes T. N. Krebs

We study estimation of multivariate densities $p$ of the form $p(x)=h(g(x))$ for $x\in \mathbb {R}^d$ and for a fixed monotone function $h$ and an unknown convex function $g$. The canonical example is $h(y)=e^{-y}$ for $y\in \mathbb {R}$;…

Statistics Theory · Mathematics 2012-11-15 Arseni Seregin , Jon A. Wellner

We establish the limiting distribution of $\frac{{(\log \log x)}^{1/4}}{\sqrt{x}} \sum_{n\le x}\alpha(n)$ where $\alpha$ is a Steinhaus random multiplicative function, answering a question of Harper. The distributional convergence is proved…

Number Theory · Mathematics 2025-09-16 Ofir Gorodetsky , Mo Dick Wong

The Collatz Conjecture's connection to dynamical systems opens it to a variety of techniques aimed at recurrence and density results. First, we turn to density results and strengthen the result of Terras through finding a strict rate of…

Dynamical Systems · Mathematics 2023-10-16 Idris Assani , Ethan Ebbighausen

Estimation of the density of regression errors is a fundamental issue in regression analysis and it is typically explored via a parametric approach. This article uses a nonparametric approach with the mean integrated squared error (MISE)…

Statistics Theory · Mathematics 2007-06-13 Sam Efromovich

In this short note we have proved an enhanced version of a theorem of Lorentz [1] and its generalization to the multivariate case which gives a non- uniform estimate of degree of approximation by a polynomial with positive coefficients. The…

Classical Analysis and ODEs · Mathematics 2016-11-30 Zhong Guan , Tao Wang

We investigate the stochastic optimization problem of minimizing population risk, where the loss defining the risk is assumed to be weakly convex. Compositions of Lipschitz convex functions with smooth maps are the primary examples of such…

Optimization and Control · Mathematics 2018-12-19 Damek Davis , Dmitriy Drusvyatskiy

Let $p_n(y)=\sum_k\hat{\alpha}_k\phi(y-k)+\sum_{l=0}^{j_n-1}\sum_k\hat {\beta}_{lk}2^{l/2}\psi(2^ly-k)$ be the linear wavelet density estimator, where $\phi$, $\psi$ are a father and a mother wavelet (with compact support),…

Statistics Theory · Mathematics 2009-08-31 Evarist Giné , Richard Nickl

We consider the problem of estimating smooth integrated functionals of a monotone nonincreasing density $f$ on $[0,\infty)$ using the nonparametric maximum likelihood based plug-in estimator. We find the exact asymptotic distribution of…

Statistics Theory · Mathematics 2019-04-16 Rajarshi Mukherjee , Bodhisattva Sen

We provide statistical learning guarantees for two unsupervised learning tasks in the context of compressive statistical learning, a general framework for resource-efficient large-scale learning that we introduced in a companion paper.The…

Machine Learning · Computer Science 2021-08-18 Rémi Gribonval , Gilles Blanchard , Nicolas Keriven , Yann Traonmilin

We study lower and upper bounds for the density of a diffusion process in ${\mathbb{R}}^n$ in a small (but not asymptotic) time, say $\delta$. We assume that the diffusion coefficients $\sigma_1,\ldots,\sigma_d$ may degenerate at the…

Probability · Mathematics 2019-12-03 Vlad Bally , Lucia Caramellino , Paolo Pigato

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

We derive the exact probability density function of the product of $N$ independent variance-gamma random variables with zero location parameter. We then apply this formula to derive formulas for the cumulative distribution function and…

Probability · Mathematics 2025-08-05 Robert E. Gaunt , Siqi Li , Heather Sutcliffe

Kernel density estimation is a widely used nonparametric approach to estimate an unknown distribution. Recent work in Bayesian predictive inference has considered stochastic processes formed by specifying the predictive distribution for the…

Methodology · Statistics 2026-05-15 Torey Hilbert

In this paper, we study a class of non-parametric density estimators under Bayesian settings. The estimators are piecewise constant functions on binary partitions. We analyze the concentration rate of the posterior distribution under a…

Statistics Theory · Mathematics 2015-08-21 Linxi Liu , Wing Hung Wong

The Conway-Maxwell-Poisson distribution is a two-parameter generalisation of the Poisson distribution that can be used to model data that is under- or over-dispersed relative to the Poisson distribution. The normalizing constant…

Statistics Theory · Mathematics 2019-04-05 Robert E. Gaunt , Satish Iyengar , Adri B. Olde Daalhuis , Burcin Simsek