English
Related papers

Related papers: Model selection for density estimation with L2-los…

200 papers

The $L_2$-norm, or collision norm, is a core entity in the analysis of distributions and probabilistic algorithms. Batu and Canonne (FOCS 2017) presented an extensive analysis of algorithmic aspects of the $L_2$-norm and its connection to…

Data Structures and Algorithms · Computer Science 2026-03-26 Tomer Adar

The estimation of the ratio of two density probability functions is of great interest in many statistics fields, including causal inference. In this study, we develop an ensemble estimator of density ratios with a novel loss function based…

Machine Learning · Statistics 2024-08-12 Wencheng Wu , David Benkeser

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

This paper concerns estimating a probability density function $f$ based on iid observations from $g(x)=W^{-1} w(x) f(x)$, where the weight function $w$ and the total weight $W=\int w(x) f(x) dx$ may not be known. The length-biased and…

Statistics Theory · Mathematics 2007-06-13 Robert M. Mnatsakanov , Frits H. Ruymgaart

We consider a multiplicative deconvolution problem, in which the density $f$ or the survival function $S^X$ of a strictly positive random variable $X$ is estimated nonparametrically based on an i.i.d. sample from a noisy observation $Y =…

Statistics Theory · Mathematics 2025-09-30 Sergio Brenner Miguel , Jan Johannes , Maximilian Siebel

We examine the integrated squared difference, also known as the L2 distance (L2D), between two probability densities. Such a distance metric allows for comparison of differences between pairs of distributions or changes in a distribution…

Methodology · Statistics 2019-06-03 George Shan , Mark J. van der Laan

We consider the problem of estimating the state and unknown input for a large class of nonlinear systems subject to unknown exogenous inputs. The exogenous inputs themselves are modeled as being generated by a nonlinear system subject to…

Systems and Control · Computer Science 2019-02-25 Martin Corless , Ankush Chakrabarty

A two-class mixture model, where the density of one of the components is known, is considered. We address the issue of the nonparametric adaptive estimation of the unknown probability density of the second component. We propose a randomly…

Statistics Theory · Mathematics 2021-02-08 Gaelle Chagny , Antoine Channarond , Van Ha Hoang , Angelina Roche

We are interested in the problem of robust parametric estimation of a density from $n$ i.i.d. observations. By using a practice-oriented procedure based on robust tests, we build an estimator for which we establish non-asymptotic risk…

Statistics Theory · Mathematics 2016-03-31 Mathieu Sart

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

Statistics Theory · Mathematics 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

This paper introduces a probability density estimator based on Green's function identities. A density model is constructed under the sole assumption that the probability density is differentiable. The method is implemented as a binary…

Machine Learning · Statistics 2012-08-22 Peter Kovesarki , Ian C. Brock , A. Elizabeth Nuncio Quiroz

In this article we study the problem of quantifying the uncertainty in an experiment with a technical system. We propose new density estimates which combine observed data of the technical system and simulated data from an (imperfect)…

Statistics Theory · Mathematics 2020-12-21 Sebastian Kersting , Michael Kohler

Existing approaches to model uncertainty typically either compare models using a quantitative model selection criterion or evaluate posterior model probabilities having set a prior. In this paper, we propose an alternative strategy which…

Methodology · Statistics 2025-03-26 Vik Shirvaikar , Stephen G. Walker , Chris Holmes

Our investigation concerns the estimation of predictive densities and a study of efficiency as measured by the frequentist risk of such predictive densities with integrated $L_2$ and $L_1$ losses. Our findings relate to a $p-$variate…

Statistics Theory · Mathematics 2014-08-25 Tatsuya Kubokawa , Éric Marchand , William E. Strawderman

Multivariate distributions often carry latent structures that are difficult to identify and estimate, and which better reflect the data generating mechanism than extrinsic structures exhibited simply by the raw data. In this paper, we…

Methodology · Statistics 2025-04-16 Bryon Aragam , Ruiyi Yang

We explain how effective automatic probability density function estimates can be constructed using contemporary Bayesian inference engines such as those based on no-U-turn sampling and expectation propagation. Extensive simulation studies…

Machine Learning · Statistics 2021-09-28 M. P. Wand , J. C. F. Yu

This paper addresses the problem of an efficient predictive density estimation for the density $q(\|y-\theta\|^2)$ of $Y$ based on $X \sim p(\|x-\theta\|^2)$ for $y, x, \theta \in \mathbb{R}^d$. The chosen criteria are integrated $L_1$ loss…

Statistics Theory · Mathematics 2022-10-04 Pankaj Bhagwat , Eric Marchand

Probability density estimation is a core problem of statistics and signal processing. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely…

Machine Learning · Statistics 2023-07-06 Guangyu Wu , Anders Lindquist

Density level sets can be estimated using plug-in methods, excess mass algorithms or a hybrid of the two previous methodologies. The plug-in algorithms are based on replacing the unknown density by some nonparametric estimator, usually the…

Statistics Theory · Mathematics 2016-11-26 A. Rodríguez-Casal , P. Saavedra-Nieves

We present a new Bayesian methodology to learn the unknown material density of a given sample by inverting its two-dimensional images that are taken with a Scanning Electron Microscope. An image results from a sequence of projections of the…

Applications · Statistics 2014-03-06 Dalia Chakrabarty , Fabio Rigat , Nare Gabrielyan , Richard Beanland , Shashi Paul