English
Related papers

Related papers: Rapid parametric density estimation

200 papers

The question of how best to estimate a continuous probability density from finite data is an intriguing open problem at the interface of statistics and physics. Previous work has argued that this problem can be addressed in a natural way…

Data Analysis, Statistics and Probability · Physics 2014-07-16 Justin B. Kinney

A parametric method similar to autoregressive spectral estimators is proposed to determine the probability density function (pdf) of a random set. The method proceeds by maximizing the likelihood of the pdf, yielding estimates that perform…

Data Analysis, Statistics and Probability · Physics 2009-10-31 T. Dudok de Wit , E. Floriani

Density regression provides a flexible strategy for modeling the distribution of a response variable $Y$ given predictors $\mathbf{X}=(X_1,\ldots,X_p)$ by letting that the conditional density of $Y$ given $\mathbf{X}$ as a completely…

Statistics Theory · Mathematics 2016-01-07 Weining Shen , Subhashis Ghosal

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.)…

Machine Learning · Statistics 2026-02-24 Xinyu Liu , Hai Zhang

Mixture proportion estimation (MPE) is the problem of estimating the weight of a component distribution in a mixture, given samples from the mixture and component. This problem constitutes a key part in many "weakly supervised learning"…

Machine Learning · Computer Science 2016-06-01 Harish G. Ramaswamy , Clayton Scott , Ambuj Tewari

In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the…

Signal Processing · Electrical Eng. & Systems 2020-01-10 Nitesh Sahu , Prabhu Babu

We propose Bayesian model averaging (BMA) as a method for postprocessing the results of model-based clustering. Given a number of competing models, appropriate model summaries are averaged, using the posterior model probabilities, instead…

Computation · Statistics 2015-07-01 Niamh Russell , Thomas Brendan Murphy , Adrian E Raftery

We study holonomic gradient decent for maximum likelihood estimation of exponential-polynomial distribution, whose density is the exponential function of a polynomial in the random variable. We first consider the case that the support of…

Statistics Theory · Mathematics 2014-09-17 Jumpei Hayakawa , Akimichi Takemura

We tackle the problem of high-dimensional nonparametric density estimation by taking the class of log-concave densities on $\mathbb{R}^p$ and incorporating within it symmetry assumptions, which facilitate scalable estimation algorithms and…

Statistics Theory · Mathematics 2019-03-15 Min Xu , Richard J. Samworth

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

We formally map the problem of sampling from an unknown distribution with a density in $\mathbb{R}^d$ to the problem of learning and sampling a smoother density in $\mathbb{R}^{Md}$ obtained by convolution with a fixed factorial kernel: the…

Machine Learning · Statistics 2022-06-17 Saeed Saremi , Rupesh Kumar Srivastava

Calculation of the distribution of the average value of a Gaussian random field in a finite domain is carried out for different cases. The results of the calculation demonstrate a strong dependence of the width of the distribution on the…

Disordered Systems and Neural Networks · Physics 2015-05-13 S. V. Novikov , M. Van der Auweraer

Density estimation is a fundamental technique employed in various fields to model and to understand the underlying distribution of data. The primary objective of density estimation is to estimate the probability density function of a random…

Machine Learning · Statistics 2024-02-20 Cristiano Tamborrino , Antonella Falini , Francesca Mazzia

The paper considers so-called adaptive estimations of regression, distribution density and spectral density of a Gaussian stationary sequence, asymptotically optimal in order at a growing number of observation on any regular subspace…

Probability · Mathematics 2007-05-23 Eugene Ostrovsky , Leonid Sirota

In many statistical and econometric applications, we gather individual samples from various interconnected populations that undeniably exhibit common latent structures. Utilizing a model that incorporates these latent structures for such…

Methodology · Statistics 2023-09-19 Archer Gong Zhang , Jiahua Chen

Non-linear aggregation strategies have recently been proposed in response to the problem of how to combine, in a non-linear way, estimators of the regression function (see for instance \cite{biau:16}), classification rules (see…

Statistics Theory · Mathematics 2018-12-24 Alejandro Cholaquidis , Ricardo Fraiman , Badih Ghattas , Juan Kalemkerian

With the recent growth in data availability and complexity, and the associated outburst of elaborate modelling approaches, model selection tools have become a lifeline, providing objective criteria to deal with this increasingly challenging…

Methodology · Statistics 2020-10-08 Alessandro Casa , Luca Scrucca , Giovanna Menardi

The clusters of a distribution are often defined by the connected components of a density level set. However, this definition depends on the user-specified level. We address this issue by proposing a simple, generic algorithm, which uses an…

Methodology · Statistics 2015-10-29 Ingo Steinwart

In this paper, we consider the problem of estimating a conditional density in moderately large dimensions. Much more informative than regression functions, conditional densities are of main interest in recent methods, particularly in the…

Methodology · Statistics 2018-01-22 Minh-Lien Jeanne Nguyen

Density based spatial clustering of points in $\mathbb{R}^n$ has a myriad of applications in a variety of industries. We generalise this problem to the density based clustering of lines in high-dimensional spaces, keeping in mind there…

Machine Learning · Computer Science 2024-10-04 Akanksha Das , Malay Bhattacharyya