English
Related papers

Related papers: Nonparametric Estimation of Probability Density Fu…

200 papers

Estimating the score, i.e., the gradient of log density function, from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models that involve flexible yet intractable…

Machine Learning · Statistics 2020-07-01 Yuhao Zhou , Jiaxin Shi , Jun Zhu

We consider a nonparametric regression model $Y=r(X)+\varepsilon$ with a random covariate $X$ that is independent of the error $\varepsilon$. Then the density of the response $Y$ is a convolution of the densities of $\varepsilon$ and…

Statistics Theory · Mathematics 2013-12-18 Anton Schick , Wolfgang Wefelmeyer

We study the density estimation problem with observations generated by certain dynamical systems that admit a unique underlying invariant Lebesgue density. Observations drawn from dynamical systems are not independent and moreover, usual…

Machine Learning · Statistics 2016-07-14 Hanyuan Hang , Ingo Steinwart , Yunlong Feng , Johan A. K. Suykens

Elliptical distribution is a basic assumption underlying many multivariate statistical methods. For example, in sufficient dimension reduction and statistical graphical models, this assumption is routinely imposed to simplify the data…

Statistics Theory · Mathematics 2024-12-16 Yin Tang , Bing Li

The density function of the limiting spectral distribution of general sample covariance matrices is usually unknown. We propose to use kernel estimators which are proved to be consistent. A simulation study is also conducted to show the…

Statistics Theory · Mathematics 2012-11-15 Bing-Yi Jing , Guangming Pan , Qi-Man Shao , Wang Zhou

We consider the estimation of densities in multiple subpopulations, where the available sample size in each subpopulation greatly varies. This problem occurs in epidemiology, for example, where different diseases may share similar…

Methodology · Statistics 2021-09-15 Jiaming Qiu , Xiongtao Dai , Zhengyuan Zhu

We propose a method for nonparametric density estimation that exhibits robustness to contamination of the training sample. This method achieves robustness by combining a traditional kernel density estimator (KDE) with ideas from classical…

Machine Learning · Statistics 2011-09-07 JooSeuk Kim , Clayton D. Scott

In the context of estimating local modes of a conditional density based on kernel density estimators, we show that existing bandwidth selection methods developed for kernel density estimation are unsuitable for mode estimation. We propose…

Computation · Statistics 2017-11-02 Haiming Zhou , Xianzheng Huang

Estimating expected polynomials of density functions from samples is a basic problem with numerous applications in statistics and information theory. Although kernel density estimators are widely used in practice for such functional…

Information Theory · Computer Science 2017-02-13 Weihao Gao , Sewoong Oh , Pramod Viswanath

Estimating density functionals of analog sources is an important problem in statistical signal processing and information theory. Traditionally, estimating these quantities requires either making parametric assumptions about the underlying…

Information Theory · Computer Science 2017-05-19 Alan Wisler , Kevin Moon , Visar Berisha

We study nonparametric estimation of an unknown density function $f$ based on the ranked-based observations obtained from a partially rank-ordered set (PROS) sampling design. PROS sampling design has many applications in environmental,…

Statistics Theory · Mathematics 2014-01-07 Sahar Nazari , Mohammad Jafari Jozani , Mahmood Kharrati-Kopaei

Important information concerning a multivariate data set, such as clusters and modal regions, is contained in the derivatives of the probability density function. Despite this importance, nonparametric estimation of higher order derivatives…

Statistics Theory · Mathematics 2022-03-04 José E. Chacón , Tarn Duong

A density estimation method in a Bayesian nonparametric framework is presented when recorded data are not coming directly from the distribution of interest, but from a length biased version. From a Bayesian perspective, efforts to…

Statistics Theory · Mathematics 2015-10-23 Spyridon J. Hatjispyros , Theodoros Nicoleris , Stephen G. Walker

We introduce \emph{topological density estimation} (TDE), in which the multimodal structure of a probability density function is topologically inferred and subsequently used to perform bandwidth selection for kernel density estimation. We…

Methodology · Statistics 2022-03-10 Steve Huntsman

Density estimation plays a fundamental role in many areas of statistics and machine learning. Parametric, nonparametric and semiparametric density estimation methods have been proposed in the literature. Semiparametric density models are…

Statistics Theory · Mathematics 2019-01-11 Jian Shi , Jiahui Yu , Anna Liu , Yuedong Wang

Bandwidth selection is crucial in the kernel estimation of density level sets. A risk based on the symmetric difference between the estimated and true level sets is usually used to measure their proximity. In this paper we provide an…

Statistics Theory · Mathematics 2020-01-01 Wanli Qiao

We define a new bandwidth-dependent kernel density estimator that improves existing convergence rates for the bias, and preserves that of the variation, when the error is measured in $L_1$. No additional assumptions are imposed to the…

Statistics Theory · Mathematics 2016-12-28 Kairat Mynbaev , Carlos Martins-Filho

We consider kernel estimation of marginal densities and regression functions of stationary processes. It is shown that for a wide class of time series, with proper centering and scaling, the maximum deviations of kernel density and…

Statistics Theory · Mathematics 2010-10-21 Weidong Liu , Wei Biao Wu

It is a common practice to evaluate probability density function or matter spatial density function from statistical samples. Kernel density estimation is a frequently used method, but to select an optimal bandwidth of kernel estimation,…

Methodology · Statistics 2021-04-27 Zhen-Wei Li , Ping He

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi