English
Related papers

Related papers: Tuning Parameter-Free Nonparametric Density Estima…

200 papers

We present a local density estimator based on first order statistics. To estimate the density at a point, $x$, the original sample is divided into subsets and the average minimum sample distance to $x$ over all such subsets is used to…

Methodology · Statistics 2014-12-10 Vikram V. Garg , Luis Tenorio , Karen Willcox

Consider the communication-constrained problem of nonparametric function estimation, in which each distributed terminal holds multiple i.i.d. samples. Under certain regularity assumptions, we characterize the minimax optimal rates for all…

Machine Learning · Computer Science 2025-01-15 Deheng Yuan , Tao Guo , Zhongyi Huang

Faithful representations of atomic environments and general models for regression can be harnessed to learn electron densities that are close to the ground state. One of the applications of data-derived electron densities is to orbital-free…

Materials Science · Physics 2019-03-01 Andrew T. Fowler , Chris J. Pickard , James A. Elliott

As an application of generalised statistical mechanics, it is studied a possible route toward a consistent generalised information theory in terms of a family of non-extensive, non-parametric entropies $H^\pm_D(P)$. Unlike other proposals…

Information Theory · Computer Science 2021-03-23 Jesús Fuentes , Octavio Obregón

A new nonparametric model of maximum-entropy (MaxEnt) copula density function is proposed, which offers the following advantages: (i) it is valid for mixed random vector. By `mixed' we mean the method works for any combination of discrete…

Statistics Theory · Mathematics 2022-08-23 Subhadeep , Mukhopadhyay

Indirect inference estimators (i.e., simulation-based minimum distance estimators) in a parametric model that are based on auxiliary non-parametric maximum likelihood density estimators are shown to be asymptotically normal. If the…

Statistics Theory · Mathematics 2012-01-24 Florian Gach , Benedikt M. Pötscher

Density estimation is a fundamental task in statistics and machine learning applications. Kernel density estimation is a powerful tool for non-parametric density estimation in low dimensions; however, its performance is poor in higher…

Machine Learning · Computer Science 2022-08-08 Joseph A. Gallego , Fabio A. González

A nonparametric kernel density estimator for directional-linear data is introduced. The proposal is based on a product kernel accounting for the different nature of both (directional and linear) components of the random vector. Expressions…

We introduce a new deal of kernel density estimation using an exponentiated form of kernel density estimators. The density estimator has two hyperparameters flexibly controlling the smoothness of the resulting density. We tune them in a…

Semicontinuous outcomes occur frequently in health services, insurance, and cost studies. Standard nonparametric density estimators are not well suited to such data because they do not naturally accommodate the mixed structure, the…

Methodology · Statistics 2026-05-06 Guanjie Lyu , Frédéric Ouimet , Cindy Feng

This article introduces a new instrumental variable approach for estimating unknown population parameters with data having nonrandom missing values. With coarse and discrete instruments, Shao and Wang (2016) proposed a semiparametric method…

Methodology · Statistics 2021-11-19 Arkaprabha Ganguli , David Todem

The histogram method is a powerful non-parametric approach for estimating the probability density function of a continuous variable. But the construction of a histogram, compared to the parametric approaches, demands a large number of…

Machine Learning · Statistics 2015-12-29 Hideaki Kim , Hiroshi Sawada

Parametric factor copula models typically work well in modeling multivariate dependencies due to their flexibility and ability to capture complex dependency structures. However, accurately estimating the linking copulas within these models…

Methodology · Statistics 2025-10-22 Bahareh Ghanbari , Pavel Krupskiy , Laleh Tafakori , Yan Wang

Subsampling methods aim to select a subsample as a surrogate for the observed sample. Such methods have been used pervasively in large-scale data analytics, active learning, and privacy-preserving analysis in recent decades. Instead of…

Machine Learning · Statistics 2022-06-03 Jingyi Zhang , Cheng Meng , Jun Yu , Mengrui Zhang , Wenxuan Zhong , Ping Ma

Nonresponse frequently arises in practice, and simply ignoring it may lead to erroneous inference. Besides, the number of collected covariates may increase as the sample size in modern statistics, so parametric imputation or propensity…

Methodology · Statistics 2022-09-29 Xin He , Xiaojun Mao , Zhonglei Wang

We propose a kernel-based nonparametric framework for mean-variance optimization that enables inference on economically motivated shape constraints in finance, including positivity, monotonicity, and convexity. Many central hypotheses in…

Machine Learning · Statistics 2026-01-26 Rohan Sen

Estimating density functionals of analog sources is an important problem in statistical signal processing and information theory. Traditionally, estimating these quantities requires either making parametric assumptions about the underlying…

Information Theory · Computer Science 2017-05-19 Alan Wisler , Kevin Moon , Visar Berisha

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

Recent work has focused on the problem of nonparametric estimation of information divergence functionals. Many existing approaches are restrictive in their assumptions on the density support set or require difficult calculations at the…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Kristjan Greenewald , Alfred O. Hero

In this paper, we will discuss how to generalize nonparametric density estimators to MLE parametric estimators. Basing on the Parzen window theory and using the advantages of probability amplitude of quantum theory, we model a nonlinear…

Statistics Theory · Mathematics 2008-11-13 Yeong-Shyeong Tsai