English
Related papers

Related papers: Nonparametric Conditional Density Estimation in a …

200 papers

This paper develops a nonparametric density estimator with parametric overtones. Suppose $f(x,\theta)$ is some family of densities, indexed by a vector of parameters $\theta$. We define a local kernel smoothed likelihood function which for…

Methodology · Statistics 2026-04-22 Nils Lid Hjort , M. C. Jones

Nonparametric feature selection in high-dimensional data is an important and challenging problem in statistics and machine learning fields. Most of the existing methods for feature selection focus on parametric or additive models which may…

Methodology · Statistics 2021-03-31 Hang Yu , Yuanjia Wang , Donglin Zeng

Parametric factor copula models typically work well in modeling multivariate dependencies due to their flexibility and ability to capture complex dependency structures. However, accurately estimating the linking copulas within these models…

Methodology · Statistics 2025-10-22 Bahareh Ghanbari , Pavel Krupskiy , Laleh Tafakori , Yan Wang

We develop a novel method to construct uniformly valid confidence bands for a nonparametric component $f_1$ in the sparse additive model $Y=f_1(X_1)+\ldots + f_p(X_p) + \varepsilon$ in a high-dimensional setting. Our method integrates sieve…

Methodology · Statistics 2024-04-24 Philipp Bach , Sven Klaassen , Jannis Kueck , Martin Spindler

To successfully work on variable selection, sparse model structure has become a basic assumption for all existing methods. However, this assumption is questionable as it is hard to hold in most of cases and none of existing methods may…

Methodology · Statistics 2011-12-06 Lu Lin , Lixing Zhu , Yujie Gai

We consider the nonparametric regression estimation problem of recovering an unknown response function f on the basis of spatially inhomogeneous data when the design points follow a known compactly supported density g with a finite number…

Methodology · Statistics 2012-10-29 Anestis Antoniadis , Marianna Pensky , Theofanis Sapatinas

Density regression provides a flexible strategy for modeling the distribution of a response variable $Y$ given predictors $\mathbf{X}=(X_1,\ldots,X_p)$ by letting that the conditional density of $Y$ given $\mathbf{X}$ as a completely…

Statistics Theory · Mathematics 2016-01-07 Weining Shen , Subhashis Ghosal

We introduce a nonparametric spectral density estimator for continuous-time and continuous-space processes measured at fully irregular locations. Our estimator is constructed using a weighted nonuniform Fourier sum whose weights yield a…

Methodology · Statistics 2025-10-07 Christopher J. Geoga , Paul G. Beckman

Regressing a function $F$ on $\mathbb{R}^d$ without the statistical and computational curse of dimensionality requires special statistical models, for example that impose geometric assumptions on the distribution of the data (e.g., that its…

Machine Learning · Statistics 2026-02-06 Yantao Wu , Mauro Maggioni

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

This paper studies the minimax rate of nonparametric conditional density estimation under a weighted absolute value loss function in a multivariate setting. We first demonstrate that conditional density estimation is impossible if one only…

Statistics Theory · Mathematics 2021-03-15 Michael Li , Matey Neykov , Sivaraman Balakrishnan

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

Statistics Theory · Mathematics 2015-08-13 Jana Jankova , Sara van de Geer

Compositional data, representing proportions constrained to the simplex, arise in diverse fields such as geosciences, ecology, genomics, and microbiome research. Existing nonparametric density estimation methods often rely on…

Methodology · Statistics 2025-10-10 Jiajin Xie , Yong Wang , Eduardo García-Portugués

In this paper, we consider a partial deconvolution kernel estimator for nonparametric regression when some covariates are measured with error while others are observed without error. We focus on a general and realistic setting in which the…

Statistics Theory · Mathematics 2026-01-29 Baba Thiam

Let $\textbf{X} = (X_1,\ldots, X_p)$ be a stochastic vector having joint density function $f_{\textbf{X}}(x)$ with partitions $\textbf{X}_1 = (X_1,\ldots, X_k)$ and $\textbf{X}_2 = (X_{k+1},\ldots, X_p)$. A new method for estimating the…

Methodology · Statistics 2018-09-28 Håkon Otneim , Dag Tjøstheim

Density estimation plays a key role in many tasks in machine learning, statistical inference, and visualization. The main bottleneck in high-dimensional density estimation is the prohibitive computational cost and the slow convergence rate.…

Machine Learning · Computer Science 2021-10-22 Liang Ding , Lu Zou , Wenjia Wang , Shahin Shahrampour , Rui Tuo

A sparse precision matrix can be directly translated into a sparse Gaussian graphical model under the assumption that the data follow a joint normal distribution. This neat property makes high-dimensional precision matrix estimation very…

Statistics Theory · Mathematics 2013-02-14 Lingzhou Xue , Hui Zou

We propose a novel approach for density estimation called histogram trend filtering. Our estimator arises from looking at surrogate Poisson model for counts of observations in a partition of the support of the data. We begin by showing…

Methodology · Statistics 2016-02-09 Oscar Hernan Madrid Padilla , James G. Scott

Nonparametric estimation of the conditional expectation $E(Y | U)$ of an outcome $Y$ given a covariate vector $U$ is of primary importance in many statistical applications such as prediction and personalized medicine. In some problems,…

Methodology · Statistics 2018-05-10 Bingying Xie , Jun Shao