English
Related papers

Related papers: Adaptive density estimation: a curse of support?

200 papers

This paper demonstrates that when a shallow neural network with a Lipschitz continuous activation function is trained using either empirical or population risk to approximate a target function that is $r$ times continuously differentiable…

Machine Learning · Computer Science 2026-03-06 Sanghoon Na , Haizhao Yang

A regression problem with dependent data is considered. Regularity assumptions on the dependency of the data are introduced, and it is shown that under suitable structural assumptions on the regression function a deep recurrent neural…

Machine Learning · Statistics 2020-11-03 Michael Kohler , Adam Krzyzak

We consider a linear model where the coefficients - intercept and slopes - are random with a law in a nonparametric class and independent from the regressors. Identification often requires the regressors to have a support which is the whole…

Statistics Theory · Mathematics 2020-06-22 Christophe Gaillac , Eric Gautier

This paper continues the research started in \cite{LW16}. In the framework of the convolution structure density model on $\bR^d$, we address the problem of adaptive minimax estimation with $\bL_p$--loss over the scale of anisotropic…

Statistics Theory · Mathematics 2017-04-17 Oleg Lepski , Thomas Willer

We offer a theoretical validation of the curse of dimensionality in the pivot-based indexing of datasets for similarity search, by proving, in the framework of statistical learning, that in high dimensions no pivot-based indexing scheme can…

Data Structures and Algorithms · Computer Science 2016-11-17 Ilya Volnyansky , Vladimir Pestov

Practical applications of nonparametric density estimators in more than three dimensions suffer a great deal from the well-known curse of dimensionality: convergence slows down as dimension increases. We show that one can evade the curse of…

Methodology · Statistics 2016-11-24 Thomas Nagler , Claudia Czado

In this paper we study the problem of pointwise density estimation from observations with multiplicative measurement errors. We elucidate the main feature of this problem: the influence of the estimation point on the estimation accuracy. In…

Methodology · Statistics 2018-07-13 Denis Belomestny , Alexander Goldenshluger

We prove the curse of dimensionality in the worst case setting for multivariate numerical integration for various classes of smooth functions. We prove the results when the domains are isotropic convex bodies with small diameter satisfying…

Numerical Analysis · Mathematics 2019-08-15 Aicke Hinrichs , Joscha Prochno , Mario Ullrich

Integration is affected by the curse of dimensionality and quickly becomes intractable as the dimensionality of the problem grows. We propose a randomized algorithm that, with high probability, gives a constant-factor approximation of a…

Machine Learning · Computer Science 2013-02-28 Stefano Ermon , Carla P. Gomes , Ashish Sabharwal , Bart Selman

One key issue in several astrophysical problems is the evaluation of the density probability function underlying an observational discrete data set. We here review two non-parametric density estimators which recently appeared in the…

Astrophysics · Physics 2009-10-30 Dario Fadda , Eric Slezak , Albert Bijaoui

This paper deals with the problem of the multivariate copula density estimation. Using wavelet methods we provide two shrinkage procedures based on thresholding rules for which the knowledge of the regularity of the copula density to be…

Statistics Theory · Mathematics 2011-11-04 Florent Autin , Erwan Le Pennec , Karine Tribouley

We consider a circular deconvolution problem, in which the density $f$ of a circular random variable $X$ must be estimated nonparametrically based on an i.i.d. sample from a noisy observation $Y$ of $X$. The additive measurement error is…

Statistics Theory · Mathematics 2013-12-11 Jan Johannes , Maik Schwarz

We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density…

Statistics Theory · Mathematics 2024-01-05 Y. Baraud , H. Halconruy , G. Maillard

As is known, factor analysis is a popular method to reduce dimension for high-dimensional data. For matrix data, the dimension reduction can be more effectively achieved through both row and column directions. In this paper, we introduce a…

Methodology · Statistics 2019-04-17 Xialu Liu , Elynn Chen

In the present paper a behavior of the "average case" approximation complexity for d-parametric random fields of tensor-type is studied. It was shown in [Lifshits and Tulyakova, 2006] that for a given approximation accuracy level the…

Probability · Mathematics 2012-08-16 N. A. Serdyukova

Bayesian density deconvolution using nonparametric prior distributions is a useful alternative to the frequentist kernel based deconvolution estimators due to its potentially wide range of applicability, straightforward uncertainty…

Statistics Theory · Mathematics 2013-09-10 Abhra Sarkar , Debdeep Pati , Bani K. Mallick , Raymond J. Carroll

Max-plus based methods have been recently developed to approximate the value function of possibly high dimensional optimal control problems. A critical step of these methods consists in approximating a function by a supremum of a small…

Optimization and Control · Mathematics 2012-06-05 Stephane Gaubert , William McEneaney , Zheng Qu

We consider the estimation of the global mode of a density under some decay rate condition around the global mode. We show that the maximum of a histogram, with proper choice of bandwidth, achieves the minimax rate that we establish for the…

Statistics Theory · Mathematics 2021-04-19 Ery Arias-Castro , Wanli Qiao , Lin Zheng

A $d$-dimensional nonparametric additive regression model with dependent observations is considered. Using the marginal integration technique and wavelets methodology, we develop a new adaptive estimator for a component of the additive…

Statistics Theory · Mathematics 2012-08-07 Christophe Chesneau , Jalal M. Fadili , Bertrand Maillot

We prove the curse of dimensionality for multivariate integration of C^r functions: The number of needed function values to achieve an error \epsilon\ is larger than c_r (1+\gamma)^d for \epsilon\le \epsilon_0, where c_r,\gamma>0 and d is…

Numerical Analysis · Mathematics 2017-06-22 Aicke Hinrichs , Erich Novak , Mario Ullrich , Henryk Wozniakowski