English
Related papers

Related papers: Adaptive Inference in Multivariate Nonparametric R…

200 papers

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set $\mathcal{G}$ up to the smallest possible additive term, called the convergence rate. When the…

Statistics Theory · Mathematics 2009-09-09 Jean-Yves Audibert

In additive models with many nonparametric components, a number of regularized estimators have been proposed and proven to attain various error bounds under different combinations of sparsity and fixed smoothness conditions. Some of these…

Statistics Theory · Mathematics 2020-11-16 Yisha Yao , Cun-Hui Zhang

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper (2007) for estimation of unknown nonparametric regression. We prove that this procedure is asymptotically efficient for a quadratic risk. It…

Statistics Theory · Mathematics 2008-12-18 Leonid Galtchouk , Serguey Pergamenshchikov

We consider the estimation of the value of a linear functional of the slope parameter in functional linear regression, where scalar responses are modeled in dependence of random functions. In Johannes and Schenk [2010] it has been shown…

Statistics Theory · Mathematics 2011-12-14 Jan Johannes , Rudolf Schenk

In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. At the…

Statistics Theory · Mathematics 2025-05-29 Oliver Y. Feng , Yu-Chun Kao , Min Xu , Richard J. Samworth

Minimax $L_2$ risks for high-dimensional nonparametric regression are derived under two sparsity assumptions: (1) the true regression surface is a sparse function that depends only on $d=O(\log n)$ important predictors among a list of $p$…

Statistics Theory · Mathematics 2015-04-02 Yun Yang , Surya T. Tokdar

We study the adaptive minimax estimation of non-linear integral functionals of a density and extend the results obtained for linear and quadratic functionals to general functionals. The typical rate optimal non-adaptive minimax estimators…

Statistics Theory · Mathematics 2016-01-12 Rajarshi Mukherjee , Eric Tchetgen Tchetgen , James Robins

This paper provides some useful tests for fitting a parametric single-index regression model when covariates are measured with error and validation data is available. We propose two tests whose consistency rates do not depend on the…

Methodology · Statistics 2016-04-29 Hira L. Koul , Chuanlong Xie , Lixing Zhu

We consider the problem of constructing honest confidence intervals (CIs) for a scalar parameter of interest, such as the regression discontinuity parameter, in nonparametric regression based on kernel or local polynomial estimators. To…

Applications · Statistics 2020-04-08 Timothy B. Armstrong , Michal Kolesár

In this paper, we consider the time-inhomogeneous nonlinear time series regression for a general class of locally stationary time series. On one hand, we propose sieve nonparametric estimators for the time-varying regression functions which…

Statistics Theory · Mathematics 2021-12-17 Xiucai Ding , Zhou Zhou

We address functional uncertainty quantification for ill-posed inverse problems where it is possible to evaluate a possibly rank-deficient forward model, the observation noise distribution is known, and there are known parameter…

Methodology · Statistics 2025-02-06 Michael Stanley , Pau Batlle , Pratik Patil , Houman Owhadi , Mikael Kuusela

Negative binomial regression is commonly employed to analyze overdispersed count data. With small to moderate sample sizes, the maximum likelihood estimator of the dispersion parameter may be subject to a significant bias, that in turn…

Methodology · Statistics 2020-11-06 Euloge Clovis Kenne Pagui , Alessandra Salvan , Nicola Sartori

The purpose of this paper is to propose methodologies for statistical inference of low-dimensional parameters with high-dimensional data. We focus on constructing confidence intervals for individual coefficients and linear combinations of…

Methodology · Statistics 2012-11-05 Cun-Hui Zhang , Stephanie S. Zhang

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

For the problem of nonparametric regression of smooth functions, we reconsider and analyze a constrained variational approach, which we call the MultIscale Nemirovski-Dantzig (MIND) estimator. This can be viewed as a multiscale extension of…

Statistics Theory · Mathematics 2018-05-02 Markus Grasmair , Housen Li , Axel Munk

Recent research shows the susceptibility of machine learning models to adversarial attacks, wherein minor but maliciously chosen perturbations of the input can significantly degrade model performance. In this paper, we theoretically analyse…

Statistics Theory · Mathematics 2025-05-14 Jingfu Peng , Yuhong Yang

We consider the nonparametric multivariate isotonic regression problem, where the regression function is assumed to be nondecreasing with respect to each predictor. Our goal is to construct a Bayesian credible interval for the function…

Statistics Theory · Mathematics 2022-11-24 Kang Wang , Subhashis Ghosal

We consider the nonparametric estimation of the intensity function of a Poisson point process in a circular model from indirect observations $N_1,\ldots,N_n$. These observations emerge from hidden point process realizations with the target…

Statistics Theory · Mathematics 2019-02-19 Martin Kroll

For nonparametric regression with one-sided errors and a boundary curve model for Poisson point processes we consider the problem of efficient estimation for linear functionals. The minimax optimal rate is obtained by an unbiased estimation…

Statistics Theory · Mathematics 2015-09-25 Markus Reiß , Leonie Selk

We investigate online convex optimization in changing environments, and choose the adaptive regret as the performance measure. The goal is to achieve a small regret over every interval so that the comparator is allowed to change over time.…

Machine Learning · Computer Science 2019-06-18 Lijun Zhang , Tie-Yan Liu , Zhi-Hua Zhou