English
Related papers

Related papers: Wavelet regression in random design with heterosce…

200 papers

As one of the triumphs and milestones of robust statistics, Huber regression plays an important role in robust inference and estimation. It has also been finding a great variety of applications in machine learning. In a parametric setup, it…

Statistics Theory · Mathematics 2020-09-29 Yunlong Feng , Qiang Wu

We analyze the problem of quantum-limited estimation of a stochastically varying phase of a continuous beam (rather than a pulse) of the electromagnetic field. We consider both non-adaptive and adaptive measurements, and both dyne detection…

Quantum Physics · Physics 2007-05-23 D. W. Berry , H. M. Wiseman

This paper studies a Bayesian approach to non-asymptotic minimax adaptation in nonparametric estimation. Estimating an input function on the basis of output functions in a Gaussian white-noise model is discussed. The input function is…

Statistics Theory · Mathematics 2018-08-30 Keisuke Yano , Fumiyasu Komaki

We show both adaptive and non-adaptive minimax rates of convergence for a family of weighted Laplacian-Eigenmap based nonparametric regression methods, when the true regression function belongs to a Sobolev space and the sampling density is…

Statistics Theory · Mathematics 2023-11-02 Zhaoyang Shi , Krishnakumar Balasubramanian , Wolfgang Polonik

Deep, overparameterized regression models are notorious for their tendency to overfit. This problem is exacerbated in heteroskedastic models, which predict both mean and residual noise for each data point. At one extreme, these models fit…

Machine Learning · Statistics 2024-02-15 Eliot Wong-Toi , Alex Boyd , Vincent Fortuin , Stephan Mandt

Functional linear regression is an important topic in functional data analysis. It is commonly assumed that samples of the functional predictor are independent realizations of an underlying stochastic process, and are observed over a grid…

Methodology · Statistics 2020-09-15 Cheng Chen , Shaojun Guo , Xinghao Qiao

Suppose that we observe $y \in \mathbb{R}^f$ and $X \in \mathbb{R}^{f \times m}$ in the following errors-in-variables model: \begin{eqnarray*} y & = & X_0 \beta^* + \epsilon \\ X & = & X_0 + W \end{eqnarray*} where $X_0$ is a $f \times m$…

Statistics Theory · Mathematics 2015-12-21 Mark Rudelson , Shuheng Zhou

The construction of adaptive nonparametric procedures by means of wavelet thresholding techniques is now a classical topic in modern mathematical statistics. In this paper, we extend this framework to the analysis of nonparametric…

Statistics Theory · Mathematics 2013-03-12 Claudio Durastanti , Daryl Geller , Domenico Marinucci

The problem of prediction in functional linear regression is conventionally addressed by reducing dimension via the standard principal component basis. In this paper we show that an alternative basis chosen through weighted least-squares,…

Methodology · Statistics 2009-02-20 Aurore Delaigle , Peter Hall , Tatiyana V. Apanasovich

This work investigates a three-dimensional slow-fast stochastic system with quadratic nonlinearity and additive noise, inspired by fluid dynamics. The deterministic counterpart exhibits a periodic orbit and a slow manifold. We demonstrate…

Dynamical Systems · Mathematics 2025-01-22 Mickaël D. Chekroun , Jeroen S. W. Lamb , Christian J. Pangerl , Martin Rasmussen

In many modern applications, including analysis of gene expression and text documents, the data are noisy, high-dimensional, and unordered--with no particular meaning to the given order of the variables. Yet, successful learning is often…

Methodology · Statistics 2008-07-25 Ann B. Lee , Boaz Nadler , Larry Wasserman

While adaptive sensing has provided improved rates of convergence in sparse regression and classification, results in nonparametric regression have so far been restricted to quite specific classes of functions. In this paper, we describe an…

Statistics Theory · Mathematics 2015-03-20 Adam D. Bull

We look into the minimax results for the anisotropic two-dimensional functional deconvolution model with the two-parameter fractional Gaussian noise. We derive the lower bounds for the $L^p$-risk, $1 \leq p < \infty$, and taking advantage…

Statistics Theory · Mathematics 2018-12-19 Rida Benhaddou , Qing Liu

In this paper we propose a wavelet-based methodology for estimation and variable selection in partially linear models. The inference is conducted in the wavelet domain, which provides a sparse and localized decomposition appropriate for…

Methodology · Statistics 2016-09-26 Norbert Remenyi

This paper discusses a design-dependent nature of variance in nonparametric link regression aiming at predicting a mean outcome at a link, i.e., a pair of nodes, based on currently observed data comprising covariates at nodes and outcomes…

Statistics Theory · Mathematics 2022-10-14 Akifumi Okuno , Keisuke Yano

We consider the problem of testing for long-range dependence in time-varying coefficient regression models, where the covariates and errors are locally stationary, allowing complex temporal dynamics and heteroscedasticity. We develop KPSS,…

Statistics Theory · Mathematics 2023-03-10 Lujia Bai , Weichi Wu

Response-biased sampling, in which samples are drawn from a popula- tion according to the values of the response variable, is common in biomedical, epidemiological, economic and social studies. In particular, the complete obser- vations in…

Methodology · Statistics 2016-10-31 Kani Chen , Yuanyuan Lin , Yuan Yao , Chaoxu Zhou

We consider the problem of adaptive inference on a regression function at a point under a multivariate nonparametric regression setting. The regression function belongs to a H\"older class and is assumed to be monotone with respect to some…

Statistics Theory · Mathematics 2020-12-01 Koohyun Kwon , Soonwoo Kwon

Let Y be a response variable related with a set of explanatory variables and let f1, f2, ..., fk be a set of the parametric forms representing a set of candidate's model. Let f* be the true model among the set of k plausible models. We…

This paper introduces a data-adaptive non-parametric approach for the estimation of time-varying spectral densities from nonstationary time series. Time-varying spectral densities are commonly estimated by local kernel smoothing. The…

Computation · Statistics 2020-07-21 Anne van Delft , Michael Eichler