English
Related papers

Related papers: Nonparametric estimation in functional linear mode…

200 papers

In this article we study the asymptotic behaviour of the least square estimator in a linear regression model based on random observation instances. We provide mild assumptions on the moments and dependence structure on the randomly spaced…

Statistics Theory · Mathematics 2021-10-07 Karine Bertin , Soledad Torres , Lauri Viitasaari

Given a nonconvex function that is an average of $n$ smooth functions, we design stochastic first-order methods to find its approximate stationary points. The convergence of our new methods depends on the smallest (negative) eigenvalue…

Optimization and Control · Mathematics 2018-09-28 Zeyuan Allen-Zhu

We find the local rate of convergence of the least squares estimator (LSE) of a one dimensional convex regression function when (a) a certain number of derivatives vanish at the point of interest, and (b) the true regression function is…

Methodology · Statistics 2016-11-17 Promit Ghosal , Bodhisattva Sen

In the functional linear regression model, many methods have been proposed and studied to estimate the slope function while the functional predictor was observed in the entire domain. However, works on functional linear regression models…

Methodology · Statistics 2021-12-21 Yafei Wang , Tingyu Lai , Bei Jiang , Linglong Kong , Zhongzhan Zhang

We consider estimation of a step function $f$ from noisy observations of a deconvolution $\phi*f$, where $\phi$ is some bounded $L_1$-function. We use a penalized least squares estimator to reconstruct the signal $f$ from the observations,…

Statistics Theory · Mathematics 2008-12-18 Leif Boysen , Axel Munk

Non-parametric inference for functional data over two-dimensional domains entails additional computational and statistical challenges, compared to the one-dimensional case. Separability of the covariance is commonly assumed to address these…

Methodology · Statistics 2021-03-19 Tomas Masak , Tomas Rubin , Victor Panaretos

Under the usual nonparametric regression model with Gaussian errors, Least Squares Estimators (LSEs) over natural subclasses of convex functions are shown to be suboptimal for estimating a $d$-dimensional convex function in squared error…

Statistics Theory · Mathematics 2024-09-05 Gil Kur , Fuchang Gao , Adityanand Guntuboyina , Bodhisattva Sen

The estimation of parameters in a linear model is considered under the hypothesis that the noise, with finite second order statistics, can be represented in a given deterministic basis by random coefficients. An extended underdetermined…

Statistics Theory · Mathematics 2014-05-06 Piero Barone , Isabella Lari

We consider the nonparametric estimation problem of time-dependent multivariate functions observed in a presence of additive cylindrical Gaussian white noise of a small intensity. We derive minimax lower bounds for the $L^2$-risk in the…

Statistics Theory · Mathematics 2012-11-02 Jérémie Bigot , Theofanis Sapatinas

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

We deal with the problem of optimal estimation of the linear functionals constructed from unobserved values of a continuous time stochastic process with periodically correlated increments based on past observations of this process. To solve…

Statistics Theory · Mathematics 2023-04-25 Maksym Luz , Mikhail Moklyachuk

We consider the problem of estimating the region on which a non-parametric regression function is at its baseline level in two dimensions. The baseline level typically corresponds to the minimum/maximum of the function and estimating such…

Methodology · Statistics 2013-12-24 Atul Mallik , Moulinath Banerjee , Michael Woodroofe

We consider nonparametric estimation of the mean and covariance functions for functional/longitudinal data. Strong uniform convergence rates are developed for estimators that are local-linear smoothers. Our results are obtained in a unified…

Statistics Theory · Mathematics 2012-11-12 Yehua Li , Tailen Hsing

The problem of the mean-square optimal linear estimation of functionals which depend on the unknown values of a stationary stochastic sequence from observations of the sequence with noise is considered. In the case of spectral certainty,…

Statistics Theory · Mathematics 2024-06-25 Maksym Luz , Mikhail Moklyachuk

For the Gaussian sequence model, we obtain non-asymptotic minimax rates of estimation of the linear, quadratic and the L2-norm functionals on classes of sparse vectors and construct optimal estimators that attain these rates. The main…

Statistics Theory · Mathematics 2015-02-04 Olivier Collier , Laëtitia Comminges , Alexandre B. Tsybakov

We propose an estimation procedure for linear functionals based on Gaussian model selection techniques. We show that the procedure is adaptive, and we give a non asymptotic oracle inequality for the risk of the selected estimator with…

Statistics Theory · Mathematics 2008-10-27 Béatrice Laurent , Carenne Ludeña , Clémentine Prieur

This paper studies sparse covariance operator estimation for nonstationary processes with sharply varying marginal variance and small correlation lengthscale. We introduce a covariance operator estimator that adaptively thresholds the…

Statistics Theory · Mathematics 2025-06-23 Omar Al-Ghattas , Daniel Sanz-Alonso

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

In this paper, we derive minimax rates for estimating both parametric and nonparametric components in partially linear additive models with high dimensional sparse vectors and smooth functional components. The minimax lower bound for…

Statistics Theory · Mathematics 2018-01-16 Zhuqing Yu , Michael Levine , Guang Cheng

In this work, we study a random orthogonal projection based least squares estimator for the stable solution of a multivariate nonparametric regression (MNPR) problem. More precisely, given an integer $d\geq 1$ corresponding to the dimension…

Statistics Theory · Mathematics 2022-02-04 Asma BenSaber , Sophie Dabo-Niang , Abderrazek Karoui