English
Related papers

Related papers: Rate-Optimal Non-Asymptotics for the Quadratic Pre…

200 papers

An adaptive nonparametric estimation procedure is constructed for heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (oracle inequality) is obtained

Statistics Theory · Mathematics 2010-02-09 Leonid Galtchouk , Serguei Pergamenchtchikov

Time series prediction covers a vast field of every-day statistical applications in medical, environmental and economic domains. In this paper we develop nonparametric prediction strategies based on the combination of a set of 'experts' and…

Methodology · Statistics 2008-01-03 Gérard Biau , Kevin Bleakley , László Györfi , György Ottucsák

Linear time series modelling is dominated by the use of purely autoregressive models even though incorporating moving average components can greatly improve parsimony. We present a convex formulation for vector-ARMA system identification…

Systems and Control · Electrical Eng. & Systems 2022-12-01 Alex Nguyen-Le , Victor M. Preciado

Transfer learning for nonparametric regression is considered. We first study the non-asymptotic minimax risk for this problem and develop a novel estimator called the confidence thresholding estimator, which is shown to achieve the minimax…

Machine Learning · Statistics 2024-01-24 T. Tony Cai , Hongming Pu

We study the asymptotic behavior of the least squares estimators of the unknown parameters of bifurcating autoregressive processes. Under very weak assumptions on the driven noise of the process, namely conditional pair-wise independence…

Probability · Mathematics 2009-06-29 Bernard Bercu , Benoite de Saporta , Anne Gegout-Petit

The problem of estimating a linear functional based on observational data is canonical in both the causal inference and bandit literatures. We analyze a broad class of two-stage procedures that first estimate the treatment effect function,…

Statistics Theory · Mathematics 2022-09-28 Wenlong Mou , Martin J. Wainwright , Peter L. Bartlett

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

In this paper, we consider a functional linear regression model, where both the covariate and the response variable are functional random variables. We address the problem of optimal nonparametric estimation of the conditional expectation…

Statistics Theory · Mathematics 2022-03-02 Gaëlle Chagny , Anouar Meynaoui , Angelina Roche

We propose a panel ARMA-GARCH model to capture the dynamics of large panel data with $N$ individuals over $T$ time periods. For this model, we provide a two-step estimation procedure to estimate the ARMA parameters and GARCH parameters…

Methodology · Statistics 2024-04-30 Bing Su , Ke Zhu

Stochastic approximation (SA) is a key method used in statistical learning. Recently, its non-asymptotic convergence analysis has been considered in many papers. However, most of the prior analyses are made under restrictive assumptions…

Machine Learning · Statistics 2019-06-18 Belhal Karimi , Blazej Miasojedow , Eric Moulines , Hoi-To Wai

Misspecified models often provide useful information about the true data generating distribution. For example, if $y$ is a non-linear function of $x$ the least squares estimator $\hat{\beta}$ is an estimate of $\beta$, the slope of the best…

Methodology · Statistics 2017-05-17 James P. Long

Time Optimal Path Parametrization is the problem of minimizing the time interval during which an actuation constrained agent can traverse a given path. Recently, an efficient linear-time algorithm for solving this problem was proposed.…

Robotics · Computer Science 2019-06-24 Igor Spasojevic , Varun Murali , Sertac Karaman

An adaptive nonparametric estimation procedure is constructed for the estimation problem of heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (an oracle…

Statistics Theory · Mathematics 2008-12-18 Leonid Galtchouk , Serguey Pergamenshchikov

Data-driven methods for modeling dynamic systems have received considerable attention as they provide a mechanism for control synthesis directly from the observed time-series data. In the absence of prior assumptions on how the time-series…

Optimization and Control · Mathematics 2018-09-24 Atiye Alaeddini , Siavash Alemzadeh , Afshin Mesbahi , Mehran Mesbahi

With regard to a three-step estimation procedure, proposed without theoretical discussion by Li and You in Journal of Applied Statistics and Management, for a nonparametric regression model with time-varying regression function, local…

Statistics Theory · Mathematics 2020-10-27 Jiyanglin Li , Tao Li

We provide another look at the statistical calibration problem in computer models. This viewpoint is inspired by two overarching practical considerations of computer models: (i) many computer models are inadequate for perfectly modeling…

Methodology · Statistics 2018-09-26 Xiaowu Dai , Peter Chien

We express the classic ARMA time-series model as a directed graphical model. In doing so, we find that the deterministic relationships in the model make it effectively impossible to use the EM algorithm for learning model parameters. To…

Applications · Statistics 2012-08-10 Bo Thiesson , David Maxwell Chickering , David Heckerman , Christopher Meek

In this paper we derive the asymptotic properties of the least squares estimator (LSE) of fractionally integrated autoregressive moving-average (FARIMA) models under the assumption that the errors are uncorrelated but not necessarily…

Applications · Statistics 2021-03-19 Yacouba Boubacar Maïnassara , Youssef Esstafa , Bruno Saussereau

We consider non parametric estimation problem for stochastic tomography regression model, i.e. we consider the estimation problem of function of multivariate variables (image) observed through its Radon transformation calculated with the…

Statistics Theory · Mathematics 2018-11-22 Dominique Fourdrinier , Sergey Pergamenshchikov

In this article we study the asymptotic predictive optimality of a model selection criterion based on the cross-validatory predictive density, already available in the literature. For a dependent variable and associated explanatory…

Statistics Theory · Mathematics 2008-12-18 Arijit Chakrabarti , Tapas Samanta