English
Related papers

Related papers: Conditional least squares estimation in nonstation…

200 papers

In a decision-theoretic framework, the minimax lower bound provides the worst-case performance of estimators relative to a given class of statistical models. For parametric and semiparametric models, the H\'{a}jek--Le Cam local asymptotic…

Statistics Theory · Mathematics 2024-10-22 Kenta Takatsu , Arun Kumar Kuchibhotla

We compute precise asymptotic expressions for the learning curves of least squares random feature (RF) models with either a separable strongly convex regularization or the $\ell_1$ regularization. We propose a novel multi-level application…

Machine Learning · Statistics 2023-03-02 David Bosch , Ashkan Panahi , Ayca Özcelikkale , Devdatt Dubhash

Spatial Gaussian process regression models typically contain finite dimensional covariance parameters that need to be estimated from the data. We study the Bayesian estimation of covariance parameters including the nugget parameter in a…

Statistics Theory · Mathematics 2023-02-22 Cheng Li , Saifei Sun , Yichen Zhu

Approximations to the modified signed likelihood ratio statistic are asymptotically standard normal with error of order $n^{-1}$, where $n$ is the sample size. Proofs of this fact generally require that the sufficient statistic of the model…

Statistics Theory · Mathematics 2007-12-18 Heping He , Thomas A. Severini

Newton-step approximations to pseudo maximum likelihood estimates of spatial autoregressive models with a large number of parameters are examined, in the sense that the parameter space grows slowly as a function of sample size. These have…

Econometrics · Economics 2021-05-25 Abhimanyu Gupta

Under distribution uncertainty, on the basis of discrete data we investigate the consistency of the least squares estimator (LSE) of the parameter for the stochastic differential equation (SDE) where the noise are characterized by…

Statistics Theory · Mathematics 2019-04-30 Chen Fei , Weiyin Fei

Stochastic approximation (SA) is a powerful and scalable computational method for iteratively estimating the solution of optimization problems in the presence of randomness, particularly well-suited for large-scale and streaming data…

Statistics Theory · Mathematics 2023-10-03 Meimei Liu , Zuofeng Shang , Yun Yang

This paper deals with the estimation of hidden periodicities in a non-linear regression model with stationary noise displaying cyclical dependence. Consistency and asymptotic normality are established for the least-squares estimates.

Statistics Theory · Mathematics 2013-06-25 A. V. Ivanov , N. N. Leonenko , M. D. Ruiz-Medina , B. M. Zhurakovsky

We consider a resampling scheme for parameters estimates in nonlinear regression models. We provide an estimation procedure which recycles, via random weighting, the relevant parameters estimates to construct consistent estimates of the…

Methodology · Statistics 2018-12-18 Ben Boukai , Yue Zhang

We consider a high-probability non-asymptotic confidence estimation in the $\ell^2$-regularized non-linear least-squares setting with fixed design. In particular, we study confidence estimation for local minimizers of the regularized…

Machine Learning · Computer Science 2025-06-12 Ilja Kuzborskij , Yasin Abbasi Yadkori

We study asymptotic properties of maximum likelihood estimators for Heston models based on continuous time observations of the log-price process. We distinguish three cases: subcritical (also called ergodic), critical and supercritical. In…

Statistics Theory · Mathematics 2016-07-25 Matyas Barczy , Gyula Pap

The aim of this paper is to establish non-asymptotic minimax rates of testing for goodness-of-fit hypotheses in a heteroscedastic setting. More precisely, we deal with sequences $(Y_j)_{j\in J}$ of independent Gaussian random variables,…

Statistics Theory · Mathematics 2010-02-09 Béatrice Laurent , Jean-Michel Loubès , Clément Marteau

We study the estimation of $\beta$ for the nonlinear model $y = f(X\sp{\top}\beta) + \epsilon$ when $f$ is a nonlinear transformation that is known, $\beta$ has sparse nonzero coordinates, and the number of observations can be much smaller…

Statistics Theory · Mathematics 2009-10-15 Zhiyi Chi

We prove conditional asymptotic normality of a class of quadratic U-statistics that are dominated by their degenerate second order part and have kernels that change with the number of observations. These statistics arise in the construction…

Methodology · Statistics 2015-12-09 James Robins , Lingling Li , Eric Tchetgen Tchetgen , Aad van der Vaart

Functional data present as functions or curves possessing a spatial or temporal component. These components by nature have a fixed observational domain. Consequently, any asymptotic investigation requires modelling the increased correlation…

Methodology · Statistics 2024-03-11 Cory W. Natoli , Edward D. White , Beau A. Nunnally , Alex J. Gutman , Raymond R. Hill

We prove the asymptotic mixed normality of the least absolute deviation (LAD) estimator for a locally $\alpha$-stable stochastic differential equation (SDE) observed at high frequency, where $\alpha\in(0,2)$. We investigate both ergodic and…

Statistics Theory · Mathematics 2026-03-31 Oleksii M. Kulyk , Hiroki Masuda

We study local asymptotic properties of likelihood ratios of certain Heston models. We distinguish three cases: subcritical, critical and supercritical models. For the drift parameters, local asymptotic normality is proved in the…

Statistics Theory · Mathematics 2019-10-17 János Marcell Benke , Gyula Pap

Suppose the nonparametric regression function of a response variable $Y$ on covariates $X$ and $Z$ is an affine function of $X$ such that the slope $\beta$ and the intercept $\alpha$ are real valued measurable functions on the range of the…

Statistics Theory · Mathematics 2017-12-19 Rajeshwari Majumdar

We investigate the theoretical performances of the Partial Least Square (PLS) algorithm in a high dimensional context. We provide upper bounds on the risk in prediction for the statistical linear model when considering the PLS estimator.…

Statistics Theory · Mathematics 2024-10-15 Luca Castelli , Irène Gannaz , Clément Marteau

We find the asymptotics of the series $\sum_{n=1}^\infty (-1)^n n^{-1} \exp(-t/n)$ as $t\to+\infty$. The answer is an oscillating function of $t$ dominated by $\exp(-(2\pi t)^{1/2})$. The intermediate step is to find the asymptotics of the…

Classical Analysis and ODEs · Mathematics 2015-08-31 Sergey Sadov