English
Related papers

Related papers: Conditional least squares estimation in nonstation…

200 papers

In constrained stochastic optimization, one naturally expects that imposing a stricter feasible set does not increase the statistical risk of an estimator defined by projection onto that set. In this paper, we show that this intuition can…

Statistics Theory · Mathematics 2026-01-23 Omar Al-Ghattas

In this paper, we are concerned with the stochastic process \begin{equation} \beta_{n}(q_{t},t)=\beta_{n}(t)=\frac{1}{\sqrt{n}}\sum_{j=1}^{n}\left\{G_{t,n}(Y(t))-G_{t}(Y_{j}(t))\right\} q_{t}(Y_{j}(t)), \tag{A} \end{equation} where for…

Methodology · Statistics 2014-05-23 Gane Samb Lo

We study the problem of parameter estimation for a non-ergodic Gaussian Vasicek-type model defined as $dX_t=(\mu+\theta X_t)dt+dG_t,\ t\geq0$ with unknown parameters $\theta>0$ and $\mu\in\mathbb{R}$, where $G$ is a Gaussian process. We…

Probability · Mathematics 2020-05-12 Khalifa Es-Sebaiy , Mohammed Es. Sebaiy

It is well known that in the presence of heteroscedasticity ordinary least squares estimator is not efficient. I propose a generalized automatic least squares estimator (GALS) that makes partial correction of heteroscedasticity based on a…

Econometrics · Economics 2023-04-18 Bulat Gafarov

The paper concerns the $d$-dimensional stochastic approximation recursion, $$ \theta_{n+1}= \theta_n + \alpha_{n + 1} f(\theta_n, \Phi_{n+1}) $$ where $ \{ \Phi_n \}$ is a stochastic process on a general state space, satisfying a…

Statistics Theory · Mathematics 2024-11-18 Vivek Borkar , Shuhang Chen , Adithya Devraj , Ioannis Kontoyiannis , Sean Meyn

We study the least squares estimator for the drift parameter of the Langevin stochastic equation driven by the Rosenblatt process. Using the techniques of the Malliavin calculus and the stochastic integration with respect to the Rosenblatt…

Probability · Mathematics 2019-03-07 Radomyra Shevchenko , Ciprian A. Tudor

We study the problem of parameter estimation for discretely observed stochastic processes driven by additive small L\'{e}vy noises. We do not impose any moment condition on the driving L\'{e}vy process. Under certain regularity conditions…

Statistics Theory · Mathematics 2012-05-23 Hongwei Long , Yasutaka Shimizu , Wei Sun

Let $\beta>1$ be a real number and $M: \mathbb{R}\to {\rm GL(\CC^d)}$ be a uniformly almost periodic matrix-valued function. We study the asymptotic behavior of the product $$ P_n(x) =M(\beta^{n-1}x)... M(\beta x) M(x). $$ Under some…

Dynamical Systems · Mathematics 2007-05-23 Ai-Hua Fan , Benoit Saussol , Joerg Schmeling

We study the problem of parameter estimation for discretely observed stochastic differential equations driven by small fractional noise. Under some conditions, we obtain strong consistency and rate of convergence of the least square…

Statistics Theory · Mathematics 2022-01-24 S. Nakajima , S. Nakamura , Y. Shimizu

This paper considers the effect of least squares procedures for nearly unstable linear time series with strongly dependent innovations. Under a general framework and appropriate scaling, it is shown that ordinary least squares procedures…

Statistics Theory · Mathematics 2009-09-29 Boris Buchmann , Ngai Hang Chan

We consider a nonparametric model $\mathcal{E}^{n},$ generated by independent observations $X_{i},$ $i=1,...,n,$ with densities $p(x,\theta_{i}),$ $i=1,...,n,$ the parameters of which $\theta _{i}=f(i/n)\in \Theta $ are driven by the values…

Statistics Theory · Mathematics 2024-12-20 Ion Grama , Michael Nussbaum

Consider discrete time observations (X_{\ell\delta})_{1\leq \ell \leq n+1}$ of the process $X$ satisfying $dX_t= \sqrt{V_t} dB_t$, with $V_t$ a one-dimensional positive diffusion process independent of the Brownian motion $B$. For both the…

Methodology · Statistics 2007-12-25 Fabienne Comte , Valentine Genon-Catalot , Yves Rozenholc

We consider the regression model with errors-in-variables where we observe $n$ i.i.d. copies of $(Y,Z)$ satisfying $Y=f(X)+\xi, Z=X+\sigma\epsilon$, involving independent and unobserved random variables $X,\xi,\epsilon$. The density $g$ of…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Marie-Luce Taupin

In this paper, we study non-asymptotic deviation bounds of the least squares estimator in Gaussian AR($n$) processes. By relying on martingale concentration inequalities and a tail-bound for $\chi^2$ distributed variables, we provide a…

Machine Learning · Statistics 2020-05-26 Rodrigo A. González , Cristian R. Rojas

A novel estimation approach for a general class of semi-parametric multivariate time series models is introduced where the conditional mean is modeled through parametric functions. The focus of the estimation is the conditional mean…

Methodology · Statistics 2025-07-21 Mirko Armillotta

Parameters defined via General Estimating Equations (GEE) can be estimated by maximizing the Empirical Likelihood (EL). Newey and Smith (2004) have recently shown that this EL estimator exhibits desirable higher-order asymptotic properties,…

Statistics Theory · Mathematics 2013-07-18 Susanne M. Schennach

We study the asymptotic behavior of the smallest eigenvalue, $\lambda_{N}$, of the Hankel (or moments) matrix denoted by $\mathcal{H}_{N}=\left(\mu_{m+n}\right)_{0\leq m,n\leq N}$, with respect to the weight $w(x)=x^{\alpha}{\rm…

Mathematical Physics · Physics 2019-05-22 Mengkun Zhu , Niall Emmart , Yang Chen , Charles Weems

This work analyzes the stochastic approximation algorithm with non-decaying gains as applied in time-varying problems. The setting is to minimize a sequence of scalar-valued loss functions $f_k(\cdot)$ at sampling times $\tau_k$ or to…

Optimization and Control · Mathematics 2020-03-18 Jingyi Zhu

We derive the non-equilibrium fluctuations of one-dimensional symmetric simple exclusion processes in contact with slowed stochastic reservoirs which are regulated by a factor $n^{-\theta}$. Depending on the range of $\theta$ we obtain…

Probability · Mathematics 2018-10-12 Patrícia Gonçalves , Milton Jara , Otávio Menezes , Adriana Neumann

We present large sample results for partitioning-based least squares nonparametric regression, a popular method for approximating conditional expectation functions in statistics, econometrics, and machine learning. First, we obtain a…

Statistics Theory · Mathematics 2020-07-20 Matias D. Cattaneo , Max H. Farrell , Yingjie Feng