English
Related papers

Related papers: Linear Prediction of Long-Memory Processes: Asympt…

200 papers

Quantitative T1rho mapping has shown promise in clinical and research studies. However, it suffers from long scan times. Deep learning-based techniques have been successfully applied in accelerated quantitative MR parameter mapping.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Yuanyuan Liu , Jinwen Xie , Zhuo-Xu Cui , Qingyong Zhu , Jing Cheng , Dong Liang , Yanjie Zhu

We consider linear two-time-scale stochastic approximation algorithms driven by martingale noise. Recent applications in machine learning motivate the need to understand finite-time error rates, but conventional stochastic approximation…

Machine Learning · Computer Science 2025-12-12 Seo Taek Kong , Sihan Zeng , Thinh T. Doan , R. Srikant

We propose a generalized functional linear regression model for a regression situation where the response variable is a scalar and the predictor is a random function. A linear predictor is obtained by forming the scalar product of the…

Statistics Theory · Mathematics 2007-06-13 Hans-Georg Muller , Ulrich Stadtmuller

In this paper we introduce randomized pivots for the means of short and long memory linear processes. We show that, under the same conditions, these pivots converge in distribution to the same limit as that of their classical non-randomized…

Statistics Theory · Mathematics 2014-05-14 Miklos Csorgo , Masoud M Nasari , Mohamedou Ould-Haye

In linear models, omitting a covariate that is orthogonal to covariates in the model does not result in biased coefficient estimation. This in general does not hold for longitudinal data, where additional assumptions are needed to get…

Statistics Theory · Mathematics 2023-05-30 Zhuowei Sun , Hongyuan Cao , Li Chen , Jason P. Fine

We analyze linear panel regression models with interactive fixed effects and predetermined regressors, for example lagged-dependent variables. The first-order asymptotic theory of the least squares (LS) estimator of the regression…

Econometrics · Economics 2026-05-04 Hyungsik Roger Moon , Martin Weidner

This paper considers the effect of least squares procedures for nearly unstable linear time series with strongly dependent innovations. Under a general framework and appropriate scaling, it is shown that ordinary least squares procedures…

Statistics Theory · Mathematics 2009-09-29 Boris Buchmann , Ngai Hang Chan

This paper compares Kolmogorov-Arnold Networks (KAN) and Long Short-Term Memory networks (LSTM) for forecasting non-deterministic stock price data, evaluating predictive accuracy versus interpretability trade-offs using Root Mean Square…

Machine Learning · Computer Science 2025-11-25 Tabish Ali Rather , S M Mahmudul Hasan Joy , Nadezda Sukhorukova , Federico Frascoli

Two-time-scale stochastic approximation algorithms are iterative methods used in applications such as optimization, reinforcement learning, and control. Finite-time analysis of these algorithms has primarily focused on fixed point…

Optimization and Control · Mathematics 2026-04-09 Siddharth Chandak

We study the asymptotic behavior of kernel estimators of asymptotic variances (or long-run variances) for a class of adaptive Markov chains. The convergence is studied both in $L^p$ and almost surely. The results also apply to Markov chains…

Probability · Mathematics 2011-05-17 Yves F. Atchadé

The drift sequential parameter estimation problems for the Cox-Ingersoll-Ross (CIR) processes under the limited duration of observation are studied. Truncated sequential estimation methods for both scalar and {two}-dimensional parameter…

Statistics Theory · Mathematics 2025-04-08 Mohamed Ben Alaya , Thi-Bao Trâm Ngô , Serguei Pergamenchtchikov

The goodness of the long-term prediction in the state-space model was evaluated using the squared long-term prediction error. In order to estimate the model parameters suitable for long-term prediction, we devised a modified log-likelihood…

Methodology · Statistics 2022-10-13 Genshiro Kitagawa

This work addresses large dimensional covariance matrix estimation with unknown mean. The empirical covariance estimator fails when dimension and number of samples are proportional and tend to infinity, settings known as Kolmogorov…

Statistics Theory · Mathematics 2025-03-12 Benoit Oriol , Alexandre Miot

At the heart of machine learning lies the question of generalizability of learned rules over previously unseen data. While over-parameterized models based on neural networks are now ubiquitous in machine learning applications, our…

Machine Learning · Computer Science 2020-05-04 Melikasadat Emami , Mojtaba Sahraee-Ardakan , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

We use a theoretical frame-work to analytically assess temporal prediction error functions on von-Karman turbulence when a zonal representation of wave-fronts is assumed. Linear prediction models analysed include auto-regressive of order up…

Instrumentation and Methods for Astrophysics · Physics 2015-06-23 Kate Jackson , Carlos Correia , Olivier Lardiere , Dave Andersen , Colin Bradley

The term ``empirical predictor'' refers to a two-stage predictor of a linear combination of fixed and random effects. In the first stage, a predictor is obtained but it involves unknown parameters; thus, in the second stage, the unknown…

Statistics Theory · Mathematics 2007-06-13 Kalyan Das , Jiming Jiang , J. N. K. Rao

The paper presents transfer functions for limited memory time-invariant linear integral predictors for continuous time processes such that the corresponding predicting kernels have bounded support. It is shown that processes with…

Information Theory · Computer Science 2022-07-07 Nikolai Dokuchaev

Cohort studies of the onset of a disease often encounter left-truncation on the event time of interest in addition to right-censoring due to variable enrollment times of study participants. Analysis of such event time data can be biased if…

Methodology · Statistics 2025-04-11 Spencer Matthews , Bin Nan

Linear regression is a basic and widely-used methodology in data analysis. It is known that some quantum algorithms efficiently perform least squares linear regression of an exponentially large data set. However, if we obtain values of the…

Quantum Physics · Physics 2021-08-27 Kazuya Kaneko , Koichi Miyamoto , Naoyuki Takeda , Kazuyoshi Yoshino

Two-time-scale stochastic approximation, a generalized version of the popular stochastic approximation, has found broad applications in many areas including stochastic control, optimization, and machine learning. Despite its popularity,…

Optimization and Control · Mathematics 2021-03-24 Thinh T. Doan