English
Related papers

Related papers: Linear Prediction of Long-Range Dependent Time Ser…

200 papers

We propose a new prediction method for multivariate linear regression problems where the number of features is less than the sample size but the number of outcomes is extremely large. Many popular procedures, such as penalized regression…

Methodology · Statistics 2021-04-20 Yihe Wang , Sihai Dave Zhao

Many scientific areas, from computer science to the environmental sciences and finance, give rise to multivariate time series which exhibit long memory, or loosely put, a slow decay in their autocorrelation structure. Efficient modelling…

Methodology · Statistics 2025-12-12 Chiara Boetti , Matthew A. Nunes , Marina I. Knight

Traditional neural networks struggle to capture the spectral structure of complex signals. Fourier neural networks (FNNs) attempt to address this by embedding Fourier series components, yet many real-world signals are almost-periodic with…

Machine Learning · Computer Science 2026-04-13 Chen Zeng , Tiehang Xu , Qiao Wang

Recent research has challenged the necessity of complex deep learning architectures for time series forecasting, demonstrating that simple linear models can often outperform sophisticated approaches. Building upon this insight, we introduce…

Machine Learning · Computer Science 2024-10-30 Remi Genet , Hugo Inzirillo

Short fixed-length inputs are the main bottleneck of deep learning methods in long time-series forecasting tasks. Prolonging input length causes overfitting, rapidly deteriorating accuracy. Our research indicates that the overfitting is a…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu

Temporal difference learning (TD) is a simple iterative algorithm used to estimate the value function corresponding to a given policy in a Markov decision process. Although TD is one of the most widely used algorithms in reinforcement…

Machine Learning · Computer Science 2018-11-07 Jalaj Bhandari , Daniel Russo , Raghav Singal

In this paper, we present a theoretical analysis of the model reduction algorithm for linear switched systems. This algorithm is a reminiscence of the balanced truncation method for linear parameter varying systems. Specifically in this…

Optimization and Control · Mathematics 2013-03-19 Mihaly Petreczky , Rafael Wisniewski , John Leth

The goodness of the long-term prediction in the state-space model was evaluated using the squared long-term prediction error. In order to estimate the model parameters suitable for long-term prediction, we devised a modified log-likelihood…

Methodology · Statistics 2022-10-13 Genshiro Kitagawa

Cohort studies of the onset of a disease often encounter left-truncation on the event time of interest in addition to right-censoring due to variable enrollment times of study participants. Analysis of such event time data can be biased if…

Methodology · Statistics 2025-04-11 Spencer Matthews , Bin Nan

We present a conformal prediction method for time series using the Transformer architecture to capture long-memory and long-range dependencies. Specifically, we use the Transformer decoder as a conditional quantile estimator to predict the…

Machine Learning · Computer Science 2024-06-11 Junghwan Lee , Chen Xu , Yao Xie

We consider the estimation of large covariance and precision matrices from high-dimensional sub-Gaussian or heavier-tailed observations with slowly decaying temporal dependence. The temporal dependence is allowed to be long-range so with…

Statistics Theory · Mathematics 2019-12-23 Hai Shu , Bin Nan

We consider estimation of high-dimensional long-run covariance matrices for time series with nonconstant means, a setting in which conventional estimators can be severely biased. To address this difficulty, we propose a difference-based…

Methodology · Statistics 2026-03-19 Yanhong Liu , Fengyi Song , Long Feng

We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. The standard…

Statistics Theory · Mathematics 2009-06-18 Vladimir Vovk , Ilia Nouretdinov , Alex Gammerman

This work aims at estimating inverse autocovariance matrices of long memory processes admitting a linear representation. A modified Cholesky decomposition is used in conjunction with an increasing order autoregressive model to achieve this…

Statistics Theory · Mathematics 2016-03-18 Ching-Kang Ing , Hai-Tang Chiou , Meihui Guo

A variety of real-world applications rely on far future information to make decisions, thus calling for efficient and accurate long sequence multivariate time series forecasting. While recent attention-based forecasting models show strong…

Machine Learning · Computer Science 2022-05-02 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang , Tung Kieu , Xuanyi Dong , Shirui Pan

We consider the problem of learning models for forecasting multiple time-series systems together with discovering the leading indicators that serve as good predictors for the system. We model the systems by linear vector autoregressive…

Machine Learning · Computer Science 2016-11-03 Magda Gregorova , Alexandros Kalousis , Stéphane Marchand-Maillet

Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide…

Machine Learning · Computer Science 2024-06-05 Kunpeng Xu , Lifei Chen , Shengrui Wang

Advection-dominated dynamical systems, characterized by partial differential equations, are found in applications ranging from weather forecasting to engineering design where accuracy and robustness are crucial. There has been significant…

Computational Physics · Physics 2020-06-29 Romit Maulik , Bethany Lusch , Prasanna Balaprakash

Time series models aim for accurate predictions of the future given the past, where the forecasts are used for important downstream tasks like business decision making. In practice, deep learning based time series models come in many forms,…

Machine Learning · Computer Science 2022-06-01 Kashif Rasul , Young-Jin Park , Max Nihlén Ramström , Kyung-Min Kim

Existing sequence prediction methods are mostly concerned with time-independent sequences, in which the actual time span between events is irrelevant and the distance between events is simply the difference between their order positions in…

Machine Learning · Computer Science 2018-07-23 Yang Li , Nan Du , Samy Bengio