English
Related papers

Related papers: On Long Memory Origins and Forecast Horizons

200 papers

Data-driven methods are emerging as efficient alternatives to traditional numerical forecasting, offering fast inference and lower computational cost. Yet, for complex systems, long-term accuracy often deteriorates due to error…

Machine Learning · Computer Science 2025-09-03 Hao Zhou , Sibo Cheng

Time-series forecasting models (TSFM) have evolved from classical statistical methods to sophisticated foundation models, yet understanding why and when these models succeed or fail remains challenging. Despite this known limitation, time…

Machine Learning · Computer Science 2025-08-29 Michael Widener , Kausik Lakkaraju , John Aydin , Biplav Srivastava

Large Language Models (LLMs) are increasingly used as autonomous agents in complex, long-horizon applications, where effective memory is critical for sustained performance. Yet existing memory benchmarks are largely dialogue-centric, while…

Accurate mechanisms for forecasting solar irradiance and insolation provide important information for the planning of renewable energy and agriculture projects as well as for environmental and socio-economical studies. This research…

Machine Learning · Computer Science 2021-06-15 Laura S. Hoyos-Gómez , Jose F. Ruiz-Muñoz , Belizza J. Ruiz-Mendoza

In this paper we investigate to what extent long short-term memory neural networks (LSTMs) are suitable for demand forecasting in the e-grocery retail sector. For this purpose, univariate as well as multivariate LSTM-based models were…

Machine Learning · Computer Science 2020-08-20 Marta Gołąbek , Robin Senge , Rainer Neumann

This work presents a Long Short-Term Memory (LSTM) network for forecasting a monthly electricity demand time series with a one-year horizon. The novelty of this work is the use of pattern representation of the seasonal time series as an…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Paweł Pełka , Grzegorz Dudek

In this paper we address the problem of predicting a time series using the ARMA (autoregressive moving average) model, under minimal assumptions on the noise terms. Using regret minimization techniques, we develop effective online learning…

Machine Learning · Computer Science 2013-02-28 Oren Anava , Elad Hazan , Shie Mannor , Ohad Shamir

Time Series Foundation Models (TSFMs) have borrowed the long context paradigm from natural language processing under the premise that feeding more history into the model improves forecast quality. But in stochastic domains, distant history…

Machine Learning · Computer Science 2026-05-12 Rishi Ahuja , Kumar Prateek , Simranjit Singh , Vijay Kumar

Understanding the statistical properties of recurrence intervals of extreme events is crucial to risk assessment and management of complex systems. The probability distributions and correlations of recurrence intervals for many systems have…

Statistical Finance · Quantitative Finance 2012-05-10 Hao Meng , Fei Ren , Gao-Feng Gu , Xiong Xiong , Yong-Jie Zhang , Wei-Xing Zhou , Wei Zhang

Hierarchical time series forecasting plays a crucial role in decision-making in various domains while presenting significant challenges for modelling as they involve multiple levels of aggregation, constraints, and availability of…

Machine Learning · Computer Science 2024-11-12 Zhao Yingjie , Mahdi Abolghasemi

We introduce Galerkin-ARIMA and Galerkin-SARIMA, a projection-based extension of classical ARIMA/SARIMA that replaces rigid linear lag operators with low-dimensional Galerkin basis expansions while preserving the familiar AR-MA…

Machine Learning · Statistics 2026-03-03 Haojie Liu , Zihan Lin

Recent studies have shown that deep learning models such as RNNs and Transformers have brought significant performance gains for long-term forecasting of time series because they effectively utilize historical information. We found,…

Machine Learning · Computer Science 2022-09-19 Tian Zhou , Ziqing Ma , Xue wang , Qingsong Wen , Liang Sun , Tao Yao , Wotao Yin , Rong Jin

Performance forecasting is an age-old problem in economics and finance. Recently, developments in machine learning and neural networks have given rise to non-linear time series models that provide modern and promising alternatives to…

Statistical Finance · Quantitative Finance 2022-01-21 Carmina Fjellström

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in…

Computational Physics · Physics 2019-09-20 Pantelis R. Vlachas , Wonmin Byeon , Zhong Y. Wan , Themistoklis P. Sapsis , Petros Koumoutsakos

Modelling physical data with linear discrete time series, namely Fractionally Integrated Autoregressive Moving Average (ARFIMA), is a technique which achieved attention in recent years. However, these models are used mainly as a statistical…

Data Analysis, Statistics and Probability · Physics 2017-03-20 Jakub Ślęzak , Aleksander Weron

Long-horizon conversational agents require persistent memory for coherent reasoning, yet uncontrolled accumulation causes temporal decay and false memory propagation. Benchmarks such as LOCOMO and LOCCO report performance degradation from…

Artificial Intelligence · Computer Science 2026-04-03 Payal Fofadiya , Sunil Tiwari

There is a lack of research on the analysis of per-user traffic in cellular networks, for deriving and following traffic-aware network management. \textcolor{black}{In fact, the legacy design approach, in which resource provisioning and…

Systems and Control · Electrical Eng. & Systems 2021-11-03 Amin Azari , Fateme Salehi , Panagiotis Papapetrou , Cicek Cavdar

As large scale cloud computing centers become more popular than individual servers, predicting future resource demand need has become an important problem. Forecasting resource need allows public cloud providers to proactively allocate or…

Machine Learning · Computer Science 2020-07-17 Langston Nashold , Rayan Krishnan

In this work we propose a new class of long-memory models with time-varying fractional parameter. In particular, the dynamics of the long-memory coefficient, $d$, is specified through a stochastic recurrence equation driven by the score of…

Methodology · Statistics 2018-12-19 Luisa Bisaglia , Matteo Grigoletto

Many scientific areas, from computer science to the environmental sciences and finance, give rise to multivariate time series which exhibit long memory, or loosely put, a slow decay in their autocorrelation structure. Efficient modelling…

Methodology · Statistics 2025-12-12 Chiara Boetti , Matthew A. Nunes , Marina I. Knight