English
Related papers

Related papers: Enhancing Time Series Forecasting via Logic-Inspir…

200 papers

While LSTMs show increasingly promising results for forecasting Financial Time Series (FTS), this paper seeks to assess if attention mechanisms can further improve performance. The hypothesis is that attention can help prevent long-term…

Machine Learning · Computer Science 2018-12-20 Thomas Hollis , Antoine Viscardi , Seung Eun Yi

Over the past few decades, the hydrology community has witnessed notable advancements in streamflow prediction, particularly with the introduction of cutting-edge machine-learning algorithms. Recurrent neural networks, especially Long…

Machine Learning · Computer Science 2023-05-23 Sinan Rasiya Koya , Tirthankar Roy

Time series forecasting (TSF) plays a critical role in decision-making for many real-world applications. Recently, LLM-based forecasters have made promising advancements. Despite their effectiveness, existing methods often lack explicit…

Machine Learning · Computer Science 2026-02-04 Xiaoyu Tao , Mingyue Cheng , Ze Guo , Shuo Yu , Yaguo Liu , Qi Liu , Shijin Wang

Time series forecasting (TSF) is a fundamental and widely studied task, spanning methods from classical statistical approaches to modern deep learning and multimodal language modeling. Despite their effectiveness, these methods often follow…

Machine Learning · Computer Science 2025-12-23 Mingyue Cheng , Jiahao Wang , Daoyu Wang , Xiaoyu Tao , Qi Liu , Enhong Chen

Recently, the superiority of Transformer for long-term time series forecasting (LTSF) tasks has been challenged, particularly since recent work has shown that simple models can outperform numerous Transformer-based approaches. This suggests…

Machine Learning · Computer Science 2023-10-10 Shengsheng Lin , Weiwei Lin , Wentai Wu , Songbo Wang , Yongxiang Wang

Accurate household electricity short-term load forecasting (STLF) is key to future and sustainable energy systems. While various studies have analyzed statistical, machine learning, or deep learning approaches for household electricity…

Computational Engineering, Finance, and Science · Computer Science 2026-01-09 Marcel Meyer , David Zapata , Sascha Kaltenpoth , Oliver Müller

Large pre-trained time series foundation models (TSFMs) have demonstrated promising zero-shot performance across a wide range of domains. However, a question remains: Do TSFMs succeed by memorizing patterns in training data, or do they…

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

While large language models have rapidly evolved towards general artificial intelligence, their versatility in analyzing time series data remains limited. To address this limitation, we propose a novel normalization technique that considers…

Machine Learning · Computer Science 2025-02-11 Janghoon Yang

Despite advances in the Transformer architecture, their effectiveness for long-term time series forecasting (LTSF) remains controversial. In this paper, we investigate the potential of integrating explicit periodicity modeling into the…

Machine Learning · Computer Science 2026-03-31 Tian Sun , Yuqi Chen , Weiwei Sun

Large language models (LLMs) have rapidly progressed into general-purpose agents capable of solving a broad spectrum of tasks. However, current models remain inefficient at reasoning: they apply fixed inference-time compute regardless of…

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

Machine Learning · Computer Science 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

Traffic flow forecasting is essential and challenging to intelligent city management and public safety. Recent studies have shown the potential of convolution-free Transformer approach to extract the dynamic dependencies among complex…

Physics and Society · Physics 2021-11-08 Xiao Yan , Xianghua Gan , Jingjing Tang , Rui Wang

Despite the notable advancements in numerous Transformer-based models, the task of long multi-horizon time series forecasting remains a persistent challenge, especially towards explainability. Focusing on commonly used saliency maps in…

Machine Learning · Computer Science 2023-09-18 Nghia Duong-Trung , Duc-Manh Nguyen , Danh Le-Phuoc

In multivariate time series forecasting (MTSF), accurately modeling the intricate dependencies among multiple variables remains a significant challenge due to the inherent limitations of traditional approaches. Most existing models adopt…

Machine Learning · Computer Science 2025-11-19 Yuchen Luo , Xinyu Li , Liuhua Peng , Mingming Gong

High-dimensional time series prediction is needed in applications as diverse as demand forecasting and climatology. Often, such applications require methods that are both highly scalable, and deal with noisy data in terms of corruptions or…

Machine Learning · Computer Science 2016-02-18 Hsiang-Fu Yu , Nikhil Rao , Inderjit S. Dhillon

Multi-task and few-shot time series forecasting tasks are commonly encountered in scenarios such as the launch of new products in different cities. However, traditional time series forecasting methods suffer from insufficient historical…

Machine Learning · Computer Science 2025-06-25 Pengpeng Ouyang , Dong Chen , Tong Yang , Shuo Feng , Zhao Jin , Mingliang Xu

Transformers have shown great power in time series forecasting due to their global-range modeling ability. However, their performance can degenerate terribly on non-stationary real-world data in which the joint distribution changes over…

Machine Learning · Computer Science 2023-11-27 Yong Liu , Haixu Wu , Jianmin Wang , Mingsheng Long

Time Series Forecasting (TSF) is an important application across many fields. There is a debate about whether Transformers, despite being good at understanding long sequences, struggle with preserving temporal relationships in time series…

Machine Learning · Computer Science 2025-10-20 Syed Tahir Hussain Rizvi , Neel Kanwal , Muddasar Naeem

Attention-based architectures have become ubiquitous in time series forecasting tasks, including spatio-temporal (STF) and long-term time series forecasting (LTSF). Yet, our understanding of the reasons for their effectiveness remains…

Machine Learning · Computer Science 2025-05-13 Suhan Guo , Jiahong Deng , Yi Wei , Hui Dou , Furao Shen , Jian Zhao