English
Related papers

Related papers: Revisiting Long-term Time Series Forecasting: An I…

200 papers

Transformer models have consistently achieved remarkable results in various domains such as natural language processing and computer vision. However, despite ongoing research efforts to better understand these models, the field still lacks…

Machine Learning · Computer Science 2024-10-18 Ilya Kaufman , Omri Azencot

Time series analysis plays a vital role in various applications, for instance, healthcare, weather prediction, disaster forecast, etc. However, to obtain sufficient shapelets by a feature network is still challenging. To this end, we…

Machine Learning · Computer Science 2021-01-01 Zhiwen Xiao , Xin Xu , Huanlai Xing , Juan Chen

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

The integration of Fourier transform and deep learning opens new avenues for time series forecasting. We reconsider the Fourier transform from a basis functions perspective. Specifically, the real and imaginary parts of the frequency…

Machine Learning · Computer Science 2025-08-05 Runze Yang , Longbing Cao , Xin You , Kun Fang , Jianxun Li , Jie Yang

TSF is growing in various domains including manufacturing. Although numerous TSF algorithms have been developed recently, the validation and evaluation of algorithms hold substantial value for researchers and practitioners and are missing.…

Machine Learning · Computer Science 2026-04-02 Mojtaba A. Farahani , Fadi El Kalach , Austin Harper , M. R. McCormick , Ramy Harik , Thorsten Wuest

Machine learning for early syndrome diagnosis aims to solve the intricate task of predicting a ground truth label that most often is the outcome (effect) of a medical consensus definition applied to observed clinical measurements (causes),…

Machine Learning · Computer Science 2024-08-27 Michael Staniek , Marius Fracarolli , Michael Hagmann , Stefan Riezler

Financial time series forecasting is particularly challenging for transformer-based time series foundation models (TSFMs) due to non-stationarity, heavy-tailed distributions, and high-frequency noise present in data. Low-rank adaptation…

Machine Learning · Computer Science 2026-02-02 Anthony Bolton , Wuyang Zhou , Zehua Chen , Giorgos Iacovides , Danilo Mandic

While machine learning has witnessed significant advancements, the emphasis has largely been on data acquisition and model creation. However, achieving a comprehensive assessment of machine learning solutions in real-world settings…

Multivariate time series (MTS) forecasting is vital in fields like weather, energy, and finance. However, despite deep learning advancements, traditional Transformer-based models often diminish the effect of crucial inter-variable…

Machine Learning · Computer Science 2025-03-03 Yanhong Li , David C. Anastasiu

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of applying stacked LSTM…

Machine Learning · Computer Science 2020-11-03 Frank Xiao

Recent advances in deep learning have significantly elevated weather prediction models. However, these models often falter in real-world scenarios due to their sensitivity to spatial-temporal shifts. This issue is particularly acute in…

Machine Learning · Computer Science 2023-12-04 Lu Han , Xu-Yang Chen , Han-Jia Ye , De-Chuan Zhan

Time series forecasting is a critical task that provides key information for decision-making. After traditional statistical and machine learning approaches, various fundamental deep learning architectures such as MLPs, CNNs, RNNs, and GNNs…

Machine Learning · Computer Science 2025-05-02 Jongseon Kim , Hyungjoon Kim , HyunGi Kim , Dongjun Lee , Sungroh Yoon

The diversity of time series applications and scarcity of domain-specific data highlight the need for time-series models with strong few-shot learning capabilities. In this work, we propose a novel training scheme and a transformer-based…

Machine Learning · Computer Science 2025-02-25 Ege Onur Taga , M. Emrullah Ildiz , Samet Oymak

Time series data appears in a variety of applications such as smart transportation and environmental monitoring. One of the fundamental problems for time series analysis is time series forecasting. Despite the success of recent deep time…

Artificial Intelligence · Computer Science 2022-09-28 Baoyu Jing , Si Zhang , Yada Zhu , Bin Peng , Kaiyu Guan , Andrew Margenot , Hanghang Tong

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

Machine Learning · Computer Science 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

Recently, frequency transformation (FT) has been increasingly incorporated into deep learning models to significantly enhance state-of-the-art accuracy and efficiency in time series analysis. The advantages of FT, such as high efficiency…

Machine Learning · Computer Science 2025-06-16 Kun Yi , Qi Zhang , Wei Fan , Longbing Cao , Shoujin Wang , Guodong Long , Liang Hu , Hui He , Qingsong Wen , Hui Xiong

The performance of time series forecasting has recently been greatly improved by the introduction of transformers. In this paper, we propose a general multi-scale framework that can be applied to the state-of-the-art transformer-based time…

Machine Learning · Computer Science 2023-02-08 Amin Shabani , Amir Abdi , Lili Meng , Tristan Sylvain

Multivariate Time series forecasting is crucial in domains such as transportation, meteorology, and finance, especially for predicting extreme weather events. State-of-the-art methods predominantly rely on Transformer architectures, which…

Machine Learning · Computer Science 2024-10-16 Li Wu , Wenbin Pei , Jiulong Jiao , Qiang Zhang

In Long-term Time Series Forecasting (LTSF), the lookback window is a critical hyperparameter often set arbitrarily, undermining the validity of model evaluations. We argue that the lookback window must be tuned on a per-task basis to…

Time series forecasting (TSF) has been a challenging research area, and various models have been developed to address this task. However, almost all these models are trained with numerical time series data, which is not as effectively…

Machine Learning · Computer Science 2023-03-01 Luoxiao Yang , Xinqi Fan , Zijun Zhang