English
Related papers

Related papers: AverageTime: Enhance Long-Term Time Series Forecas…

200 papers

Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent…

Machine Learning · Computer Science 2022-10-24 Kiran Madhusudhanan , Johannes Burchert , Nghia Duong-Trung , Stefan Born , Lars Schmidt-Thieme

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

Machine Learning · Computer Science 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

In machine learning, effective modeling requires a holistic consideration of how to encode inputs, make predictions (i.e., decoding), and train the model. However, in time-series forecasting, prior work has predominantly focused on encoder…

Machine Learning · Computer Science 2025-12-30 Jaebin Lee , Hankook Lee

Transformer-based models have recently become dominant in Long-term Time Series Forecasting (LTSF), yet the variations in their architecture, such as encoder-only, encoder-decoder, and decoder-only designs, raise a crucial question: What…

Machine Learning · Computer Science 2025-07-18 Lefei Shen , Mouxiang Chen , Han Fu , Xiaoxue Ren , Xiaoyun Joy Wang , Jianling Sun , Zhuo Li , Chenghao Liu

Transformers for time series forecasting mainly model time series from limited or fixed scales, making it challenging to capture different characteristics spanning various scales. We propose Pathformer, a multi-scale Transformer with…

Machine Learning · Computer Science 2024-09-17 Peng Chen , Yingying Zhang , Yunyao Cheng , Yang Shu , Yihang Wang , Qingsong Wen , Bin Yang , Chenjuan Guo

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

Machine Learning · Computer Science 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

Long-term weather forecasting is critical for socioeconomic planning and disaster preparedness. While recent approaches employ finetuning to extend prediction horizons, they remain constrained by the issues of catastrophic forgetting, error…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hao Chen , Tao Han , Jie Zhang , Song Guo , Fenghua Ling , Lei Bai

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful approach, but their…

Machine Learning · Computer Science 2026-03-26 Aymane Harkati , Moncef Garouani , Olivier Teste , Julien Aligon , Mohamed Hamlich

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT)…

Machine Learning · Computer Science 2025-11-26 Bowen Zhao , Huanlai Xing , Zhiwen Xiao , Jincheng Peng , Li Feng , Xinhan Wang , Rong Qu , Hui Li

Time-series forecasting plays an important role in many real-world scenarios, such as equipment life cycle forecasting, weather forecasting, and traffic flow forecasting. It can be observed from recent research that a variety of…

Machine Learning · Computer Science 2022-06-14 Benhan Li , Shengdong Du , Tianrui Li , Jie Hu , Zhen Jia

We propose an efficient design of Transformer-based models for multivariate time series forecasting and self-supervised representation learning. It is based on two key components: (i) segmentation of time series into subseries-level patches…

Machine Learning · Computer Science 2023-03-07 Yuqi Nie , Nam H. Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

Multivariate time-series forecasting holds immense value across diverse applications, requiring methods to effectively capture complex temporal and inter-variable dynamics. A key challenge lies in uncovering the intrinsic patterns that…

Machine Learning · Computer Science 2025-03-12 Liang Yu , Lai Tu , Xiang Bai

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

Applications · Statistics 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

A variety of real-world applications rely on far future information to make decisions, thus calling for efficient and accurate long sequence multivariate time series forecasting. While recent attention-based forecasting models show strong…

Machine Learning · Computer Science 2022-05-02 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang , Tung Kieu , Xuanyi Dong , Shirui Pan

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

Anomaly detection in multivariate time series is an important problem across various fields such as healthcare, financial services, manufacturing or physics detector monitoring. Accurately identifying when unexpected errors or faults occur…

Machine Learning · Computer Science 2025-06-26 Laura Boggia , Rafael Teixeira de Lima , Bogdan Malaescu

Time series forecasting holds significant importance across various industries, including finance, transportation, energy, healthcare, and climate. Despite the widespread use of linear networks due to their low computational cost and…

Machine Learning · Computer Science 2025-05-02 Chengsen Wang , Qi Qi , Jingyu Wang , Haifeng Sun , Zirui Zhuang , Jianxin Liao

Time Series forecasting (univariate and multivariate) is a problem of high complexity due the different patterns that have to be detected in the input, ranging from high to low frequencies ones. In this paper we propose a new model for…

Machine Learning · Computer Science 2019-03-07 Matteo Maggiolo , Gerasimos Spanakis

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

Multivariate time-series analysis involves extracting informative representations from sequences of multiple interdependent variables, supporting tasks such as forecasting, imputation, and anomaly detection. In real-world scenarios, these…

Machine Learning · Computer Science 2026-05-19 Israel Zexer , Omri Azencot