English
Related papers

Related papers: MTS-Mixers: Multivariate Time Series Forecasting v…

200 papers

Forecasting the behaviour of complex dynamical systems such as interconnected sensor networks characterized by high-dimensional multivariate time series(MTS) is of paramount importance for making informed decisions and planning for the…

Machine Learning · Computer Science 2024-08-23 Sagar Srinivas Sakhinana , Shivam Gupta , Krishna Sai Sudhir Aripirala , Venkataramana Runkana

Using images acquired by different satellite sensors has shown to improve classification performance in the framework of crop mapping from satellite image time series (SITS). Existing state-of-the-art architectures use self-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Theresa Follath , David Mickisch , Jan Hemmerling , Stefan Erasmi , Marcel Schwieder , Begüm Demir

Time series forecasting (TSF) is crucial in fields like economic forecasting, weather prediction, traffic flow analysis, and public health surveillance. Real-world time series data often include noise, outliers, and missing values, making…

Machine Learning · Computer Science 2024-07-09 Quangao Liu , Ruiqi Li , Maowei Jiang , Wei Yang , Chen Liang , LongLong Pang , Zhuozhang Zou

Time series prediction is crucial for understanding and forecasting complex dynamics in various domains, ranging from finance and economics to climate and healthcare. Based on Transformer architecture, one approach involves encoding…

Machine Learning · Computer Science 2024-05-24 Xin Cheng , Xiuying Chen , Shuqi Li , Di Luo , Xun Wang , Dongyan Zhao , Rui Yan

Transformer-based architectures achieved high performance in natural language processing and computer vision, yet many studies have shown that they have not demonstrated a clear advantage in time series forecasting and even underperform…

Machine Learning · Computer Science 2025-09-26 Zida Liang , Jiayi Zhu , Weiqiang Sun

Recently, Transformer-based models for long sequence time series forecasting have demonstrated promising results. The self-attention mechanism as the core component of these Transformer-based models exhibits great potential in capturing…

Machine Learning · Computer Science 2024-12-17 Zhicheng Zhang , Yong Wang , Shaoqi Tan , Bowei Xia , Yujie Luo

Multivariate time series (MTS) forecasting plays an important role in the automation and optimization of intelligent applications. It is a challenging task, as we need to consider both complex intra-variable dependencies and inter-variable…

Machine Learning · Computer Science 2023-04-11 Ling Chen , Donghui Chen , Zongjiang Shang , Binqing Wu , Cen Zheng , Bo Wen , Wei Zhang

Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between…

Machine Learning · Computer Science 2019-09-20 Shun-Yao Shih , Fan-Keng Sun , Hung-yi Lee

Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers,…

Machine Learning · Computer Science 2024-01-05 Xiang Ma , Xuemei Li , Lexin Fang , Tianlong Zhao , Caiming Zhang

Most current multivariate time series (MTS) classification algorithms focus on improving the predictive accuracy. However, for large-scale (either high-dimensional or long-sequential) time series (TS) datasets, there is an additional…

Machine Learning · Computer Science 2022-03-29 Yuqing Wang , Yun Zhao , Linda Petzold

Multivariate time series long-term prediction, which aims to predict the change of data in a long time, can provide references for decision-making. Although transformer-based models have made progress in this field, they usually do not make…

Machine Learning · Computer Science 2023-08-08 Chengqing Yu , Fei Wang , Zezhi Shao , Tao Sun , Lin Wu , Yongjun Xu

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

A variety of real-world applications rely on far future information to make decisions, thus calling for efficient and accurate long sequence multivariate time series forecasting. While recent attention-based forecasting models show strong…

Machine Learning · Computer Science 2022-05-02 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang , Tung Kieu , Xuanyi Dong , Shirui Pan

Time series forecasting presents a significant challenge, particularly when its accuracy relies on external data sources rather than solely on historical values. This issue is prevalent in the financial sector, where the future behavior of…

Machine Learning · Computer Science 2024-03-22 Hajar Emami , Xuan-Hong Dang , Yousaf Shah , Petros Zerfos

Recent advancements in multivariate time series forecasting have been propelled by Linear-based, Transformer-based, and Convolution-based models, with Transformer-based architectures gaining prominence for their efficacy in temporal and…

Machine Learning · Computer Science 2024-09-27 Chaolv Zeng , Zhanyu Liu , Guanjie Zheng , Linghe Kong

Accurately predicting the behavior of complex dynamical systems, characterized by high-dimensional multivariate time series(MTS) in interconnected sensor networks, is crucial for informed decision-making in various applications to minimize…

Machine Learning · Computer Science 2024-08-23 Sagar Srinivas Sakhinana , Krishna Sai Sudhir Aripirala , Shivam Gupta , Venkataramana Runkana

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2)…

Artificial Intelligence · Computer Science 2024-05-13 Jianli Xiao , Baichao Long

While LSTMs show increasingly promising results for forecasting Financial Time Series (FTS), this paper seeks to assess if attention mechanisms can further improve performance. The hypothesis is that attention can help prevent long-term…

Machine Learning · Computer Science 2018-12-20 Thomas Hollis , Antoine Viscardi , Seung Eun Yi

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

Machine Learning · Computer Science 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang