English
Related papers

Related papers: TEAFormers: TEnsor-Augmented Transformers for Mult…

200 papers

Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent…

Machine Learning · Computer Science 2022-10-24 Kiran Madhusudhanan , Johannes Burchert , Nghia Duong-Trung , Stefan Born , Lars Schmidt-Thieme

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global view of time series…

Machine Learning · Computer Science 2022-06-17 Tian Zhou , Ziqing Ma , Qingsong Wen , Xue Wang , Liang Sun , Rong Jin

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

Transformer-based methods have shown great potential in long-term time series forecasting. However, most of these methods adopt the standard point-wise self-attention mechanism, which not only becomes intractable for long-term forecasting…

Machine Learning · Computer Science 2022-02-24 Dazhao Du , Bing Su , Zhewei Wei

Multivariate time series (MTS) forecasting is vital in fields like weather, energy, and finance. However, despite deep learning advancements, traditional Transformer-based models often diminish the effect of crucial inter-variable…

Machine Learning · Computer Science 2025-03-03 Yanhong Li , David C. Anastasiu

Reliable weather forecasting is of great importance in science, business, and society. The best performing data-driven models for weather prediction tasks rely on recurrent or convolutional neural networks, where some of which incorporate…

Machine Learning · Computer Science 2022-02-23 Onur Bilgin , Paweł Mąka , Thomas Vergutz , Siamak Mehrkanoon

Most existing transformer based video instance segmentation methods extract per frame features independently, hence it is challenging to solve the appearance deformation problem. In this paper, we observe the temporal information is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Zhenghao Zhang , Fangtao Shao , Zuozhuo Dai , Siyu Zhu

Multivariate time series classification is a crucial task in data mining, attracting growing research interest due to its broad applications. While many existing methods focus on discovering discriminative patterns in time series,…

Machine Learning · Computer Science 2024-12-24 Wenjie Xi , Rundong Zuo , Alejandro Alvarez , Jie Zhang , Byron Choi , Jessica Lin

Transformer-based methods have achieved state-of-the-art performance in time series forecasting (TSF) by capturing positional and semantic topological relationships among input tokens. However, it remains unclear whether existing…

Artificial Intelligence · Computer Science 2025-10-27 Jianqi Zhang , Wenwen Qiang , Jingyao Wang , Jiahuan Zhou , Changwen Zheng , Hui Xiong

Currently, iTransformer is one of the most popular and effective models for multivariate time series (MTS) forecasting. Thanks to its inverted framework, iTransformer effectively captures multivariate correlation. However, the inverted…

Machine Learning · Computer Science 2025-07-17 Hongming Tan , Ting Chen , Ruochong Jin , Wai Kin Chan

Time-series data are critical in diverse applications, such as industrial monitoring, medical diagnostics, and climate research. However, effectively integrating these high-dimensional temporal signals with natural language for dynamic,…

Computation and Language · Computer Science 2025-06-26 Yilin Wang , Peixuan Lei , Jie Song , Yuzhe Hao , Tao Chen , Yuxuan Zhang , Lei Jia , Yuanxiang Li , Zhongyu Wei

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data…

Machine Learning · Computer Science 2025-05-09 Yuren Zhang , Zhongnan Pu , Lei Jing

Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a pivotal role in facilitating long-term planning and developing early warning systems. While many Transformer-based models have recently been…

Machine Learning · Computer Science 2023-05-31 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Reliable uncertainty quantification is critical in multivariate time series forecasting problems arising in domains such as energy systems and transportation networks, among many others. Although Transformer-based architectures have…

Machine Learning · Computer Science 2026-03-13 Rajdeep Pathak , Rahul Goswami , Madhurima Panja , Palash Ghosh , Tanujit Chakraborty

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are…

Machine Learning · Computer Science 2022-08-22 William T. Ng , K. Siu , Albert C. Cheung , Michael K. Ng

Time series forecasting (TSF) faces challenges in modeling complex intra-channel temporal dependencies and inter-channel correlations. Although recent research has highlighted the efficiency of linear architectures in capturing global…

Machine Learning · Computer Science 2026-01-29 Gawon Lee , Hanbyeol Park , Minseop Kim , Dohee Kim , Hyerim Bae

Real-world time series data are inherently multivariate, often exhibiting complex inter-channel dependencies. Each channel is typically sampled at its own period and is prone to missing values due to various practical and operational…

Machine Learning · Computer Science 2026-03-11 Jinkwan Jang , Hyungjin Park , Jinmyeong Choi , Taesup Kim

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

Machine Learning · Computer Science 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

Time-series classification is one of the most frequently performed tasks in industrial data science, and one of the most widely used data representation in the industrial setting is tabular representation. In this work, we propose a novel…

Machine Learning · Computer Science 2021-10-06 Sharath M Shankaranarayana , Davor Runje