English
Related papers

Related papers: Temporal Pattern Attention for Multivariate Time S…

200 papers

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

Machine Learning · Computer Science 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

Probabilistic forecasting of multivariate time series is essential for various downstream tasks. Most existing approaches rely on the sequences being uniformly spaced and aligned across all variables. However, real-world multivariate time…

Machine Learning · Computer Science 2025-02-18 Yijun Li , Cheuk Hang Leung , Qi Wu

Time series data is prevalent in a wide variety of real-world applications and it calls for trustworthy and explainable models for people to understand and fully trust decisions made by AI solutions. We consider the problem of building…

Machine Learning · Computer Science 2020-11-25 Tsung-Yu Hsieh , Suhang Wang , Yiwei Sun , Vasant Honavar

Producing probabilistic forecasts for large collections of similar and/or dependent time series is a practically relevant and challenging task. Classical time series models fail to capture complex patterns in the data, and multivariate…

Machine Learning · Statistics 2019-05-30 Yuyang Wang , Alex Smola , Danielle C. Maddix , Jan Gasthaus , Dean Foster , Tim Januschowski

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve good predictive…

Machine Learning · Computer Science 2022-05-26 Tianjie Wang , Jie Chen , Joel Vaughan , Vijayan N. Nair

Multivariate time-series forecasting holds immense value across diverse applications, requiring methods to effectively capture complex temporal and inter-variable dynamics. A key challenge lies in uncovering the intrinsic patterns that…

Machine Learning · Computer Science 2025-03-12 Liang Yu , Lai Tu , Xiang Bai

Time series forecasting lies at the core of important real-world applications in many fields of science and engineering. The abundance of large time series datasets that consist of complex patterns and long-term dependencies has led to the…

Machine Learning · Computer Science 2023-12-01 Nancy Xu , Chrysoula Kosma , Michalis Vazirgiannis

The paper develops a Transformer architecture for estimating dynamic factors from multivariate time series data under flexible identification assumptions. Performance on small datasets is improved substantially by using a conventional…

Econometrics · Economics 2026-01-21 Oliver Snellman

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

Machine Learning · Computer Science 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

Domain adaptation on time series data is an important but challenging task. Most of the existing works in this area are based on the learning of the domain-invariant representation of the data with the help of restrictions like MMD.…

Machine Learning · Computer Science 2021-06-18 Ruichu Cai , Jiawei Chen , Zijian Li , Wei Chen , Keli Zhang , Junjian Ye , Zhuozhang Li , Xiaoyan Yang , Zhenjie Zhang

Photonic reservoir computing has been successfully utilized in time-series prediction as the need for hardware implementations has increased. Prediction of chaotic time series remains a significant challenge, an area where the conventional…

Emerging Technologies · Computer Science 2024-05-03 Felix Köster , Kazutaka Kanno , Jun Ohkubo , Atsushi Uchida

Multivariate time series is prevalent in many scientific and industrial domains. Modeling multivariate signals is challenging due to their long-range temporal dependencies and intricate interactions--both direct and indirect. To confront…

Machine Learning · Computer Science 2023-12-01 Juhyeon Kim , Hyungeun Lee , Seungwon Yu , Ung Hwang , Wooyul Jung , Miseon Park , Kijung Yoon

As industrial systems become more complex and monitoring sensors for everything from surveillance to our health become more ubiquitous, multivariate time series prediction is taking an important place in the smooth-running of our society. A…

Machine Learning · Computer Science 2022-03-03 Fan Jin , Ke Zhang , Yipan Huang , Yifei Zhu , Baiping Chen

Downsampling-based methods for time series forecasting have attracted increasing attention due to their superiority in capturing sequence trends. However, this approaches mainly capture dependencies within subsequences but neglect…

Computational Engineering, Finance, and Science · Computer Science 2026-01-21 Zhangyao Song , Nanqing Jiang , Miaohong He , Xiaoyu Zhao , Tao Guo

Wind power is one of the most important renewable energy sources and accurate wind power forecasting is very significant for reliable and economic power system operation and control strategies. This paper proposes a novel framework with…

Machine Learning · Computer Science 2019-11-14 Xingbo Fu , Feng Gao , Jiang Wu , Xinyu Wei , Fangwei Duan

Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time series prediction…

Machine Learning · Computer Science 2022-09-21 Hugo Inzirillo , Ludovic De Villelongue

Recently, evolving networks are becoming a suitable form to model many real-world complex systems, due to their peculiarities to represent the systems and their constituting entities, the interactions between the entities and the…

Artificial Intelligence · Computer Science 2017-09-21 Angelo Impedovo , Corrado Loglisci , Michelangelo Ceci

In this work, we propose a novel probabilistic sequence model that excels at capturing high variability in time series data, both across sequences and within an individual sequence. Our method uses temporal latent variables to capture…

Machine Learning · Computer Science 2020-02-26 Ruizhi Deng , Yanshuai Cao , Bo Chang , Leonid Sigal , Greg Mori , Marcus A. Brubaker

This paper is a contribution towards interpretability of the deep learning models in different applications of time-series. We propose a temporal attention layer that is capable of selecting the relevant information to perform various…

Computer Vision and Pattern Recognition · Computer Science 2018-06-25 Phongtharin Vinayavekhin , Subhajit Chaudhury , Asim Munawar , Don Joven Agravante , Giovanni De Magistris , Daiki Kimura , Ryuki Tachibana