English
Related papers

Related papers: Context Neural Networks: A Scalable Multivariate M…

200 papers

An increasing body of research focuses on using neural networks to model time series. A common assumption in training neural networks via maximum likelihood estimation on time series is that the errors across time steps are uncorrelated.…

Machine Learning · Computer Science 2021-10-12 Fan-Keng Sun , Christopher I. Lang , Duane S. Boning

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Time-series forecasting is one of the most active research topics in artificial intelligence. Applications in real-world time series should consider two factors for achieving reliable predictions: modeling dynamic dependencies among…

Machine Learning · Computer Science 2021-05-28 Gabriel Spadon , Shenda Hong , Bruno Brandoli , Stan Matwin , Jose F. Rodrigues-Jr , Jimeng Sun

Probabilistic forecasting of multivariate time series is essential for various downstream tasks. Most existing approaches rely on the sequences being uniformly spaced and aligned across all variables. However, real-world multivariate time…

Machine Learning · Computer Science 2025-02-18 Yijun Li , Cheuk Hang Leung , Qi Wu

Multivariate time series forecasting is extensively studied throughout the years with ubiquitous applications in areas such as finance, traffic, environment, etc. Still, concerns have been raised on traditional methods for incapable of…

Machine Learning · Computer Science 2018-09-10 Yen-Yu Chang , Fan-Yun Sun , Yueh-Hua Wu , Shou-De Lin

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

We propose here an extended attention model for sequence-to-sequence recurrent neural networks (RNNs) designed to capture (pseudo-)periods in time series. This extended attention model can be deployed on top of any RNN and is shown to yield…

Machine Learning · Computer Science 2017-08-22 Yagmur G. Cinar , Hamid Mirisaee , Parantapa Goswami , Eric Gaussier , Ali Ait-Bachir , Vadim Strijov

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes"…

Machine Learning · Computer Science 2024-05-06 Qiqi Su , Christos Kloukinas , Artur d'Avila Garcez

Recent studies have shown great promise in applying graph neural networks for multivariate time series forecasting, where the interactions of time series are described as a graph structure and the variables are represented as the graph…

Machine Learning · Computer Science 2022-06-29 Junchen Ye , Zihan Liu , Bowen Du , Leilei Sun , Weimiao Li , Yanjie Fu , Hui Xiong

Self-attention model have shown its flexibility in parallel computation and the effectiveness on modeling both long- and short-term dependencies. However, it calculates the dependencies between representations without considering the…

Computation and Language · Computer Science 2019-02-18 Baosong Yang , Jian Li , Derek Wong , Lidia S. Chao , Xing Wang , Zhaopeng Tu

Real-valued time series are ubiquitous in the sciences and engineering. In this work, a general, hierarchical Bayesian modelling framework is developed for building mixture models for times series. This development is based, in part, on the…

Methodology · Statistics 2023-04-18 Ioannis Papageorgiou , Ioannis Kontoyiannis

Systems are commonly monitored for health and security through collection and streaming of multivariate time series. Advances in time series forecasting due to adoption of multilayer recurrent neural network architectures make it possible…

Machine Learning · Statistics 2022-03-10 Oshri Barazani , David Tolpin

Sequential models like recurrent neural networks and transformers have become standard for probabilistic multivariate time series forecasting across various domains. Despite their strengths, they struggle with capturing high-dimensional…

Machine Learning · Computer Science 2024-10-07 Yu Chen , Marin Biloš , Sarthak Mittal , Wei Deng , Kashif Rasul , Anderson Schneider

Multivariate time series is prevalent in many scientific and industrial domains. Modeling multivariate signals is challenging due to their long-range temporal dependencies and intricate interactions--both direct and indirect. To confront…

Machine Learning · Computer Science 2023-12-01 Juhyeon Kim , Hyungeun Lee , Seungwon Yu , Ung Hwang , Wooyul Jung , Miseon Park , Kijung Yoon

As industrial systems become more complex and monitoring sensors for everything from surveillance to our health become more ubiquitous, multivariate time series prediction is taking an important place in the smooth-running of our society. A…

Machine Learning · Computer Science 2022-03-03 Fan Jin , Ke Zhang , Yipan Huang , Yifei Zhu , Baiping Chen

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

Multivariate time series classification is a task with increasing importance due to the proliferation of new problems in various fields (economy, health, energy, transport, crops, etc.) where a large number of information sources are…

Machine Learning · Computer Science 2020-09-09 Francisco J. Baldán , José M. Benítez

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

Anomaly detection on multivariate time-series is of great importance in both data mining research and industrial applications. Recent approaches have achieved significant progress in this topic, but there is remaining limitations. One major…

Machine Learning · Computer Science 2020-09-07 Hang Zhao , Yujing Wang , Juanyong Duan , Congrui Huang , Defu Cao , Yunhai Tong , Bixiong Xu , Jing Bai , Jie Tong , Qi Zhang

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li