English
Related papers

Related papers: Multi-scale Attention Flow for Probabilistic Time …

200 papers

Meta-forecasting is a newly emerging field which combines meta-learning and time series forecasting. The goal of meta-forecasting is to train over a collection of source time series and generalize to new time series one-at-a-time. Previous…

Machine Learning · Computer Science 2023-02-07 Mike Van Ness , Huibin Shen , Hao Wang , Xiaoyong Jin , Danielle C. Maddix , Karthick Gopalswamy

Attention-based models are successful when trained on large amounts of data. In this paper, we demonstrate that even in the low-resource scenario, attention can be learned effectively. To this end, we start with discrete human-annotated…

Computation and Language · Computer Science 2018-08-29 Yujia Bao , Shiyu Chang , Mo Yu , Regina Barzilay

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies,…

Machine Learning · Computer Science 2018-11-12 Youru Li , Zhenfeng Zhu , Deqiang Kong , Hua Han , Yao Zhao

Time series forecasting plays a central role in many real-world applications and has been extensively studied. Most existing approaches rely on deterministic models. However, real-world environments exhibit inherently uncertain and complex…

Machine Learning · Computer Science 2026-05-25 Minju Kim , Youngbum Hur

Self-supervised feed-forward methods for scene flow estimation offer real-time efficiency, but their supervision from two-frame point correspondences is unreliable and often breaks down under occlusions. Multi-frame supervision has the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Qingwen Zhang , Chenhan Jiang , Xiaomeng Zhu , Yunqi Miao , Yushan Zhang , Olov Andersson , Patric Jensfelt

The growing impact of global climate change amplifies the need for accurate and reliable weather forecasting. Traditional autoregressive approaches, while effective for temporal modeling, suffer from error accumulation in long-term…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Doyi Kim , Minseok Seo , Hakjin Lee , Junghoon Seo

Transformer-based models have significantly advanced time series forecasting. Recent work, like the Cross-Attention-only Time Series transformer (CATS), shows that removing self-attention can make the model more accurate and efficient.…

Machine Learning · Computer Science 2025-09-08 Jiajun Song , Xiaoou Liu

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measurements from multiple…

Forecasting time series data is a critical area of research with applications spanning from stock prices to early epidemic prediction. While numerous statistical and machine learning methods have been proposed, real-life prediction problems…

Machine Learning · Statistics 2023-12-05 Madhurima Panja , Tanujit Chakraborty , Uttam Kumar , Abdenour Hadid

Mathematical models of cognition are often memoryless and ignore potential fluctuations of their parameters. However, human cognition is inherently dynamic. Thus, we propose to augment mechanistic cognitive models with a temporal dimension…

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

Over the past few decades, the hydrology community has witnessed notable advancements in streamflow prediction, particularly with the introduction of cutting-edge machine-learning algorithms. Recurrent neural networks, especially Long…

Machine Learning · Computer Science 2023-05-23 Sinan Rasiya Koya , Tirthankar Roy

In the transformative landscape of smart cities, the integration of the cutting-edge web technologies into time series forecasting presents a pivotal opportunity to enhance urban planning, sustainability, and economic growth. The…

Machine Learning · Computer Science 2024-05-10 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Forecasting Multivariate Time Series (MTS) involves significant challenges in various application domains. One immediate challenge is modeling temporal patterns with the finite length of the input. These temporal patterns usually involve…

Machine Learning · Computer Science 2024-09-30 Muyao Wang , Wenchao Chen , Zhibin Duan , Bo Chen

Normalizing Flows (NFs) are likelihood-based models for continuous inputs. They have demonstrated promising results on both density estimation and generative modeling tasks, but have received relatively little attention in recent years. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shuangfei Zhai , Ruixiang Zhang , Preetum Nakkiran , David Berthelot , Jiatao Gu , Huangjie Zheng , Tianrong Chen , Miguel Angel Bautista , Navdeep Jaitly , Josh Susskind

Sufficiently modeling the correlations among variables (aka channels) is crucial for achieving accurate multivariate time series forecasting (MTSF). In this paper, we propose a novel technique called Temporal Query (TQ) to more effectively…

Machine Learning · Computer Science 2025-09-12 Shengsheng Lin , Haojun Chen , Haijie Wu , Chunyun Qiu , Weiwei Lin

For Multivariate Time Series Forecasting (MTSF), recent deep learning applications show that univariate models frequently outperform multivariate ones. To address the difficiency in multivariate models, we introduce a method to Construct…

Machine Learning · Statistics 2026-02-06 Jiecheng Lu , Xu Han , Yan Sun , Shihao Yang

The demand of probabilistic time series forecasting has been recently raised in various dynamic system scenarios, for example, system identification and prognostic and health management of machines. To this end, we combine the advances in…

Machine Learning · Computer Science 2022-05-25 Haitao Liu , Changjun Liu , Xiaomo Jiang , Xudong Chen , Shuhua Yang , Xiaofang Wang

We introduce a neural network conformal prediction method for time series that enhances adaptivity in non-stationary environments. Our approach acts as a neural controller designed to achieve desired target coverage, leveraging auxiliary…

Machine Learning · Computer Science 2024-12-25 Ruipu Li , Alexander Rodríguez

The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-attention which is appealing for the ability to attend to…

Machine Learning · Computer Science 2021-10-26 Shujian Zhang , Xinjie Fan , Huangjie Zheng , Korawat Tanwisuth , Mingyuan Zhou