English
Related papers

Related papers: Probabilistic Decomposition Transformer for Time S…

200 papers

In this paper, we present a new approach to time series forecasting. Time series data are prevalent in many scientific and engineering disciplines. Time series forecasting is a crucial task in modeling time series data, and is an important…

Machine Learning · Computer Science 2020-01-24 Neo Wu , Bradley Green , Xue Ben , Shawn O'Banion

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Probabilistic forecasting of multivariate time series is essential for various downstream tasks. Most existing approaches rely on the sequences being uniformly spaced and aligned across all variables. However, real-world multivariate time…

Machine Learning · Computer Science 2025-02-18 Yijun Li , Cheuk Hang Leung , Qi Wu

Time series forecasting presents significant challenges in real-world applications across various domains. Building upon the decomposition of the time series, we enhance the architecture of machine learning models for better multivariate…

Machine Learning · Computer Science 2026-02-24 Sanjeev Panta , Xu Yuan , Li Chen , Nian-Feng Tzeng

Time series forecasting is a critical task in various domains, where accurate predictions can drive informed decision-making. Traditional forecasting methods often rely on current observations of variables to predict future outcomes,…

Machine Learning · Computer Science 2026-03-17 Wentao Gao , Xiaojing Du , Wenjun Yu , Xiongren Chen , Yifan Guo , Feiyu Yang

Since its introduction, the transformer has shifted the development trajectory away from traditional models (e.g., RNN, MLP) in time series forecasting, which is attributed to its ability to capture global dependencies within temporal…

Machine Learning · Computer Science 2025-01-07 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Time series forecasting models are becoming increasingly prevalent due to their critical role in decision-making across various domains. However, most existing approaches represent the coupled temporal patterns, often neglecting the…

Machine Learning · Computer Science 2025-09-26 Jintao Zhang , Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Daoyu Wang

Transformers for time series forecasting mainly model time series from limited or fixed scales, making it challenging to capture different characteristics spanning various scales. We propose Pathformer, a multi-scale Transformer with…

Machine Learning · Computer Science 2024-09-17 Peng Chen , Yingying Zhang , Yunyao Cheng , Yang Shu , Yihang Wang , Qingsong Wen , Bin Yang , Chenjuan Guo

Time series forecasting is essential across domains from finance to supply chain management. This paper introduces ForecastGAN, a novel decomposition based adversarial framework addressing limitations in existing approaches for…

Machine Learning · Computer Science 2025-11-07 Syeda Sitara Wishal Fatima , Afshin Rahimi

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

Machine Learning · Computer Science 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal dependencies, their…

Machine Learning · Computer Science 2024-12-10 Zhenkai Qin , Baozhong Wei , Caifeng Gao , Jianyuan Ni

Transformer is the state-of-the-art model for many natural language processing, computer vision, and audio analysis problems. Transformer effectively combines information from the past input and output samples in auto-regressive manner so…

Machine Learning · Computer Science 2025-03-14 Joni-Kristian Kämäräinen

Recent advancements in transformer-based models have greatly improved time series analysis, providing robust solutions for tasks such as forecasting, anomaly detection, and classification. A crucial element of these models is positional…

Machine Learning · Computer Science 2026-05-07 Habib Irani , Vangelis Metsis

Recent innovations in diffusion probabilistic models have paved the way for significant progress in image, text and audio generation, leading to their applications in generative time series forecasting. However, leveraging such abilities to…

Machine Learning · Computer Science 2025-11-07 Yuansan Liu , Sudanthi Wijewickrema , Dongting Hu , Christofer Bester , Stephen O'Leary , James Bailey

With the advent of Transformers, time series forecasting has seen significant advances, yet it remains challenging due to the need for effective sequence representation, memory construction, and accurate target projection. Time series…

Artificial Intelligence · Computer Science 2025-07-09 Robert Leppich , Michael Stenger , André Bauer , Samuel Kounev

Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior…

Machine Learning · Computer Science 2022-01-10 Haixu Wu , Jiehui Xu , Jianmin Wang , Mingsheng Long

Time series modeling for predictive purpose has been an active research area of machine learning for many years. However, no sufficiently comprehensive and meanwhile substantive survey was offered so far. This survey strives to meet this…

Machine Learning · Computer Science 2021-09-28 Fatoumata Dama , Christine Sinoquet

Probabilistic graphical models (PGMs) are widely used to discover latent structure in data, but their success hinges on selecting an appropriate model design. In practice, model specification is difficult and often requires iterative…

Machine Learning · Computer Science 2026-04-08 Kevin Zhang , Yixin Wang

Sequential models like recurrent neural networks and transformers have become standard for probabilistic multivariate time series forecasting across various domains. Despite their strengths, they struggle with capturing high-dimensional…

Machine Learning · Computer Science 2024-10-07 Yu Chen , Marin Biloš , Sarthak Mittal , Wei Deng , Kashif Rasul , Anderson Schneider