English
Related papers

Related papers: Deep Transformer Models for Time Series Forecastin…

200 papers

Weather forecasting remains a crucial yet challenging domain, where recently developed models based on deep learning (DL) have approached the performance of traditional numerical weather prediction (NWP) models. However, these DL models,…

Atmospheric and Oceanic Physics · Physics 2024-02-13 Zhanxiang Hua , Yutong He , Chengqian Ma , Alexandra Anderson-Frey

There is a recent growing interest in applying Deep Learning techniques to tabular data, in order to replicate the success of other Artificial Intelligence areas in this structured domain. Specifically interesting is the case in which…

Machine Learning · Computer Science 2025-05-06 Simone Luetto , Fabrizio Garuti , Enver Sangineto , Lorenzo Forni , Rita Cucchiara

Multivariate Time Series forecasting has been an increasingly popular topic in various applications and scenarios. Recently, contrastive learning and Transformer-based models have achieved good performance in many long-term series…

Machine Learning · Computer Science 2023-01-24 Zhe Li , Zhongwen Rao , Lujia Pan , Pengyun Wang , Zenglin Xu

Diffusion models, initially developed for image synthesis, demonstrate remarkable generative capabilities. Recently, their application has expanded to time series forecasting (TSF), yielding promising results. Existing surveys on time…

Machine Learning · Statistics 2025-09-03 Chen Su , Zhengzhou Cai , Yuanhe Tian , Zhuochao Chang , Zihong Zheng , Yan Song

This paper presents a novel approach in wildfire prediction through the integration of multisource spatiotemporal data, including satellite data, and the application of deep learning techniques. Specifically, we utilize an ensemble model…

Machine Learning · Computer Science 2025-01-07 Ayoub Jadouli , Chaker El Amrani

The abundance of modern health data provides many opportunities for the use of machine learning techniques to build better statistical models to improve clinical decision making. Predicting time-to-event distributions, also known as…

Machine Learning · Statistics 2020-12-15 Zidi Xiu , Chenyang Tao , Benjamin A. Goldstein , Ricardo Henao

Many methods for time-series forecasting are known in classical statistics, such as autoregression, moving averages, and exponential smoothing. The DeepAR framework is a novel, recent approach for time-series forecasting based on deep…

Machine Learning · Computer Science 2023-02-23 Ayla Jungbluth , Johannes Lederer

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

In this paper, we propose a machine learning approach for forecasting hierarchical time series. When dealing with hierarchical time series, apart from generating accurate forecasts, one needs to select a suitable method for producing…

Machine Learning · Computer Science 2021-07-12 Paolo Mancuso , Veronica Piccialli , Antonio M. Sudoso

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

Developments in Deep Learning have significantly improved time series forecasting by enabling more accurate modeling of complex temporal dependencies inherent in sequential data. The effectiveness of such models is often demonstrated on…

Machine Learning · Computer Science 2025-11-19 Victoria Hankemeier , Malte Schilling

Deep neural networks, including transformers and convolutional neural networks, have significantly improved multivariate time series classification (MTSC). However, these methods often rely on supervised learning, which does not fully…

Machine Learning · Computer Science 2024-05-28 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Time position embeddings capture the positional information of time steps, often serving as auxiliary inputs to enhance the predictive capabilities of time series models. However, existing models exhibit limitations in capturing intricate…

Machine Learning · Computer Science 2026-01-28 Xiaobao Song , Hao Wang , Liwei Deng , Yuxin He , Wenming Cao , Chi-Sing Leungc

Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distribution assumptions or…

Machine Learning · Computer Science 2021-01-27 Nam Nguyen , Brian Quanz

Nowadays, time series forecasting is predominantly approached through the end-to-end training of deep learning architectures using error-based objectives. While this is effective at minimizing average loss, it encourages the encoder to…

Machine Learning · Computer Science 2026-03-26 Jiacheng Wang , Liang Fan , Baihua Li , Luyan Zhang

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

Machine Learning · Computer Science 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

Time series forecasting plays a critical role in decision-making across many real-world applications. Unlike data in vision and language domains, time series data is inherently tied to the evolution of underlying processes and can only…

Machine Learning · Computer Science 2026-02-03 Suhan Guo , Bingxu Wang , Shaodan Zhang , Furao Shen

It is imperative to discern the relationships between multiple time series for accurate forecasting. In particular, for stock prices, components are often divided into groups with the same characteristics, and a model that extracts…

Machine Learning · Computer Science 2023-05-16 Ryo Umagami , Yu Ono , Yusuke Mukuta , Tatsuya Harada

Multivariate time series forecasting is extensively studied throughout the years with ubiquitous applications in areas such as finance, traffic, environment, etc. Still, concerns have been raised on traditional methods for incapable of…

Machine Learning · Computer Science 2018-09-10 Yen-Yu Chang , Fan-Yun Sun , Yueh-Hua Wu , Shou-De Lin

Time series analysis has witnessed the inspiring development from traditional autoregressive models, deep learning models, to recent Transformers and Large Language Models (LLMs). Efforts in leveraging vision models for time series analysis…

Machine Learning · Computer Science 2025-09-03 Jingchao Ni , Ziming Zhao , ChengAo Shen , Hanghang Tong , Dongjin Song , Wei Cheng , Dongsheng Luo , Haifeng Chen