English
Related papers

Related papers: Time Series Forecasting (TSF) Using Various Deep L…

200 papers

Earth Observatory is a growing research area that can capitalize on the powers of AI for short time forecasting, a Now-casting scenario. In this work, we tackle the challenge of weather forecasting using a video transformer network. Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Alabi Bojesomo , Hasan Al Marzouqi , Panos Liatsis

Analyzing both temporal and spatial patterns for an accurate forecasting model for financial time series forecasting is a challenge due to the complex nature of temporal-spatial dynamics: time series from different locations often have…

Machine Learning · Computer Science 2022-10-18 Hu Yang , Yi Huang , Haijun Wang , Yu Chen

Recent work has shown the efficiency of deep learning models such as Fully Convolutional Networks (FCN) or Recurrent Neural Networks (RNN) to deal with Time Series Regression (TSR) problems. These models sometimes need a lot of data to be…

Machine Learning · Computer Science 2021-11-03 Sebastian Pineda Arango , Felix Heinrich , Kiran Madhusudhanan , Lars Schmidt-Thieme

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

This study examines the predictability of artificial intelligence (AI) models for weather prediction. Using a simple deep-learning architecture based on convolutional long short-term memory and the ERA5 data for training, we show that…

Atmospheric and Oceanic Physics · Physics 2024-10-07 Chanh Kieu

In this paper, we propose machine learning solutions to predict the time of future trips and the possible distance the vehicle will travel. For this prediction task, we develop and investigate four methods. In the first method, we use long…

Machine Learning · Computer Science 2023-03-28 Ebrahim Balouji , Jonas Sjöblom , Nikolce Murgovski , Morteza Haghir Chehreghani

Long-term time series forecasting (LTSF) remains challenging due to the trade-off between parallel efficiency and sequential modeling of temporal coherence. Direct multi-step forecasting (DMS) methods enable fast, parallel prediction of all…

Machine Learning · Computer Science 2026-02-03 Sunho Kim , Susik Yoon

In this paper, we propose a novel model for time series prediction in which difference-attention LSTM model and error-correction LSTM model are respectively employed and combined in a cascade way. While difference-attention LSTM model…

Machine Learning · Computer Science 2020-08-26 Yuxuan Liu , Jiangyong Duan , Juan Meng

Sufficiently modeling the correlations among variables (aka channels) is crucial for achieving accurate multivariate time series forecasting (MTSF). In this paper, we propose a novel technique called Temporal Query (TQ) to more effectively…

Machine Learning · Computer Science 2025-09-12 Shengsheng Lin , Haojun Chen , Haijie Wu , Chunyun Qiu , Weiwei Lin

Accurate workload forecasting is critical for efficient resource management in cloud computing systems, enabling effective scheduling and autoscaling. Despite recent advances with transformer-based forecasting models, challenges remain due…

Machine Learning · Computer Science 2024-08-20 Shiyu Wang , Zhixuan Chu , Yinbo Sun , Yu Liu , Yuliang Guo , Yang Chen , Huiyang Jian , Lintao Ma , Xingyu Lu , Jun Zhou

Recency bias is a useful inductive prior for sequential modeling: it emphasizes nearby observations and can still allow longer-range dependencies. Standard Transformer attention lacks this property, relying on all-to-all interactions that…

Machine Learning · Computer Science 2026-04-23 Kareem Hegazy , Michael W. Mahoney , N. Benjamin Erichson

Transformer-based models have gained increasing attention in time series research, driving interest in Large Language Models (LLMs) and foundation models for time series analysis. As the field moves toward multi-modality, Large Vision…

Machine Learning · Computer Science 2025-07-11 Ziming Zhao , ChengAo Shen , Hanghang Tong , Dongjin Song , Zhigang Deng , Qingsong Wen , Jingchao Ni

While recurrent neural networks still largely define state-of-the-art speech recognition systems, the Transformer network has been proven to be a competitive alternative, especially in the offline condition. Most studies with Transformers…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Liang Lu , Changliang Liu , Jinyu Li , Yifan Gong

Long-term time series forecasting (LTSF) is a challenging task that has been investigated in various domains such as finance investment, health care, traffic, and weather forecasting. In recent years, Linear-based LTSF models showed better…

Machine Learning · Computer Science 2023-11-13 Seonkyu Lim , Jaehyeon Park , Seojin Kim , Hyowon Wi , Haksoo Lim , Jinsung Jeon , Jeongwhan Choi , Noseong Park

Time series data is a prevalent form of data found in various fields. It consists of a series of measurements taken over time. Forecasting is a crucial application of time series models, where future values are predicted based on historical…

Machine Learning · Computer Science 2025-09-23 Sahar Koohfar , Wubeshet Woldemariam

Time series prediction can be generalized as a process that extracts useful information from historical records and then determines future values. Learning long-range dependencies that are embedded in time series is often an obstacle for…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Recent innovations in transformers have shown their superior performance in natural language processing (NLP) and computer vision (CV). The ability to capture long-range dependencies and interactions in sequential data has also triggered a…

Statistical Finance · Quantitative Finance 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Kitae Kim , Seong-Bae Park , Choong Seon Hong

Multi-dimensional time series data, such as matrix and tensor-variate time series, are increasingly prevalent in fields such as economics, finance, and climate science. Traditional Transformer models, though adept with sequential data, do…

Machine Learning · Computer Science 2024-10-29 Linghang Kong , Elynn Chen , Yuzhou Chen , Yuefeng Han

Recent studies have shown that by introducing prior knowledge, multi-scale analysis of complex and non-stationary time series in real environments can achieve good results in the field of long-term forecasting. However, affected by…

Machine Learning · Computer Science 2025-05-26 Bin Wang , Heming Yang , Jinfang Sheng

Time series forecasting with limited data is a challenging yet critical task. While transformers have achieved outstanding performances in time series forecasting, they often require many training samples due to the large number of…

Machine Learning · Computer Science 2019-10-23 Yunkai Zhang , Qiao Jiang , Shurui Li , Xiaoyong Jin , Xueying Ma , Xifeng Yan