English
Related papers

Related papers: AverageTime: Enhance Long-Term Time Series Forecas…

200 papers

In the domain of multivariate time series analysis, the concept of channel independence has been increasingly adopted, demonstrating excellent performance due to its ability to eliminate noise and the influence of irrelevant variables.…

Machine Learning · Computer Science 2024-12-18 Haoxin Wang , Yipeng Mo , Kunlan Xiang , Nan Yin , Honghe Dai , Bixiong Li , Songhai Fan , Site Mo

Time series forecasting is crucial for applications across multiple domains and various scenarios. Although Transformer models have dramatically advanced the landscape of forecasting, their effectiveness remains debated. Recent findings…

Machine Learning · Computer Science 2024-12-24 Dongbin Kim , Jinseong Park , Jaewook Lee , Hoki Kim

Accurate forecasting of long-term time series has important applications for decision making and planning. However, it remains challenging to capture the long-term dependencies in time series data. To better extract long-term dependencies,…

Machine Learning · Computer Science 2024-05-15 Feifei Li , Suhan Guo , Feng Han , Jian Zhao , Furao Shen

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

The analysis of long sequence data remains challenging in many real-world applications. We propose a novel architecture, ChunkFormer, that improves the existing Transformer framework to handle the challenges while dealing with long time…

Machine Learning · Computer Science 2022-01-03 Yue Ju , Alka Isac , Yimin Nie

Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior…

Machine Learning · Computer Science 2022-01-10 Haixu Wu , Jiehui Xu , Jianmin Wang , Mingsheng Long

The exponential growth of multivariate time series data from sensor networks in domains like industrial monitoring and smart cities requires efficient and accurate forecasting models. Current deep learning methods often fail to adequately…

Machine Learning · Computer Science 2024-11-08 Xinxing Zhou , Jiaqi Ye , Shubao Zhao , Ming Jin , Chengyi Yang , Yanlong Wen , Xiaojie Yuan

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Multivariate Time Series (MTS) forecasting involves modeling temporal dependencies within historical records. Transformers have demonstrated remarkable performance in MTS forecasting due to their capability to capture long-term…

Machine Learning · Computer Science 2024-07-17 Yifan Zhang , Rui Wu , Sergiu M. Dascalu , Frederick C. Harris

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

The past few years have witnessed the rapid development in multivariate time series forecasting. The key to accurate forecasting results is capturing the long-term dependency between each time step (cross-time dependency) and modeling the…

Machine Learning · Computer Science 2023-06-06 Donghao Luo , Xue Wang

Recent CNN and Transformer-based models tried to utilize frequency and periodicity information for long-term time series forecasting. However, most existing work is based on Fourier transform, which cannot capture fine-grained and local…

Machine Learning · Computer Science 2024-01-05 Peiyuan Liu , Beiliang Wu , Naiqi Li , Tao Dai , Fengmao Lei , Jigang Bao , Yong Jiang , Shu-Tao Xia

In the context of increasing demands for long-term multi-energy load forecasting in real-world applications, this paper introduces Patchformer, a novel model that integrates patch embedding with encoder-decoder Transformer-based…

Machine Learning · Computer Science 2024-04-17 Qiuyi Hong , Fanlin Meng , Felipe Maldonado

Deep learning utilizing transformers has recently achieved a lot of success in many vital areas such as natural language processing, computer vision, anomaly detection, and recommendation systems, among many others. Among several merits of…

Machine Learning · Computer Science 2023-12-05 Lena Sasal , Tanujit Chakraborty , Abdenour Hadid

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

Machine Learning · Computer Science 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

In the complex landscape of multivariate time series forecasting, achieving both accuracy and interpretability remains a significant challenge. This paper introduces the Fuzzy Transformer (Fuzzformer), a novel recurrent neural network…

Artificial Intelligence · Computer Science 2025-10-02 Miha Ožbot , Igor Škrjanc , Vitomir Štruc

Modern multivariate time series forecasting primarily relies on two architectures: the Transformer with attention mechanism and Mamba. In natural language processing, an approach has been used that combines local window attention for…

Machine Learning · Computer Science 2025-09-26 Itay Katav , Aryeh Kontorovich

Multi-horizon probabilistic time series forecasting has wide applicability to real-world tasks such as demand forecasting. Recent work in neural time-series forecasting mainly focus on the use of Seq2Seq architectures. For example,…

Machine Learning · Computer Science 2022-09-09 Sitan Yang , Carson Eisenach , Dhruv Madeka