English
Related papers

Related papers: HPMixer: Hierarchical Patching for Multivariate Ti…

200 papers

In this paper, we propose a machine learning approach for forecasting hierarchical time series. When dealing with hierarchical time series, apart from generating accurate forecasts, one needs to select a suitable method for producing…

Machine Learning · Computer Science 2021-07-12 Paolo Mancuso , Veronica Piccialli , Antonio M. Sudoso

Deep learning algorithms, especially Transformer-based models, have achieved significant performance by capturing long-range dependencies and historical information. However, the power of convolution has not been fully investigated.…

Machine Learning · Computer Science 2023-12-29 Zhihao Yu , Liantao Ma , Yasha Wang , Junfeng Zhao

Periodicity is a fundamental characteristic of time series data and has long played a central role in forecasting. Recent deep learning methods strengthen the exploitation of periodicity by treating patches as basic tokens, thereby…

Machine Learning · Computer Science 2025-10-07 Yiming Niu , Jinliang Deng , Yongxin Tong

Time series forecasters are widely used across various domains. Among them, MLP (multi-layer perceptron)-based forecasters have been proven to be more robust to noise compared to Transformer-based forecasters. However, MLP struggles to…

Machine Learning · Computer Science 2026-03-18 Xiang Ao

Accurate forecasting of multivariate time series data remains a formidable challenge, particularly due to the growing complexity of temporal dependencies in real-world scenarios. While neural network-based models have achieved notable…

Machine Learning · Computer Science 2025-12-09 Andrey Savchenko , Oleg Kachan

Forecasting irregularly sampled multivariate time series with missing values (IMTS) is a fundamental challenge in domains such as healthcare, climate science, and biology. While recent advances in vision and time series forecasting have…

Machine Learning · Computer Science 2026-02-27 Christian Klötergens , Tim Dernedde , Lars Schmidt-Thieme , Vijaya Krishna Yalavarthi

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

Machine Learning · Computer Science 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz

Forecasting long-term time series in IoT environments remains a significant challenge due to the non-stationary and multi-scale characteristics of sensor signals. Furthermore, error accumulation causes a decrease in forecast quality when…

Machine Learning · Computer Science 2025-11-10 Qianyang Li , Xingjun Zhang , Peng Tao , Shaoxun Wang , Yancheng Pan , Jia Wei

Since the introduction of the Transformer architecture for large language models, the softmax-based attention layer has faced increasing scrutinity due to its quadratic-time computational complexity. Attempts have been made to replace it…

Machine Learning · Computer Science 2026-02-02 Robert Forchheimer

Multivariate time series forecasting has been widely used in various practical scenarios. Recently, Transformer-based models have shown significant potential in forecasting tasks due to the capture of long-range dependencies. However,…

Machine Learning · Computer Science 2023-02-10 Zhe Li , Zhongwen Rao , Lujia Pan , Zenglin Xu

Time series forecasting is important in many fields that require accurate predictions for decision-making. Patching techniques, commonly used and effective in time series modeling, help capture temporal dependencies by dividing the data…

Machine Learning · Computer Science 2026-02-03 Xiangfei Qiu , Xvyuan Liu , Tianen Shen , Xingjian Wu , Hanyin Cheng , Bin Yang , Jilin Hu

Hierarchical forecasting is a key problem in many practical multivariate forecasting applications - the goal is to simultaneously predict a large number of correlated time series that are arranged in a pre-specified aggregation hierarchy.…

Machine Learning · Computer Science 2021-10-13 Biswajit Paria , Rajat Sen , Amr Ahmed , Abhimanyu Das

Time series forecasting presents significant challenges due to the complex temporal dependencies at multiple time scales. This paper introduces ScatterFusion, a novel framework that synergistically integrates scattering transforms with…

Machine Learning · Computer Science 2026-01-29 Wei Li

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

Recent lightweight MLP-based models have achieved strong performance in time series forecasting by capturing stable trends and seasonal patterns. However, their effectiveness hinges on an implicit assumption of local stationarity…

Machine Learning · Computer Science 2026-01-29 Zhiyu Chen , Minhao Liu , Yanru Zhang

Multivariate time series forecasting is essential in domains such as finance, transportation, climate, and energy. However, existing patch-based methods typically adopt fixed-length segmentation, overlooking the heterogeneity of local…

Machine Learning · Computer Science 2026-01-06 Kuiye Ding , Fanda Fan , Chunyi Hou , Zheya Wang , Lei Wang , Zhengxin Yang , Jianfeng Zhan

We present a parsimonious deep learning weather prediction model to forecast seven atmospheric variables with 3-h time resolution for up to one-year lead times on a 110-km global mesh using the Hierarchical Equal Area isoLatitude…

The classification of time-series data is pivotal for streaming data and comes with many challenges. Although the amount of publicly available datasets increases rapidly, deep neural models are only exploited in a few areas. Traditional…

Machine Learning · Computer Science 2021-09-27 Dominique Mercier , Andreas Dengel , Sheraz Ahmed

Nonlinear differential equations rarely admit closed-form solutions, thus requiring numerical time-stepping algorithms to approximate solutions. Further, many systems characterized by multiscale physics exhibit dynamics over a vast range of…

Machine Learning · Computer Science 2020-08-26 Yuying Liu , J. Nathan Kutz , Steven L. Brunton

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li