English
Related papers

Related papers: Disentangling Structured Components: Towards Adapt…

200 papers

We propose Scalable Mechanistic Neural Network (S-MNN), an enhanced neural network framework designed for scientific machine learning applications involving long temporal sequences. By reformulating the original Mechanistic Neural Network…

Machine Learning · Computer Science 2026-05-15 Jiale Chen , Dingling Yao , Adeel Pervez , Dan Alistarh , Francesco Locatello

Despite the notable advancements in numerous Transformer-based models, the task of long multi-horizon time series forecasting remains a persistent challenge, especially towards explainability. Focusing on commonly used saliency maps in…

Machine Learning · Computer Science 2023-09-18 Nghia Duong-Trung , Duc-Manh Nguyen , Danh Le-Phuoc

The decomposition of time series into components is an important task that helps to understand time series and can enable better forecasting. Nowadays, with high sampling rates leading to high-frequency data (such as daily, hourly, or…

Applications · Statistics 2021-07-29 Kasun Bandara , Rob J Hyndman , Christoph Bergmeir

Multivariate Time Series (MTS) forecasting involves modeling temporal dependencies within historical records. Transformers have demonstrated remarkable performance in MTS forecasting due to their capability to capture long-term…

Machine Learning · Computer Science 2024-07-17 Yifan Zhang , Rui Wu , Sergiu M. Dascalu , Frederick C. Harris

Short-term load forecasting (STLF) is challenging due to complex time series (TS) which express three seasonal patterns and a nonlinear trend. This paper proposes a novel hybrid hierarchical deep learning model that deals with multiple…

Machine Learning · Computer Science 2021-12-07 Slawek Smyl , Grzegorz Dudek , Paweł Pełka

Convolutional architectures have recently been shown to be competitive on many sequence modelling tasks when compared to the de-facto standard of recurrent neural networks (RNNs), while providing computational and modeling advantages due to…

Machine Learning · Computer Science 2019-02-19 Emre Aksan , Otmar Hilliges

Spatiotemporal forecasting is critical for real-world applications like traffic management, yet capturing reliable interactions remains challenging under noisy and non-stationary conditions. Existing methods primarily rely on historical…

Machine Learning · Computer Science 2026-05-20 Yinghao Ai , Yukai Zhou , Ruoxi Jiang , Junyi An , Chao Qu , Zhijian Zhou , Shiyu Wang , Fenglei Cao , Zenglin Xu , Furao Shen , Yuan Qi

Multivariate time series forecasting is an important yet challenging problem in machine learning. Most existing approaches only forecast the series value of one future moment, ignoring the interactions between predictions of future moments…

Machine Learning · Computer Science 2019-12-12 Jiezhu Cheng , Kaizhu Huang , Zibin Zheng

The proliferation of multi-source remote sensing data has propelled the development of deep learning for dense prediction, yet significant challenges in data and task unification persist. Current deep learning architectures for remote…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sijie Zhao , Feng Liu , Enzhuo Zhang , Yiqing Guo , Pengfeng Xiao , Lei Bai , Xueliang Zhang , Hao Chen

Time series forecasting presents significant challenges in real-world applications across various domains. Building upon the decomposition of the time series, we enhance the architecture of machine learning models for better multivariate…

Machine Learning · Computer Science 2026-02-24 Sanjeev Panta , Xu Yuan , Li Chen , Nian-Feng Tzeng

Due to effective pattern mining and feature representation, neural forecasting models based on deep learning have achieved great progress. The premise of effective learning is to collect sufficient data. However, in time series forecasting,…

Machine Learning · Computer Science 2023-07-04 Yan Gao , Yan Wang , Qiang Wang

Multivariate time-series forecasting holds immense value across diverse applications, requiring methods to effectively capture complex temporal and inter-variable dynamics. A key challenge lies in uncovering the intrinsic patterns that…

Machine Learning · Computer Science 2025-03-12 Liang Yu , Lai Tu , Xiang Bai

In this paper, we present SSDNet, a novel deep learning approach for time series forecasting. SSDNet combines the Transformer architecture with state space models to provide probabilistic and interpretable forecasts, including trend and…

Machine Learning · Computer Science 2021-12-21 Yang Lin , Irena Koprinska , Mashud Rana

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Multivariate Time Series (MTS) forecasting has a wide range of applications in both industry and academia. Recent advances in Spatial-Temporal Graph Neural Network (STGNN) have achieved great progress in modelling spatial-temporal…

Machine Learning · Computer Science 2025-05-22 Huiliang Zhang , Di Wu , Arnaud Zinflou , Stephane Dellacherie , Mouhamadou Makhtar Dione , Benoit Boulet

In recent years, there has been an ever increasing amount of multivariate time series (MTS) data in various domains, typically generated by a large family of sensors such as wearable devices. This has led to the development of novel…

Machine Learning · Computer Science 2022-02-08 Kang Gu , Soroush Vosoughi , Temiloluwa Prioleau

Current time-series forecasting problems use short-term weather attributes as exogenous inputs. However, in specific time-series forecasting solutions (e.g., demand prediction in the supply chain), seasonal climate predictions are crucial…

Machine Learning · Computer Science 2023-09-06 Smit Marvaniya , Jitendra Singh , Nicolas Galichet , Fred Ochieng Otieno , Geeth De Mel , Kommy Weldemariam

Accurate and robust weather forecasting remains a fundamental challenge due to the inherent spatio-temporal complexity of atmospheric systems. In this paper, we propose a novel self-supervised learning framework that leverages…

Machine Learning · Computer Science 2025-11-04 Yao Liu

Multivariate time series (MTS) data, when sampled irregularly and asynchronously, often present extensive missing values. Conventional methodologies for MTS analysis tend to rely on temporal embeddings based on timestamps that necessitate…

Machine Learning · Computer Science 2024-05-28 Chun-Kai Huang , Yi-Hsien Hsieh , Ta-Jung Chien , Li-Cheng Chien , Shao-Hua Sun , Tung-Hung Su , Jia-Horng Kao , Che Lin

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao