English
Related papers

Related papers: Three-Stage Learning Unlocks Strong Performance in…

200 papers

Time series forecasting presents significant challenges in real-world applications across various domains. Building upon the decomposition of the time series, we enhance the architecture of machine learning models for better multivariate…

Machine Learning · Computer Science 2026-02-24 Sanjeev Panta , Xu Yuan , Li Chen , Nian-Feng Tzeng

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

Spatial-temporal forecasting is crucial and widely applicable in various domains such as traffic, energy, and climate. Benefiting from the abundance of unlabeled spatial-temporal data, self-supervised methods are increasingly adapted to…

Machine Learning · Computer Science 2024-12-20 Qi Zheng , Zihao Yao , Yaying Zhang

Multistage stochastic programming provides a modeling framework for sequential decision-making problems that involve uncertainty. One typically overlooked aspect of this methodology is how uncertainty is incorporated into modeling.…

Optimization and Control · Mathematics 2021-09-24 Juyoung Wang , Mucahit Cevik , Merve Bodur

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

Machine Learning · Computer Science 2024-12-30 Peiwang Tang , Weitai Zhang

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

Machine Learning · Computer Science 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a…

Machine Learning · Computer Science 2023-10-02 Kevin Roy , Luis Miguel Lopez-Ramos , Baltasar Beferull-Lozano

Accurately forecasting long-term atmospheric variables remains a defining challenge in meteorological science due to the chaotic nature of atmospheric systems. Temperature data represents a complex superposition of deterministic cyclical…

Machine Learning · Computer Science 2026-01-14 Shreyas Rajeev , Karthik Mudenahalli Ashoka , Amit Mallappa Tiparaddi

Streaming recurrent models enable efficient 3D reconstruction by maintaining persistent state representations. However, they suffer from catastrophic forgetting over long sequences due to balancing historical information with new…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Zhijie Zheng , Xinhao Xiang , Jiawei Zhang

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

There is a recent surge of interest in designing deep architectures based on the update steps in traditional algorithms, or learning neural networks to improve and replace traditional algorithms. While traditional algorithms have certain…

Machine Learning · Computer Science 2020-06-11 Xinshi Chen , Hanjun Dai , Yu Li , Xin Gao , Le Song

Multivariate time series forecasting plays a pivotal role in numerous real-world applications, including financial analysis, energy management, and traffic planning. While Transformer-based architectures have gained popularity for this…

Machine Learning · Computer Science 2026-05-01 Pourya Zamanvaziri , Amirhossein Sadr , Aida Pakniyat , Dara Rahmati

Recent developments in large language models have sparked interest in efficient pretraining methods. Stagewise training approaches to improve efficiency, like gradual stacking and layer dropping (Reddi et al, 2023; Zhang & He, 2020), have…

Computation and Language · Computer Science 2024-10-15 Abhishek Panigrahi , Nikunj Saunshi , Kaifeng Lyu , Sobhan Miryoosefi , Sashank Reddi , Satyen Kale , Sanjiv Kumar

Recent research in time series forecasting frequently investigates the integration of textual and visual modalities with numerical models to better navigate non-stationary environments. Despite delivering solid numerical results, existing…

Machine Learning · Computer Science 2026-05-26 Hui Cheng , Jinsheng Guo , Zhenhao Weng , Yan Qiao , Meng Li

As modern power systems continue to evolve, accurate power load forecasting remains a critical issue in energy management. The phase space reconstruction method can effectively retain the inner chaotic property of power load from a system…

Signal Processing · Electrical Eng. & Systems 2024-07-30 Zihan Tang , Tianyao Ji , Wenhu Tang

This paper proposes a neural framework for power and timing prediction of multi-stage data path, distinguishing itself from traditional lib-based analytical methods dependent on driver characterization and load simplifications. To the best…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Junlang Huang , Hao Chen , Zhong Guan

Time series forecasting has long been dominated by model-centric approaches that formulate prediction as a single-pass mapping from historical observations to future values. Despite recent progress, such formulations often struggle in…

Machine Learning · Computer Science 2026-02-17 Xiaoyu Tao , Mingyue Cheng , Chuang Jiang , Tian Gao , Huanjian Zhang , Yaguo Liu

Nowadays, time series forecasting is predominantly approached through the end-to-end training of deep learning architectures using error-based objectives. While this is effective at minimizing average loss, it encourages the encoder to…

Machine Learning · Computer Science 2026-03-26 Jiacheng Wang , Liang Fan , Baihua Li , Luyan Zhang

Multi-step forecasting is often described through a simple rule of thumb: recursive strategies are said to have high bias and low variance, while direct strategies are said to have low bias and high variance. We revisit this belief by…

Machine Learning · Computer Science 2025-11-17 Riku Green , Huw Day , Zahraa S. Abdallah , Telmo M. Silva Filho

Recent research has challenged the necessity of complex deep learning architectures for time series forecasting, demonstrating that simple linear models can often outperform sophisticated approaches. Building upon this insight, we introduce…

Machine Learning · Computer Science 2024-10-30 Remi Genet , Hugo Inzirillo