English
Related papers

Related papers: Towards Lightweight Time Series Forecasting: a Pat…

200 papers

Foundation models (FMs) have emerged as a promising approach for time series forecasting. While effective, FMs typically remain fixed during deployment due to the high computational costs of learning them online. Consequently, deployed FMs…

Machine Learning · Computer Science 2025-07-31 Thomas L. Lee , William Toner , Rajkarn Singh , Artjom Joosen , Martin Asenov

Reliable uncertainty quantification is critical in multivariate time series forecasting problems arising in domains such as energy systems and transportation networks, among many others. Although Transformer-based architectures have…

Machine Learning · Computer Science 2026-03-13 Rajdeep Pathak , Rahul Goswami , Madhurima Panja , Palash Ghosh , Tanujit Chakraborty

Recurrent neural networks are effective models to process sequences. However, they are unable to learn long-term dependencies because of their inherent sequential nature. As a solution, Vaswani et al. introduced the Transformer, a model…

Machine Learning · Computer Science 2023-03-28 Quentin Fournier , Gaétan Marceau Caron , Daniel Aloise

Transformer recently emerged as the de facto model for computer vision tasks and has also been successfully applied to shadow removal. However, these existing methods heavily rely on intricate modifications to the attention mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhuohao Li , Guoyang Xie , Guannan Jiang , Zhichao Lu

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Subseasonal forecasting, which is pivotal for agriculture, water resource management, and early warning of disasters, faces challenges due to the chaotic nature of the atmosphere. Recent advances in machine learning (ML) have revolutionized…

Machine Learning · Computer Science 2024-02-06 Shan Zhao , Zhitong Xiong , Xiao Xiang Zhu

With the recent advancements in wireless technologies, forecasting electromagnetic field (EMF) exposure has become critical to enable proactive network spectrum and power allocation, as well as network deployment planning. In this paper, we…

Machine Learning · Computer Science 2025-04-02 Xavier Mootoo , Hina Tabassum , Luca Chiaraviglio

To address the high sampling cost of Diffusion Transformers (DiTs), feature caching offers a training-free acceleration method. However, existing methods rely on hand-crafted forecasting formulas that fail under aggressive skipping. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zhirong Shen , Rui Huang , Jiacheng Liu , Chang Zou , Peiliang Cai , Shikang Zheng , Zhengyi Shi , Liang Feng , Linfeng Zhang

Recent studies have demonstrated the great power of Transformer models for time series forecasting. One of the key elements that lead to the transformer's success is the channel-independent (CI) strategy to improve the training robustness.…

Machine Learning · Computer Science 2024-02-19 Wang Xue , Tian Zhou , Qingsong Wen , Jinyang Gao , Bolin Ding , Rong Jin

Time series forecasters are widely used across various domains. Among them, MLP (multi-layer perceptron)-based forecasters have been proven to be more robust to noise compared to Transformer-based forecasters. However, MLP struggles to…

Machine Learning · Computer Science 2026-03-18 Xiang Ao

Accurate forecasting of residual Physical Resource Blocks (PRBs) is critical for proactive network slice provisioning, energy-efficient operation, and spectrum-aware decision making in cellular systems, where residual PRBs serve as a…

Machine Learning · Computer Science 2026-05-18 Saad Masrur , Yuxuan Jiang , Matti Hiltunen , Ajay Rajkumar , Ismail Guvenc

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

Although numerical weather forecasting methods have dominated the field, recent advances in deep learning methods, such as diffusion models, have shown promise in ensemble weather forecasting. However, such models are typically…

Machine Learning · Computer Science 2025-09-16 Kevin Valencia , Ziyang Liu , Justin Cui

Time series forecasting requires capturing patterns across multiple temporal scales while maintaining computational efficiency. This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with…

Machine Learning · Computer Science 2026-01-29 Wei Li

Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using…

Machine Learning · Computer Science 2026-01-14 Jiacheng You , Jingcheng Yang , Yuhang Xie , Zhongxuan Wu , Xiucheng Li , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xinyang Chen

While Transformers excel in language and vision-where inputs are semantically rich and exhibit univariate dependency structures-their architectural complexity leads to diminishing returns in time series forecasting. Time series data is…

Machine Learning · Computer Science 2025-06-09 Yash Vijay , Harini Subramanyan

In practical time series forecasting, covariates provide rich contextual information that can potentially enhance the forecast of target variables. Although some covariates extend into the future forecasting horizon (e.g., calendar events,…

Machine Learning · Computer Science 2025-08-07 Yosuke Yamaguchi , Issei Suemitsu , Wenpeng Wei

Time Series Foundation Models (TSFMs) advance generalization and data efficiency in time series forecasting by unified large-scale pretraining. But TSFMs remain lacking when adapting to specific downstream forecasting tasks for two reasons.…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Siyang Li , Yize Chen , Zijie Zhu , Yuxin Pan , Yan Guo , Ming Huang , Hui Xiong

Accurately predicting end-to-end network latency is essential for enabling reliable task offloading in real-time edge computing applications. This paper introduces a lightweight latency prediction scheme based on rational modelling that…

Networking and Internet Architecture · Computer Science 2025-11-05 Mohan Liyanage , Eldiyar Zhantileuov , Ali Kadhum Idrees , Rolf Schuster

Diffusion models have recently emerged as powerful frameworks for generating high-quality images. While recent studies have explored their application to time series forecasting, these approaches face significant challenges in cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Weilin Ruan , Siru Zhong , Haomin Wen , Yuxuan Liang