English
Related papers

Related papers: Enhancing Transformer-Based Foundation Models for …

200 papers

Demographic shifts, influenced by globalization, economic conditions, geopolitical events, and environmental factors, pose significant challenges for policymakers and researchers. Accurate demographic forecasting is essential for informed…

Machine Learning · Computer Science 2025-08-20 Aditya Akella , Jonathan Farah

Short-term load prediction (STLP) is critical for modern power distribution system operations, particularly as demand and generation uncertainties grow with the integration of low-carbon technologies, such as electric vehicles and…

Systems and Control · Electrical Eng. & Systems 2024-12-18 Nan Lin , Dong Yun , Weijie Xia , Peter Palensky , Pedro P. Vergara

Crowd and flow predictions have been extensively studied in mobility data science. Traditional forecasting methods have relied on statistical models such as ARIMA, later supplemented by deep learning approaches like ST-ResNet. More…

Machine Learning · Computer Science 2025-04-08 Anita Graser

Accurate network-traffic forecasting enables proactive capacity planning and anomaly detection in Internet Service Provider (ISP) networks. Recent advances in time-series foundation models (TSFMs) have demonstrated strong zero-shot and…

Networking and Internet Architecture · Computer Science 2026-02-18 Fan Liu , Behrooz Farkiani , Patrick Crowley

Time series foundation models have demonstrated strong performance in zero-shot learning, making them well-suited for predicting rapidly evolving patterns in real-world applications where relevant training data are scarce. However, most of…

Machine Learning · Computer Science 2024-11-06 Haoyu Ma , Yushu Chen , Wenlai Zhao , Jinzhe Yang , Yingsheng Ji , Xinghua Xu , Xiaozhu Liu , Hao Jing , Shengzhuo Liu , Guangwen Yang

Accurate forecasting of sequential data streams is a cornerstone of modern Web services, supporting applications such as traffic management, user behavior modeling, and online anomaly prevention. However, in many Web environments, new…

Machine Learning · Computer Science 2026-02-02 Shichao Ma , Zhengyang Zhou , Qihe Huang , Binwu Wang , Yang Wang

Time Series Forecasting (TSF) has long been a challenge in time series analysis. Inspired by the success of Large Language Models (LLMs), researchers are now developing Large Time Series Models (LTSMs)-universal transformer-based models…

Time series forecasting is essential for operational intelligence in the hospitality industry, and particularly challenging in large-scale, distributed systems. This study evaluates the performance of statistical, machine learning (ML),…

Machine Learning · Computer Science 2025-02-06 Issar Arab , Rodrigo Benitez

Modern IoT deployments for environmental sensing produce high volume spatiotemporal data to support downstream tasks such as forecasting, typically powered by machine learning models. While existing filtering and strategic deployment…

Machine Learning · Computer Science 2025-12-02 Ragini Gupta , Naman Raina , Bo Chen , Li Chen , Claudiu Danilov , Josh Eckhardt , Keyshla Bernard , Klara Nahrstedt

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Time series foundational models (TSFM) have gained prominence in time series forecasting, promising state-of-the-art performance across various applications. However, their application in anomaly detection and prediction remains…

Machine Learning · Computer Science 2024-12-30 Chathurangi Shyalika , Harleen Kaur Bagga , Ahan Bhatt , Renjith Prasad , Alaa Al Ghazo , Amit Sheth

Time Series Foundation Models (TSFMs) are a powerful paradigm for time series analysis and are often enhanced by synthetic data augmentation to improve the training data quality. Existing augmentation methods, however, typically rely on…

Machine Learning · Computer Science 2026-01-28 Junwei Deng , Chang Xu , Jiaqi W. Ma , Ming Jin , Chenghao Liu , Jiang Bian

Practitioners deploying time series forecasting models face a dilemma: exhaustively validating dozens of models is computationally prohibitive, yet choosing the wrong model risks poor performance. We show that spectral…

Machine Learning · Computer Science 2025-11-13 Oliver Wang , Pengrui Quan , Kang Yang , Mani Srivastava

Financial time series forecasting is central to trading, portfolio optimization, and risk management, yet it remains challenging due to noisy, non-stationary, and heterogeneous data. Recent advances in time series foundation models (TSFMs),…

Computational Finance · Quantitative Finance 2025-11-25 Eghbal Rahimikia , Hao Ni , Weiguan Wang

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

We investigate ensembling techniques in forecasting and examine their potential for use in nonseasonal time-series similar to those in the early days of the COVID-19 pandemic. Developing improved forecast methods is essential as they…

Machine Learning · Computer Science 2022-01-04 Pieter Cawood , Terence L. van Zyl

The proliferation of Time Series Foundation Models (TSFMs) has significantly advanced zero-shot forecasting, enabling predictions for unseen time series without task-specific fine-tuning. Extensive research has confirmed that no single TSFM…

Machine Learning · Computer Science 2025-09-26 Hao-Nan Shi , Ting-Ji Huang , Lu Han , De-Chuan Zhan , Han-Jia Ye

Effective resource allocation in higher education depends on reliable enrolment forecasts, yet institutional planners frequently face data series disrupted by structural shifts. This paper investigates whether zero-shot Time Series…

Artificial Intelligence · Computer Science 2026-04-28 Jittarin Jetwiriyanon , Teo Susnjak , Surangika Ranathunga

Time Series Foundation Models (TSFMs) advance generalization and data efficiency in time series forecasting by unified large-scale pretraining. But TSFMs remain lacking when adapting to specific downstream forecasting tasks for two reasons.…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Siyang Li , Yize Chen , Zijie Zhu , Yuxin Pan , Yan Guo , Ming Huang , Hui Xiong

Time series foundation models have shown impressive performance on a variety of tasks, across a wide range of domains, even in zero-shot settings. However, most of these models are designed to handle short univariate time series as an…

Machine Learning · Computer Science 2024-09-23 Nina Żukowska , Mononito Goswami , Michał Wiliński , Willa Potosnak , Artur Dubrawski