English
Related papers

Related papers: How Foundational are Foundation Models for Time Se…

200 papers

Using a time series model to mimic an observed time series has a long history. However, with regard to this objective, conventional estimation methods for discrete-time dynamical models are frequently found to be wanting. In fact, they are…

Statistics Theory · Mathematics 2015-03-19 Yingcun Xia , Howell Tong

Effective resource allocation in higher education depends on reliable enrolment forecasts, yet institutional planners frequently face data series disrupted by structural shifts. This paper investigates whether zero-shot Time Series…

Artificial Intelligence · Computer Science 2026-04-28 Jittarin Jetwiriyanon , Teo Susnjak , Surangika Ranathunga

This work studies the problem of time series analysis with generalist (or foundation) models, which are models trained across many data domains. Drawing inspiration from the widespread success of large language models, we consider the…

Machine Learning · Computer Science 2025-01-03 Sabera Talukder , Yisong Yue , Georgia Gkioxari

Foundation models (FMs) are a popular topic of research in AI. Their ability to generalize to new tasks and datasets without retraining or needing an abundance of data makes them an appealing candidate for applications on specialist…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Marga Don , Stijn Pinson , Blanca Guillen Cebrian , Yuki M. Asano

The present study explores the interpretability of latent spaces produced by time series foundation models, focusing on their potential for visual analysis tasks. Specifically, we evaluate the MOMENT family of models, a set of…

Foundation models have emerged as a promising approach in time series forecasting (TSF). Existing approaches either repurpose large language models (LLMs) or build large-scale time series datasets to develop TSF foundation models for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mouxiang Chen , Lefei Shen , Zhuo Li , Xiaoyun Joy Wang , Jianling Sun , Chenghao Liu

Deep learning models have grown increasingly popular in time series applications. However, the large quantity of newly proposed architectures, together with often contradictory empirical results, makes it difficult to assess which…

Machine Learning · Computer Science 2025-12-30 Valentina Moretti , Andrea Cini , Ivan Marisca , Cesare Alippi

Time series foundation models (TSFMs) demonstrate impressive zero-shot performance for time series forecasting. However, an important yet underexplored challenge is how to effectively finetune TSFMs on specific downstream tasks. While naive…

Foundation models (FMs) have revolutionized computer vision, enabling effective learning across different domains. However, their performance under domain shift is yet underexplored. This paper investigates the zero-shot domain adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ugur Ali Kaplan , Margret Keuper , Anna Khoreva , Dan Zhang , Yumeng Li

As global energy systems transit to clean energy, accurate renewable generation and renewable demand forecasting is imperative for effective grid management. Foundation Models (FMs) can help improve forecasting of renewable generation and…

Systems and Control · Electrical Eng. & Systems 2025-08-01 Md Meftahul Ferdaus , Tanmoy Dam , Md Rasel Sarkar , Moslem Uddin , Sreenatha G. Anavatti

Time series foundation models have demonstrated strong performance in zero-shot learning, making them well-suited for predicting rapidly evolving patterns in real-world applications where relevant training data are scarce. However, most of…

Machine Learning · Computer Science 2024-11-06 Haoyu Ma , Yushu Chen , Wenlai Zhao , Jinzhe Yang , Yingsheng Ji , Xinghua Xu , Xiaozhu Liu , Hao Jing , Shengzhuo Liu , Guangwen Yang

Building energy management (BEM) tasks require processing and learning from a variety of time-series data. Existing solutions rely on bespoke task- and data-specific models to perform these tasks, limiting their broader applicability.…

Machine Learning · Computer Science 2025-06-16 Ozan Baris Mulayim , Pengrui Quan , Liying Han , Xiaomin Ouyang , Dezhi Hong , Mario Bergés , Mani Srivastava

Advances in time-series forecasting are driving a shift from conventional machine learning models to foundation models (FMs) that are trained with generalized knowledge. However, existing FMs still perform poorly in the energy fields, such…

Machine Learning · Computer Science 2024-12-24 Rui Liang , Yang Deng , Donghua Xie , Fang He , Dan Wang

Time-series foundation models (TSFMs) achieve strong forecast accuracy, yet accuracy alone does not determine practical value. The form of a forecast -- point, quantile, parametric, or trajectory ensemble -- fundamentally constrains which…

Machine Learning · Computer Science 2025-10-23 Alvaro Perez-Diaz , James C. Loach , Danielle E. Toutoungi , Lee Middleton

Modern Foundation Models (FMs) are typically trained on corpora spanning a wide range of different data modalities, topics and downstream tasks. Utilizing these models can be very computationally expensive and is out of reach for most…

Machine Learning · Computer Science 2025-06-09 Andrey Zhmoginov , Jihwan Lee , Mark Sandler

Pretrained foundation models learn embeddings that can be used for a wide range of downstream tasks. These embeddings optimise general performance, and if insufficiently accurate at a specific task the model can be fine-tuned to improve…

Machine Learning · Computer Science 2025-02-20 Matthew P. Wilson , Edward O. Pyzer-Knapp , Nicolas Galichet , Luke Dicks

Financial time-series forecasting is critical for maintaining economic stability, guiding informed policymaking, and promoting sustainable investment practices. However, it remains challenging due to various underlying pattern shifts. These…

Machine Learning · Computer Science 2025-08-28 Zhuohang Zhu , Haodong Chen , Qiang Qu , Vera Chung

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series…

Machine Learning · Computer Science 2025-09-09 Yihang Wang , Yuying Qiu , Peng Chen , Kai Zhao , Yang Shu , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Considering the difficulty of financial time series forecasting in financial aid, much of the current research focuses on leveraging big data analytics in financial services. One modern approach is to utilize "predictive analysis",…

Machine Learning · Computer Science 2024-10-28 Md Khairul Islam , Ayush Karmacharya , Timothy Sue , Judy Fox

A world model creates a surrogate world to train a controller and predict safety violations by learning the internal dynamic model of systems. However, the existing world models rely solely on statistical learning of how observations change…

Machine Learning · Computer Science 2024-05-06 Zhenjiang Mao , Siqi Dai , Yuang Geng , Ivan Ruchkin