English
Related papers

Related papers: Estimating Time Series Foundation Model Transferab…

200 papers

Foundation models for time series imputation remain largely unexplored. Recently, two such models, TabPFN-TS and MoTM, have emerged. These models share a common philosophy that places them within the family of time-indexed foundation…

Machine Learning · Computer Science 2026-02-11 Etienne Le Naour , Tahar Nabil , Adrien Petralia , Ghislain Agoua

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Time series forecasting plays a crucial role in data mining, driving rapid advancements across numerous industries. With the emergence of large models, time series foundation models (TSFMs) have exhibited remarkable generalization…

Machine Learning · Computer Science 2024-12-31 Huanyu Zhang , Chang Xu , Yi-Fan Zhang , Zhang Zhang , Liang Wang , Jiang Bian , Tieniu Tan

Tabular foundation models (TFMs), such as TabPFN-2.6, TabICLv2, ConTextTab, Mitra, LimiX, and TabDPT, achieve strong zero-shot performance through in-context learning, but their inductive biases remain fixed at inference time. Adapting a…

Machine Learning · Computer Science 2026-05-12 Duong Nguyen , Mohammed Jawhar , Nicolas Chesneau

Non-stationary sequences arise naturally in control, forecasting, and decision-making. The data-generating process shifts at unknown times, and models must detect the change, discard or downweight obsolete evidence, and adapt to new…

Machine Learning · Computer Science 2026-04-21 Carson Dudley , Yutong Bi , Xiaofeng Liu , Samet Oymak

Given a set of pre-trained models, how can we quickly and accurately find the most useful pre-trained model for a downstream task? Transferability measurement is to quantify how transferable is a pre-trained model learned on a source task…

Machine Learning · Computer Science 2023-08-14 Huiwen Xu , U Kang

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effective approach for…

Machine Learning · Computer Science 2026-01-21 Yuqi Li , Kuiye Ding , Chuanguang Yang , Szu-Yu Chen , Yingli Tian

Building energy management (BEM) tasks require processing and learning from a variety of time-series data. Existing solutions rely on bespoke task- and data-specific models to perform these tasks, limiting their broader applicability.…

Machine Learning · Computer Science 2025-06-16 Ozan Baris Mulayim , Pengrui Quan , Liying Han , Xiaomin Ouyang , Dezhi Hong , Mario Bergés , Mani Srivastava

The present study explores the interpretability of latent spaces produced by time series foundation models, focusing on their potential for visual analysis tasks. Specifically, we evaluate the MOMENT family of models, a set of…

Analyzing time series data is crucial to a wide spectrum of applications, including economics, online marketplaces, and human healthcare. In particular, time series classification plays an indispensable role in segmenting different phases…

Machine Learning · Computer Science 2025-05-12 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Hao Wang , Huayu Li , Zihan Li , Yalin Wang , Aristeidis Sotiras , Abolfazl Razi

The proliferation of Time Series Foundation Models (TSFMs) has significantly advanced zero-shot forecasting, enabling predictions for unseen time series without task-specific fine-tuning. Extensive research has confirmed that no single TSFM…

Machine Learning · Computer Science 2025-09-26 Hao-Nan Shi , Ting-Ji Huang , Lu Han , De-Chuan Zhan , Han-Jia Ye

The development of tabular foundation models (TFMs) has accelerated in recent years, showing strong potential to outperform traditional ML methods for structured data. A key finding is that TFMs can be pretrained entirely on synthetic…

Machine Learning · Computer Science 2025-12-04 Matthew Peroni , Franck Le , Vadim Sheinin

The advancement of Time Series Foundation Models (TSFMs) has been driven primarily by large-scale pre-training, but inference-time compute potential remains largely untapped. This work systematically investigates two questions: how do TSFMs…

Machine Learning · Computer Science 2026-01-27 Ruijin Hua , Zichuan Liu , Kun Zhang , Yiyuan Yang

Tabular foundation models, particularly Prior-data Fitted Networks like TabPFN have emerged as the leading contender in a myriad of tasks ranging from data imputation to label prediction on the tabular data format surpassing the historical…

Machine Learning · Computer Science 2026-04-10 Mayuka Jayawardhana , Nihal Sharma , Kazem Meidani , Bayan Bruss , Tom Goldstein , Doron Bergman

Practitioners deploying time series forecasting models face a dilemma: exhaustively validating dozens of models is computationally prohibitive, yet choosing the wrong model risks poor performance. We show that spectral…

Machine Learning · Computer Science 2025-11-13 Oliver Wang , Pengrui Quan , Kang Yang , Mani Srivastava

Demographic shifts, influenced by globalization, economic conditions, geopolitical events, and environmental factors, pose significant challenges for policymakers and researchers. Accurate demographic forecasting is essential for informed…

Machine Learning · Computer Science 2025-08-20 Aditya Akella , Jonathan Farah

Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs),…

Machine Learning · Computer Science 2025-03-17 Xu Liu , Taha Aksu , Juncheng Liu , Qingsong Wen , Yuxuan Liang , Caiming Xiong , Silvio Savarese , Doyen Sahoo , Junnan Li , Chenghao Liu

While Time Series Foundation Models (TSFMs) have demonstrated exceptional performance in generalized forecasting, their performance often degrades significantly when deployed in real-world vertical domains characterized by temporal…

Machine Learning · Computer Science 2026-02-17 Xiaoyun Yu , Li fan , Xiangfei Qiu , Nanqing Dong , Yonggui Huang , Honggang Qi , Geguang Pu , Wanli Ouyang , Xi Chen , Jilin Hu

Current time series foundation models (TSFMs) primarily focus on learning prevalent and regular patterns within a predefined time or frequency domain to enable supervised downstream tasks (e.g., forecasting). Consequently, they are often…

Machine Learning · Computer Science 2026-02-24 Hui He , Hezhe Qiao , Yutong Chen , Kun Yi , Guansong Pang

Recent advances in deep learning have driven rapid progress in time series forecasting, yet many state-of-the-art models continue to struggle with robust performance in real-world applications, even when they achieve strong results on…

Machine Learning · Computer Science 2025-10-24 Qitai Tan , Yiyun Chen , Mo Li , Ruiwen Gu , Yilin Su , Xiao-Ping Zhang