English
Related papers

Related papers: Estimating Time Series Foundation Model Transferab…

200 papers

Test-time training (TTT) enhances model performance by explicitly updating designated parameters prior to each prediction to adapt to the test data. While TTT has demonstrated considerable empirical success, its theoretical underpinnings…

Machine Learning · Statistics 2026-02-03 Kento Kuwataka , Taiji Suzuki

Time series analysis stands as a focal point within the data mining community, serving as a cornerstone for extracting valuable insights crucial to a myriad of real-world applications. Recent advances in Foundation Models (FMs) have…

Machine Learning · Computer Science 2024-06-19 Yuxuan Liang , Haomin Wen , Yuqi Nie , Yushan Jiang , Ming Jin , Dongjin Song , Shirui Pan , Qingsong Wen

Time series foundation models (TSFMs) have shown strong results on public benchmarks, prompting comparisons to a "BERT moment" for time series. Their effectiveness in industrial settings, however, remains uncertain. We examine why TSFMs…

Language models (LMs) have shown impressive performance on tasks within their training distribution, but often struggle with structurally novel tasks even when given a small number of in-context task examples. We investigate the…

Artificial Intelligence · Computer Science 2025-03-26 Ekin Akyürek , Mehul Damani , Adam Zweiger , Linlu Qiu , Han Guo , Jyothish Pari , Yoon Kim , Jacob Andreas

Deep conditional generative models are developed to simultaneously learn the temporal dependencies of multiple sequences. The model is designed by introducing a three-way weight tensor to capture the multiplicative interactions between side…

Machine Learning · Statistics 2016-05-24 Jiaming Song , Zhe Gan , Lawrence Carin

Time series forecasting is essential for operational intelligence in the hospitality industry, and particularly challenging in large-scale, distributed systems. This study evaluates the performance of statistical, machine learning (ML),…

Machine Learning · Computer Science 2025-02-06 Issar Arab , Rodrigo Benitez

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Financial time-series forecasting is critical for maintaining economic stability, guiding informed policymaking, and promoting sustainable investment practices. However, it remains challenging due to various underlying pattern shifts. These…

Machine Learning · Computer Science 2025-08-28 Zhuohang Zhu , Haodong Chen , Qiang Qu , Vera Chung

Over the past decade, Time Series Classification (TSC) has gained an increasing attention. While various methods were explored, deep learning - particularly through Convolutional Neural Networks (CNNs)-stands out as an effective approach.…

Machine Learning · Computer Science 2024-02-29 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

Foundation models (FMs) have emerged as a powerful paradigm, enabling a diverse range of data analytics and knowledge discovery tasks across scientific fields. Inspired by the success of FMs, particularly large language models, researchers…

Machine Learning · Computer Science 2025-11-27 Sean Bin Yang , Ying Sun , Yunyao Cheng , Yan Lin , Kristian Torp , Jilin Hu

Time-Series Foundation Models (TSFMs) excel at zero-shot unimodal forecasting using numerical data, but unlike LLMs they cannot consume multimodal, non-numerical context that often shape real-world trajectories. In this work, we bridge this…

Machine Learning · Computer Science 2026-05-29 Haoxin Liu , Yichen Zhou , Rajat Sen , B. Aditya Prakash , Abhimanyu Das

Modern IoT deployments for environmental sensing produce high volume spatiotemporal data to support downstream tasks such as forecasting, typically powered by machine learning models. While existing filtering and strategic deployment…

Machine Learning · Computer Science 2025-12-02 Ragini Gupta , Naman Raina , Bo Chen , Li Chen , Claudiu Danilov , Josh Eckhardt , Keyshla Bernard , Klara Nahrstedt

We present Tiny-TSM, a time series foundation model characterized by small scale, economical training, and state-of-the-art performance. It comprises 23M total parameters, trained on a single A100 GPU in less than a week using a new…

Machine Learning · Computer Science 2025-11-25 Felix Birkel

Can meta-learning discover generic ways of processing time series (TS) from a diverse dataset so as to greatly improve generalization on new TS coming from different datasets? This work provides positive evidence to this using a broad…

Machine Learning · Computer Science 2020-12-16 Boris N. Oreshkin , Dmitri Carpov , Nicolas Chapados , Yoshua Bengio

Transformer-based methods have achieved state-of-the-art performance in time series forecasting (TSF) by capturing positional and semantic topological relationships among input tokens. However, it remains unclear whether existing…

Artificial Intelligence · Computer Science 2025-10-27 Jianqi Zhang , Wenwen Qiang , Jingyao Wang , Jiahuan Zhou , Changwen Zheng , Hui Xiong

Many scientific fields, from medicine to seismology, rely on analyzing sequences of events over time to understand complex systems. Traditionally, machine learning models must be built and trained from scratch for each new dataset, which is…

Machine Learning · Computer Science 2026-01-21 David Berghaus , Patrick Seifner , Kostadin Cvejoski , Ramses J. Sanchez

Recent years have witnessed a growing interest for time series foundation models, with a strong emphasis on the forecasting task. Yet, the crucial task of out-of-domain imputation of missing values remains largely underexplored. We propose…

Machine Learning · Computer Science 2025-11-11 Etienne Le Naour , Tahar Nabil , Ghislain Agoua

Foundation medical segmentation models, with MedSAM being the most popular, have achieved promising performance across organs and lesions. However, MedSAM still suffers from compromised performance on specific lesions with intricate…

Quantitative Methods · Quantitative Biology 2025-07-16 Kecheng Chen , Xinyu Luo , Tiexin Qin , Jie Liu , Hui Liu , Victor Ho Fun Lee , Hong Yan , Haoliang Li

Accurate forecasting of sequential data streams is a cornerstone of modern Web services, supporting applications such as traffic management, user behavior modeling, and online anomaly prevention. However, in many Web environments, new…

Machine Learning · Computer Science 2026-02-02 Shichao Ma , Zhengyang Zhou , Qihe Huang , Binwu Wang , Yang Wang

Time series foundation models (TSFMs) are increasingly being adopted as highly-capable general-purpose time series representation learners. Although their training corpora are vast, they exclude astronomical time series data. Observations…

Solar and Stellar Astrophysics · Physics 2026-02-19 Weijian Li , Hong-Yu Chen , Nabeel Rehemtulla , Ved G. Shah , Dennis Wu , Dongho Kim , Qinjie Lin , Adam A. Miller , Han Liu