English
Related papers

Related papers: A Comparative Study on How Data Normalization Affe…

200 papers

Time Series Foundation Models (TSFMs) represent a new paradigm for time-series forecasting, promising zero-shot predictions without the need for task-specific training or fine-tuning. However, similar to Large Language Models (LLMs), the…

Machine Learning · Computer Science 2026-02-26 Marcel Meyer , Sascha Kaltenpoth , Kevin Zalipski , Oliver Müller

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Decision-making in building energy systems critically depends on the predictive accuracy of relevant time-series models. In scenarios lacking extensive data from a target building, foundation models (FMs) represent a promising technology…

Advances in time-series forecasting are driving a shift from conventional machine learning models to foundation models (FMs) that are trained with generalized knowledge. However, existing FMs still perform poorly in the energy fields, such…

Machine Learning · Computer Science 2024-12-24 Rui Liang , Yang Deng , Donghua Xie , Fang He , Dan Wang

Normalization and scaling are fundamental preprocessing steps in time series modeling, yet their role in Transformer-based models remains underexplored from a theoretical perspective. In this work, we present the first formal analysis of…

Machine Learning · Computer Science 2026-02-20 Sofiane Ennadir , Tianze Wang , Oleg Smirnov , Sahar Asadi , Lele Cao

Time-Series Foundation Models (TSFMs) are rapidly transitioning from research prototypes to core components of critical decision-making systems, driven by their impressive zero-shot forecasting capabilities. However, as their deployment…

Machine Learning · Computer Science 2025-12-09 Jiawen Zhang , Zhenwei Zhang , Shun Zheng , Xumeng Wen , Jia Li , Jiang Bian

Time Series Foundation Models (TSFMs) advance generalization and data efficiency in time series forecasting by unified large-scale pretraining. But TSFMs remain lacking when adapting to specific downstream forecasting tasks for two reasons.…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Siyang Li , Yize Chen , Zijie Zhu , Yuxin Pan , Yan Guo , Ming Huang , Hui Xiong

A State Space Model (SSM) is a foundation model in time series analysis, which has recently been shown as an alternative to transformers in sequence modeling. In this paper, we theoretically study the generalization of SSMs and propose…

Machine Learning · Computer Science 2024-05-07 Fusheng Liu , Qianxiao Li

Multi-task and few-shot time series forecasting tasks are commonly encountered in scenarios such as the launch of new products in different cities. However, traditional time series forecasting methods suffer from insufficient historical…

Machine Learning · Computer Science 2025-06-25 Pengpeng Ouyang , Dong Chen , Tong Yang , Shuo Feng , Zhao Jin , Mingliang Xu

The ability to generalize to unseen domains is crucial for machine learning systems deployed in the real world, especially when we only have data from limited training domains. In this paper, we propose a simple and effective regularization…

Machine Learning · Computer Science 2023-12-06 Zhenmei Shi , Yifei Ming , Ying Fan , Frederic Sala , Yingyu Liang

Learning time series foundation models has been shown to be a promising approach for zero-shot time series forecasting across diverse time series domains. Insofar as scaling has been a critical driver of performance of foundation models in…

Machine Learning · Computer Science 2026-02-20 Xinghong Fu , Yanhong Li , Georgios Papaioannou , Yoon Kim

Understanding alignment techniques begins with comprehending zero-shot generalization brought by instruction tuning, but little of the mechanism has been understood. Existing work has largely been confined to the task level, without…

Computation and Language · Computer Science 2025-04-08 Bingxiang He , Ning Ding , Cheng Qian , Jia Deng , Ganqu Cui , Lifan Yuan , Haiwen Hong , Huan-ang Gao , Longtao Huang , Hui Xue , Huimin Chen , Zhiyuan Liu , Maosong Sun

The proliferation of Time Series Foundation Models (TSFMs) has significantly advanced zero-shot forecasting, enabling predictions for unseen time series without task-specific fine-tuning. Extensive research has confirmed that no single TSFM…

Machine Learning · Computer Science 2025-09-26 Hao-Nan Shi , Ting-Ji Huang , Lu Han , De-Chuan Zhan , Han-Jia Ye

The zero-shot evaluation of time series foundation models (TSFMs) for classification typically uses a frozen encoder followed by a task-specific classifier. However, this practice violates the training-free premise of zero-shot deployment…

Machine Learning · Computer Science 2026-02-03 Juntao Fang , Shifeng Xie , Shengbin Nie , Yuhui Ling , Yuming Liu , Zijian Li , Keli Zhang , Lujia Pan , Themis Palpanas , Ruichu Cai

Foundation Models (FMs) have shown impressive performance on various text and image processing tasks. They can generalize across domains and datasets in a zero-shot setting. This could make them suitable for automated quality inspection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Simon Baeuerle , Pratik Khanna , Nils Friederich , Angelo Jovin Yamachui Sitcheu , Damir Shakirov , Andreas Steimer , Ralf Mikut

Time series anomaly detection is essential for the reliable operation of complex systems, but most existing methods require extensive task-specific training. We explore whether time series foundation models (TSFMs), pretrained on large…

Machine Learning · Computer Science 2026-01-05 Miseon Park , Kijung Yoon

For time series arising from latent dynamical systems, existing cross-domain generalization methods commonly assume that samples are comparably meaningful within a shared representation space. In real-world settings, however, different…

Machine Learning · Computer Science 2026-03-04 Jinyang Li , Shuhao Mei , Xiaoyu Xiao , Shuhang Li , Ruoxi Yun , Jinbo Sun

Graph foundation models (GFMs) have recently emerged as a promising paradigm for achieving broad generalization across various graph data. However, existing GFMs are often trained on datasets that may not fully reflect real-world graphs,…

Machine Learning · Computer Science 2025-10-10 Adrian Hayler , Xingyue Huang , İsmail İlkan Ceylan , Michael Bronstein , Ben Finkelshtein

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. FMs are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series domains,…

Machine Learning · Computer Science 2025-05-20 William Toner , Thomas L. Lee , Artjom Joosen , Rajkarn Singh , Martin Asenov

Fast spin-echo (FSE) pulse sequences for Magnetic Resonance Imaging (MRI) offer important imaging contrast in clinically feasible scan times. T2-shuffling is widely used to resolve temporal signal dynamics in FSE acquisitions by exploiting…

Image and Video Processing · Electrical Eng. & Systems 2023-03-07 Molin Zhang , Junshen Xu , Yamin Arefeen , Elfar Adalsteinsson