English
Related papers

Related papers: Evaluating Time Series Foundation Models on Noisy …

200 papers

Time Series Foundation Models (TSFMs) leverage extensive pretraining to accurately predict unseen time series during inference, without the need for task-specific fine-tuning. Through large-scale evaluations on standard benchmarks, we find…

Machine Learning · Computer Science 2026-02-03 Anthony Bao , Venkata Hasith Vattikuti , Jeffrey Lai , William Gilpin

Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation…

Machine Learning · Computer Science 2024-11-01 Abhimanyu Das , Matthew Faw , Rajat Sen , Yichen Zhou

Existing data-driven methods rely on the extraction of static features from time series to approximate the material removal rate (MRR) of semiconductor manufacturing processes such as chemical mechanical polishing (CMP). However, this leads…

Machine Learning · Computer Science 2025-12-08 Jonathan Adam Rico , Nagarajan Raghavan , Senthilnath Jayavelu

Time series foundation models (TSFMs) are widely used as generic feature extractors, yet the notion of non-stationarity in their embedding spaces remains poorly understood. Recent work often conflates non-stationarity with distribution…

Machine Learning · Computer Science 2026-04-21 Jinmyeong Choi , Brad Shook , Artur Dubrawski

Considering the difficulty of financial time series forecasting in financial aid, much of the current research focuses on leveraging big data analytics in financial services. One modern approach is to utilize "predictive analysis",…

Machine Learning · Computer Science 2024-10-28 Md Khairul Islam , Ayush Karmacharya , Timothy Sue , Judy Fox

Over the past years, foundation models have caused a paradigm shift in machine learning due to their unprecedented capabilities for zero-shot and few-shot generalization. However, despite the success of foundation models in modalities such…

The development of tabular foundation models (TFMs) has accelerated in recent years, showing strong potential to outperform traditional ML methods for structured data. A key finding is that TFMs can be pretrained entirely on synthetic…

Machine Learning · Computer Science 2025-12-04 Matthew Peroni , Franck Le , Vadim Sheinin

We study the performance of transformer architectures for multivariate time-series forecasting in low-data regimes consisting of only a few years of daily observations. Using synthetically generated processes with known temporal and…

Machine Learning · Computer Science 2026-02-11 Cyril Garcia , Guillaume Remy

A foundation model is a machine learning model trained on a large and diverse set of data, typically using self-supervised learning-based pre-training techniques, that can be adapted to various downstream tasks. However, current research on…

Recently, time series foundation models have shown promising zero-shot forecasting performance on time series from a wide range of domains. However, it remains unclear whether their success stems from a true understanding of temporal…

Machine Learning · Computer Science 2024-11-12 Willa Potosnak , Cristian Challu , Mononito Goswami , Michał Wiliński , Nina Żukowska , Artur Dubrawski

Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to TSFM performance,…

Machine Learning · Computer Science 2026-03-11 Shunyu Wu , Tianyue Li , Yixuan Leng , Jingyi Suo , Jian Lou , Dan Li , See-Kiong Ng

The advancement of Time Series Foundation Models (TSFMs) has been driven primarily by large-scale pre-training, but inference-time compute potential remains largely untapped. This work systematically investigates two questions: how do TSFMs…

Machine Learning · Computer Science 2026-01-27 Ruijin Hua , Zichuan Liu , Kun Zhang , Yiyuan Yang

The explosion of Time Series (TS) data, driven by advancements in technology, necessitates sophisticated analytical methods. Modern management systems increasingly rely on analyzing this data, highlighting the importance of effcient…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang

While anomaly detection in time series has been an active area of research for several years, most recent approaches employ an inadequate evaluation criterion leading to an inflated F1 score. We show that a rudimentary Random Guess method…

Machine Learning · Computer Science 2022-03-11 Keval Doshi , Shatha Abudalou , Yasin Yilmaz

Deep Learning has been successfully applied to many application domains, yet its advantages have been slow to emerge for time series forecasting. For example, in the well-known Makridakis (M) Competitions, hybrids of traditional statistical…

Machine Learning · Computer Science 2024-01-26 John A. Miller , Mohammed Aldosari , Farah Saeed , Nasid Habib Barna , Subas Rana , I. Budak Arpinar , Ninghao Liu

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Machine Learning · Computer Science 2025-08-15 Luca-Andrei Fechete , Mohamed Sana , Fadhel Ayed , Nicola Piovesan , Wenjie Li , Antonio De Domenico , Tareq Si Salem

Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years. As a classic machine learning task, time series forecasting has recently been boosted by LLMs. Recent works treat large language…

Computation and Language · Computer Science 2024-12-31 Hua Tang , Chong Zhang , Mingyu Jin , Qinkai Yu , Zhenting Wang , Xiaobo Jin , Yongfeng Zhang , Mengnan Du

Periodicity is a fundamental characteristic of time series data and has long played a central role in forecasting. Recent deep learning methods strengthen the exploitation of periodicity by treating patches as basic tokens, thereby…

Machine Learning · Computer Science 2025-10-07 Yiming Niu , Jinliang Deng , Yongxin Tong

Time Series Forecasting plays a crucial role in various fields such as industrial equipment maintenance, meteorology, energy consumption, traffic flow and financial investment. However, despite their considerable advantages over traditional…

Machine Learning · Computer Science 2024-07-02 Ruiqi Li , Maowei Jiang , Kai Wang , Kaiduo Feng , Quangao Liu , Yue Sun , Xiufang Zhou

Deep learning has shown strong performance in time series forecasting tasks. However, issues such as missing values and anomalies in sequential data hinder its further development in prediction tasks. Previous research has primarily focused…

Machine Learning · Computer Science 2025-12-17 Hua Wang , Jinghao Lu , Fan Zhang