English
Related papers

Related papers: Position: Universal Time Series Foundation Models …

200 papers

Access to the time-reverse $U^{-1}$ of an unknown quantum unitary process $U$ is widely assumed in quantum learning, metrology, and many-body physics. The fundamental task of unitary time-reversal dictates implementing $U^{-1}$ to within…

Quantum Physics · Physics 2026-02-24 Kean Chen , Nengkun Yu , Zhicheng Zhang

Domain-specific foundation models for healthcare have expanded rapidly in recent years, yet foundation models for critical care time series remain relatively underexplored due to the limited size and availability of datasets. In this work,…

Machine Learning · Computer Science 2025-09-25 Katja Naasunnguaq Jagd , Rachael DeVries , Ole Winther

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

Time series anomaly detection has been a perennially important topic in data science, with papers dating back to the 1950s. However, in recent years there has been an explosion of interest in this topic, much of it driven by the success of…

Machine Learning · Computer Science 2022-09-07 Renjie Wu , Eamonn J. Keogh

We study adaptive pooling under predictive heterogeneity in high-dimensional multivariate time series forecasting, where global models improve statistical efficiency but may fail to capture heterogeneous predictive structure, while naive…

Methodology · Statistics 2026-04-16 Ziling Ma , Ángel López Oriona , Hernando Ombao , Ying Sun

In recent years, specific evaluation metrics for time series anomaly detection algorithms have been developed to handle the limitations of the classical precision and recall. However, such metrics are heuristically built as an aggregate of…

Machine Learning · Computer Science 2022-10-13 Alexis Huet , Jose Manuel Navarro , Dario Rossi

Foundation models have achieved remarkable success across diverse machine-learning domains through large-scale pretraining on large, diverse datasets. However, pretraining on such datasets introduces significant challenges due to…

Machine Learning · Computer Science 2025-04-16 Peiliang Gong , Emadeldeen Eldele , Min Wu , Zhenghua Chen , Xiaoli Li , Daoqiang Zhang

Large Language Models (LLMs) achieve strong performance through extended inference-time deliberation, yet how their reasoning failures arise remains poorly understood. By analyzing model-generated reasoning trajectories, we find that errors…

Artificial Intelligence · Computer Science 2026-04-17 Wei Zhu , Jian Zhang , Lixing Yu , Kun Yue , Zhiwen Tang

Cross-domain generalization is very important in Time Series Forecasting because similar historical information may lead to distinct future trends due to the domain-specific characteristics. Recent works focus on building unimodal time…

Machine Learning · Computer Science 2026-03-10 Xingjian Wu , Jianxin Jin , Wanghui Qiu , Peng Chen , Yang Shu , Bin Yang , Chenjuan Guo

Deep neural networks generalize well despite being heavily overparameterized, in apparent contradiction with classical learning theory based on uniform convergence over fixed hypothesis spaces. Uniform bounds over the entire parameter space…

Machine Learning · Statistics 2026-05-15 Hubert Leroux , Jean Marcus , Julien Roger

The current state of machine learning scholarship in Timeseries Anomaly Detection (TAD) is plagued by the persistent use of flawed evaluation metrics, inconsistent benchmarking practices, and a lack of proper justification for the choices…

Machine Learning · Computer Science 2024-06-06 M. Saquib Sarfraz , Mei-Yen Chen , Lukas Layer , Kunyu Peng , Marios Koulakis

Time Series Foundation Models (TSFMs) have achieved remarkable success through large-scale pretraining. However, their design primarily targets real-valued series, limiting their ability to handle general forecasting tasks involving diverse…

Machine Learning · Computer Science 2026-03-25 Lu Han , Yu Liu , Lan Li , Qiwen Deng , Jian Jiang , Yinbo Sun , Zhe Yu , Binfeng Wang , Xingyu Lu , Lintao Ma , Han-Jia Ye , De-Chuan Zhan

Foundation models are revolutionizing autonomous driving perception, transitioning the field from narrow, task-specific deep learning models to versatile, general-purpose architectures trained on vast, diverse datasets. This survey examines…

Robotics · Computer Science 2025-09-11 Rajendramayavan Sathyam , Yueqi Li

Time series forecasting is a fundamental tool with wide ranging applications, yet recent debates question whether complex nonlinear architectures truly outperform simple linear models. Prior claims of dominance of the linear model often…

Machine Learning · Computer Science 2026-02-13 Md Rakibul Haque , Vishwa Goudar , Shireen Elhabian , Warren Woodrich Pettine

Time series anomaly detection is usually formulated as finding outlier data points relative to some usual data, which is also an important problem in industry and academia. To ensure systems working stably, internet companies, banks and…

Machine Learning · Computer Science 2018-12-24 Zhang Rong , Dong Shandong , Nie Xin , Xiao Shiguang

We survey applications of pretrained foundation models in robotics. Traditional deep learning models in robotics are trained on small datasets tailored for specific tasks, which limits their adaptability across diverse applications. In…

We propose a framework which generalizes "decision making with structured observations" by allowing robust (i.e. multivalued) models. In this framework, each model associates each decision with a convex set of probability distributions over…

Machine Learning · Computer Science 2025-06-27 Alexander Appel , Vanessa Kosoy

When applied sequentially to video, frame-based networks often exhibit temporal inconsistency - for example, outputs that flicker between frames. This problem is amplified when the network inputs contain time-varying corruptions. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Matthew Dutson , Nathan Labiosa , Yin Li , Mohit Gupta

Forecasting groups of time series is of increasing practical importance, e.g. forecasting the demand for multiple products offered by a retailer or server loads within a data center. The local approach to this problem considers each time…

Machine Learning · Computer Science 2021-03-30 Pablo Montero-Manso , Rob J Hyndman

This work studies the problem of time series analysis with generalist (or foundation) models, which are models trained across many data domains. Drawing inspiration from the widespread success of large language models, we consider the…

Machine Learning · Computer Science 2025-01-03 Sabera Talukder , Yisong Yue , Georgia Gkioxari