English
Related papers

Related papers: Position: Universal Time Series Foundation Models …

200 papers

Time series are all around in real-world applications. However, unexpected accidents for example broken sensors or missing of the signals will cause missing values in time series, making the data hard to be utilized. It then does harm to…

Machine Learning · Computer Science 2020-11-24 Chenguang Fang , Chen Wang

We analyze critical points that can be induced in glassy systems by the presence of constraints. These critical points are predicted by the Mean Field Thermodynamic approach and they are precursors of the standard glass transition in…

Statistical Mechanics · Physics 2014-04-01 Silvio Franz , Giorgio Parisi

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, including GAN,…

Machine Learning · Computer Science 2025-03-19 Jiangxuan Long , Zhao Song , Chiwun Yang

Semantic anomalies are contextually invalid or unusual combinations of familiar visual elements that can cause undefined behavior and failures in system-level reasoning for autonomous systems. This work explores semantic anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Max Peter Ronecker , Matthew Foutter , Amine Elhafsi , Daniele Gammelli , Ihor Barakaiev , Marco Pavone , Daniel Watzenig

Time series foundation models are pre-trained on large datasets and are able to achieve state-of-the-art performance in diverse tasks. However, to date, there has been limited work demonstrating how well these models perform in medical…

Machine Learning · Computer Science 2024-11-21 Mingzhu Liu , Angela H. Chen , George H. Chen

Timeseries foundation models (TSFMs) have multiplied, yet lightweight supervised baselines and even classical models often match them. We argue this gap stems from the naive importation of NLP or CV pipelines. In language and vision, large…

Machine Learning · Computer Science 2025-10-24 Arian Prabowo , Flora D. Salim

Time series anomaly detection is essential for the reliable operation of complex systems, but most existing methods require extensive task-specific training. We explore whether time series foundation models (TSFMs), pretrained on large…

Machine Learning · Computer Science 2026-01-05 Miseon Park , Kijung Yoon

Clinical time-series learning is routinely constrained by small, heterogeneous cohorts and protocol drift, while its downstream use spans both classification (e.g., pathology diagnosis) and regression (e.g., temporal forecasting). These…

Machine Learning · Computer Science 2026-05-29 Sharmita Dey , Diego Paez-Granados

Many algorithms have been recently proposed for causal machine learning. Yet, there is little to no theory on their quality, especially considering finite samples. In this work, we propose a theory based on generalization bounds that…

Machine Learning · Statistics 2024-05-16 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

Conceptual models as representations of real-world systems are based on diverse techniques in various disciplines but lack a framework that provides multidisciplinary ontological understanding of real-world phenomena. Concurrently, systems…

Software Engineering · Computer Science 2023-06-27 Sabah Al-Fedaghi

For the advancements of time series classification, scrutinizing previous studies, most existing methods adopt a common learning-to-classify paradigm - a time series classifier model tries to learn the relation between sequence inputs and…

Machine Learning · Computer Science 2024-03-20 Mingyue Cheng , Yiheng Chen , Qi Liu , Zhiding Liu , Yucong Luo

Prediction failures of machine learning models often arise from deficiencies in training data, such as incorrect labels, outliers, and selection biases. However, such data points that are responsible for a given failure mode are generally…

Machine Learning · Computer Science 2022-11-11 Ryutaro Tanno , Melanie F. Pradier , Aditya Nori , Yingzhen Li

A world model is an AI system that simulates how an environment evolves under actions, enabling planning through imagined futures rather than reactive perception. Current world models, however, suffer from visual conflation: the mistaken…

Artificial Intelligence · Computer Science 2026-01-23 Zhikang Chen , Tingting Zhu

Though deep learning has pushed the boundaries of classification forward, in recent years hints of the limits of standard classification have begun to emerge. Problems such as fooling, adding new classes over time, and the need to retrain…

Artificial Intelligence · Computer Science 2018-07-10 Navid Kardan , Kenneth O. Stanley

Going beyond correlations, the understanding and identification of causal relationships in observational time series, an important subfield of Causal Discovery, poses a major challenge. The lack of access to a well-defined ground truth for…

Machine Learning · Statistics 2021-04-19 Andrew R. Lawrence , Marcus Kaiser , Rui Sampaio , Maksim Sipos

Foundation models for time series imputation remain largely unexplored. Recently, two such models, TabPFN-TS and MoTM, have emerged. These models share a common philosophy that places them within the family of time-indexed foundation…

Machine Learning · Computer Science 2026-02-11 Etienne Le Naour , Tahar Nabil , Adrien Petralia , Ghislain Agoua

Generalization under distribution shift remains a core challenge in modern machine learning, yet existing learning bound theory is limited to narrow, idealized settings and is non-estimable from samples. In this paper, we bridge the gap…

Machine Learning · Statistics 2025-08-25 Hongbo Chen , Li Charlie Xia

Recent work has questioned the effectiveness and robustness of neural network architectures for time series forecasting tasks. We summarize these concerns and analyze groundly their inherent limitations: i.e. the irreconcilable conflict…

Machine Learning · Computer Science 2026-02-03 Qinwei Ma , Jingzhe Shi , Jiahao Qiu , Zaiwen Yang

Traditional foundation models are pre-trained on broad datasets to reduce the training resources (e.g., time, energy, labeled samples) needed for fine-tuning a wide range of downstream tasks. However, traditional foundation models struggle…

Machine Learning · Computer Science 2025-04-24 Majid Farhadloo , Arun Sharma , Mingzhou Yang , Bharat Jayaprakash , William Northrop , Shashi Shekhar

A critical failure mode of current lifelong agents is not lack of knowledge, but the inability to decide how to reason. When an agent encounters "Is this coin fair?" it must recognize whether to invoke frequentist hypothesis testing or…

Machine Learning · Computer Science 2026-03-17 Zhaohui Geoffrey Wang