English
Related papers

Related papers: FMTK: A Modular Toolkit for Composable Time Series…

200 papers

Foundation models (FMs) are a popular topic of research in AI. Their ability to generalize to new tasks and datasets without retraining or needing an abundance of data makes them an appealing candidate for applications on specialist…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Marga Don , Stijn Pinson , Blanca Guillen Cebrian , Yuki M. Asano

Foundation models have transformed natural language processing and computer vision, and a rapidly growing literature on time-series foundation models (TSFMs) seeks to replicate this success in forecasting. While recent open-source models…

Foundation Models (FMs) have revolutionized machine learning with their adaptability and high performance across tasks; yet, their integration into Federated Learning (FL) is challenging due to substantial communication overhead from their…

Machine Learning · Computer Science 2023-11-30 Vasileios Tsouvalas , Yuki Asano , Aaqib Saeed

Time series foundation models (TSFMs) have recently achieved remarkable success in universal forecasting by leveraging large-scale pretraining on diverse time series data. Complementing this progress, incorporating frequency-domain…

Machine Learning · Computer Science 2026-04-14 Shunyu Wu , Jiawei Huang , Weibin Feng , Boxin Li , Xiao Zhang , Erli Meng , Dan Li , Jian Lou , See-Kiong Ng

Time series foundation models (TSFMs) promise to be powerful tools for a wide range of applications. However, their internal representations and learned concepts are still not well understood. In this study, we investigate the structure and…

Machine Learning · Computer Science 2025-06-09 Michał Wiliński , Mononito Goswami , Willa Potosnak , Nina Żukowska , Artur Dubrawski

Foundational models (FMs), pretrained on extensive datasets using self-supervised techniques, are capable of learning generalized patterns from large amounts of data. This reduces the need for extensive labeled datasets for each new task,…

Machine Learning · Computer Science 2024-06-19 Quan M. Tran , Suong N. Hoang , Lam M. Nguyen , Dzung Phan , Hoang Thanh Lam

Spatio-temporal deep learning models aims to utilize useful patterns in such data to support tasks like prediction. However, previous deep learning models designed for specific tasks typically require separate training for each use case,…

Time Series Forecasting (TSF) has long been a challenge in time series analysis. Inspired by the success of Large Language Models (LLMs), researchers are now developing Large Time Series Models (LTSMs)-universal transformer-based models…

Time series foundation models (TSFMs) have become increasingly popular for zero-shot forecasting. However, for a new time series domain not fully covered by the pretraining set, performance can suffer. Therefore, when a practitioner cares…

Machine Learning · Computer Science 2026-03-04 Thomas L. Lee , Edoardo M. Ponti , Amos Storkey

Advancements in foundation models (FMs) have led to a paradigm shift in machine learning. The rich, expressive feature representations from these pre-trained, large-scale FMs are leveraged for multiple downstream tasks, usually via…

Machine Learning · Computer Science 2024-12-19 Jihye Choi , Jayaram Raghuram , Yixuan Li , Somesh Jha

Modeling stochastic and irregularly sampled time series is a challenging problem found in a wide range of applications, especially in medicine. Neural stochastic differential equations (Neural SDEs) are an attractive modeling technique for…

Machine Learning · Computer Science 2025-02-05 Xi Zhang , Yuan Pu , Yuki Kawamura , Andrew Loza , Yoshua Bengio , Dennis L. Shung , Alexander Tong

Time series forecasting (TSF) possesses great practical values in various fields, including power and energy, transportation, etc. TSF methods have been studied based on knowledge from classical statistics to modern deep learning. Yet, all…

Machine Learning · Computer Science 2025-10-27 Luoxiao Yang , Yun Wang , Xinqi Fan , Israel Cohen , Jingdong Chen , Zijun Zhang

Time-series foundation models (TSFMs) achieve strong forecast accuracy, yet accuracy alone does not determine practical value. The form of a forecast -- point, quantile, parametric, or trajectory ensemble -- fundamentally constrains which…

Machine Learning · Computer Science 2025-10-23 Alvaro Perez-Diaz , James C. Loach , Danielle E. Toutoungi , Lee Middleton

The diversity of time series applications and scarcity of domain-specific data highlight the need for time-series models with strong few-shot learning capabilities. In this work, we propose a novel training scheme and a transformer-based…

Machine Learning · Computer Science 2025-02-25 Ege Onur Taga , M. Emrullah Ildiz , Samet Oymak

The recent boom of large pre-trained models witnesses remarkable success in developing foundation models (FMs) for time series forecasting. Despite impressive performance across diverse downstream forecasting tasks, existing time series FMs…

Machine Learning · Computer Science 2025-10-23 Hui He , Kun Yi , Yuanchi Ma , Qi Zhang , Zhendong Niu , Guansong Pang

Time series reasoning is crucial to decision-making in diverse domains, including finance, energy usage, traffic, weather, and scientific discovery. While existing time series foundation models (TSFMs) can capture low-level dynamic patterns…

Computation and Language · Computer Science 2025-10-07 Fangxu Yu , Hongyu Zhao , Tianyi Zhou

Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to TSFM performance,…

Machine Learning · Computer Science 2026-03-11 Shunyu Wu , Tianyue Li , Yixuan Leng , Jingyi Suo , Jian Lou , Dan Li , See-Kiong Ng

Building energy management (BEM) tasks require processing and learning from a variety of time-series data. Existing solutions rely on bespoke task- and data-specific models to perform these tasks, limiting their broader applicability.…

Machine Learning · Computer Science 2025-06-16 Ozan Baris Mulayim , Pengrui Quan , Liying Han , Xiaomin Ouyang , Dezhi Hong , Mario Bergés , Mani Srivastava

Similarity-based approaches represent a promising direction for time series analysis. However, many such methods rely on parameter tuning, and some have shortcomings if the time series are multivariate (MTS), due to dependencies between…

Machine Learning · Statistics 2017-06-30 Karl Øyvind Mikalsen , Filippo Maria Bianchi , Cristina Soguero-Ruiz , Robert Jenssen

This system paper documents the technical foundations for the extension of the Topology ToolKit (TTK) to distributed-memory parallelism with the Message Passing Interface (MPI). While several recent papers introduced topology-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-16 Eve Le Guillou , Michael Will , Pierre Guillou , Jonas Lukasczyk , Pierre Fortin , Christoph Garth , Julien Tierny