English
Related papers

Related papers: TOTEM: TOkenized Time Series EMbeddings for Genera…

200 papers

Handling missing data in time series classification remains a significant challenge in various domains. Traditional methods often rely on imputation, which may introduce bias or fail to capture the underlying temporal dynamics. In this…

Machine Learning · Computer Science 2026-04-03 YongKyung Oh , Dong-Young Lim , Sungil Kim , Alex Bui

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series…

Machine Learning · Computer Science 2025-09-09 Yihang Wang , Yuying Qiu , Peng Chen , Kai Zhao , Yang Shu , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Foundation models have achieved remarkable success across diverse machine-learning domains through large-scale pretraining on large, diverse datasets. However, pretraining on such datasets introduces significant challenges due to…

Machine Learning · Computer Science 2025-04-16 Peiliang Gong , Emadeldeen Eldele , Min Wu , Zhenghua Chen , Xiaoli Li , Daoqiang Zhang

Time series foundation models have shown impressive performance on a variety of tasks, across a wide range of domains, even in zero-shot settings. However, most of these models are designed to handle short univariate time series as an…

Machine Learning · Computer Science 2024-09-23 Nina Żukowska , Mononito Goswami , Michał Wiliński , Willa Potosnak , Artur Dubrawski

Generative modeling of time series is a central challenge in time series analysis, particularly under data-scarce conditions. Despite recent advances in generative modeling, a comprehensive understanding of how state-of-the-art generative…

Machine Learning · Computer Science 2025-05-28 Tal Gonen , Itai Pemper , Ilan Naiman , Nimrod Berman , Omri Azencot

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation…

Machine Learning · Computer Science 2024-11-01 Abhimanyu Das , Matthew Faw , Rajat Sen , Yichen Zhou

Building energy management (BEM) tasks require processing and learning from a variety of time-series data. Existing solutions rely on bespoke task- and data-specific models to perform these tasks, limiting their broader applicability.…

Machine Learning · Computer Science 2025-06-16 Ozan Baris Mulayim , Pengrui Quan , Liying Han , Xiaomin Ouyang , Dezhi Hong , Mario Bergés , Mani Srivastava

Time Series Forecasting (TSF) is key functionality in numerous fields, such as financial investment, weather services, and energy management. Although increasingly capable TSF methods occur, many of them require domain-specific data…

Machine Learning · Computer Science 2025-06-13 Zhe Li , Xiangfei Qiu , Peng Chen , Yihang Wang , Hanyin Cheng , Yang Shu , Jilin Hu , Chenjuan Guo , Aoying Zhou , Christian S. Jensen , Bin Yang

Tokenization and transfer learning are two critical components in building state of the art time series foundation models for forecasting. In this work, we systematically study the effect of tokenizer design, specifically scaling and…

Machine Learning · Computer Science 2025-11-18 Alexis Roger , Gwen Legate , Kashif Rasul , Yuriy Nevmyvaka , Irina Rish

Multi-modal large language models (MLLMs) have enabled numerous advances in understanding and reasoning in domains like vision, but we have not yet seen this broad success for time-series. Although prior works on time-series MLLMs have…

Machine Learning · Computer Science 2024-12-05 Winnie Chow , Lauren Gardiner , Haraldur T. Hallgrímsson , Maxwell A. Xu , Shirley You Ren

Time series forecasting plays a vital role in supporting decision-making across a wide range of critical applications, including energy, healthcare, and finance. Despite recent advances, forecasting accuracy remains limited due to the…

Machine Learning · Computer Science 2025-08-14 Xiaoyu Tao , Shilong Zhang , Mingyue Cheng , Daoyu Wang , Tingyue Pan , Bokai Pan , Changqing Zhang , Shijin Wang

While large language models have rapidly evolved towards general artificial intelligence, their versatility in analyzing time series data remains limited. To address this limitation, we propose a novel normalization technique that considers…

Machine Learning · Computer Science 2025-02-11 Janghoon Yang

We introduce Chronos, a simple yet effective framework for pretrained probabilistic time series models. Chronos tokenizes time series values using scaling and quantization into a fixed vocabulary and trains existing transformer-based…

Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions:…

Modeling large-scale time series has gained significant attention in recent years. However, its direct application in finance remains challenging due to substantial differences in data characteristics across domains. Specifically, financial…

Artificial Intelligence · Computer Science 2025-10-22 Yuanjian Xu , Anxian Liu , Jianing Hao , Zhenzhuo Li , Shichang Meng , Guang Zhang

Despite recent progress in time-series foundation models, challenges persist in improving representation learning and adapting to diverse downstream tasks. We introduce a General Time-series Model (GTM), which advances representation…

Machine Learning · Computer Science 2026-03-13 Cheng He , Xu Huang , Gangwei Jiang , Zhaoyi Li , Defu Lian , Hong Xie , Enhong Chen , Xijie Liang , Zengrong Zheng , Patrick P. C. Lee

Time series foundation models are pre-trained on large datasets and are able to achieve state-of-the-art performance in diverse tasks. However, to date, there has been limited work demonstrating how well these models perform in medical…

Machine Learning · Computer Science 2024-11-21 Mingzhu Liu , Angela H. Chen , George H. Chen

Foundation Models are designed to serve as versatile embedding machines, with strong zero shot capabilities and superior generalization performance when fine-tuned on diverse downstream tasks. While this is largely true for language and…

Machine Learning · Computer Science 2025-10-08 Nouha Karaouli , Denis Coquenet , Elisa Fromont , Martial Mermillod , Marina Reyboz

Time series foundation models excel in zero-shot forecasting, handling diverse tasks without explicit training. However, the advancement of these models has been hindered by the lack of comprehensive benchmarks. To address this gap, we…

Machine Learning · Computer Science 2024-11-12 Taha Aksu , Gerald Woo , Juncheng Liu , Xu Liu , Chenghao Liu , Silvio Savarese , Caiming Xiong , Doyen Sahoo