English
Related papers

Related papers: Foundation Models for Time Series Analysis: A Tuto…

200 papers

Effective utilization of time series data is often constrained by the scarcity of data quantity that reflects complex dynamics, especially under the condition of distributional shifts. Existing datasets may not encompass the full range of…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Haibei Zhu , Yousef El-Laham , Elizabeth Fons , Svitlana Vyetrenko

Brain foundation models (BFMs) have emerged as a transformative paradigm in computational neuroscience, offering a revolutionary framework for processing diverse neural signals across different brain-related tasks. These models leverage…

Machine Learning · Computer Science 2025-07-22 Xinliang Zhou , Chenyu Liu , Zhisheng Chen , Kun Wang , Yi Ding , Ziyu Jia , Qingsong Wen

While recent advancements in foundation models have significantly impacted machine learning, rigorous tests on the performance of time series foundation models (TSFMs) remain largely underexplored. This paper presents an empirical study…

Machine Learning · Computer Science 2025-01-09 Syamantak Datta Gupta

The zero-shot capabilities of foundation models (FMs) for time series forecasting offer promising potentials in conformal prediction, as most of the available data can be allocated to calibration. This study compares the performance of Time…

Machine Learning · Computer Science 2025-07-15 Sami Achour , Yassine Bouher , Duong Nguyen , Nicolas Chesneau

Driven by the transition towards a climate-neutral energy system, accurate energy time series forecasting is critical for planning and operation. Yet, it remains largely a dataset-specific task, requiring comprehensive training data,…

Machine Learning · Computer Science 2026-04-27 Marco Obermeier , Marco Pruckner , Florian Haselbeck , Andreas Zeiselmair

Time series foundational models (TSFM) have gained prominence in time series forecasting, promising state-of-the-art performance across various applications. However, their application in anomaly detection and prediction remains…

Machine Learning · Computer Science 2024-12-30 Chathurangi Shyalika , Harleen Kaur Bagga , Ahan Bhatt , Renjith Prasad , Alaa Al Ghazo , Amit Sheth

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Time series analysis has become crucial in various fields, from engineering and finance to healthcare and social sciences. Due to their multidimensional nature, time series often need to be embedded into a fixed-dimensional feature space to…

Machine Learning · Computer Science 2025-05-27 Habib Irani , Yasamin Ghahremani , Arshia Kermani , Vangelis Metsis

Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent…

Databases · Computer Science 2025-03-19 Yuxuan Liang , Haomin Wen , Yutong Xia , Ming Jin , Bin Yang , Flora Salim , Qingsong Wen , Shirui Pan , Gao Cong

Transformers have achieved superior performances in many tasks in natural language processing and computer vision, which also triggered great interest in the time series community. Among multiple advantages of Transformers, the ability to…

Machine Learning · Computer Science 2023-05-15 Qingsong Wen , Tian Zhou , Chaoli Zhang , Weiqi Chen , Ziqing Ma , Junchi Yan , Liang Sun

Foundational models (FMs), pretrained on extensive datasets using self-supervised techniques, are capable of learning generalized patterns from large amounts of data. This reduces the need for extensive labeled datasets for each new task,…

Machine Learning · Computer Science 2024-06-19 Quan M. Tran , Suong N. Hoang , Lam M. Nguyen , Dzung Phan , Hoang Thanh Lam

The advent of foundation models (FMs) as an emerging suite of AI techniques has struck a wave of opportunities in computational healthcare. The interactive nature of these models, guided by pre-training data and human instructions, has…

Machine Learning · Computer Science 2026-04-30 Yunkun Zhang , Jin Gao , Zheling Tan , Lingfeng Zhou , Kexin Ding , Mu Zhou , Shaoting Zhang , Dequan Wang

Time series data is a collection of chronological observations which is generated by several domains such as medical and financial fields. Over the years, different tasks such as classification, forecasting, and clustering have been…

Machine Learning · Computer Science 2021-02-12 Raha Moraffah , Paras Sheth , Mansooreh Karami , Anchit Bhattacharya , Qianru Wang , Anique Tahir , Adrienne Raglin , Huan Liu

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. FMs are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series domains,…

Machine Learning · Computer Science 2025-05-20 William Toner , Thomas L. Lee , Artjom Joosen , Rajkarn Singh , Martin Asenov

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Large Language Models (LLMs) offer the potential for automatic time series analysis and reporting, which is a critical task across many domains, spanning healthcare, finance, climate, energy, and many more. In this paper, we propose a…

Computation and Language · Computer Science 2024-10-10 Elizabeth Fons , Rachneet Kaur , Soham Palande , Zhen Zeng , Tucker Balch , Manuela Veloso , Svitlana Vyetrenko

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional methods frequently struggle with the inherent complexity,…

Machine Learning · Computer Science 2025-03-06 Runlong Yu , Shengyu Chen , Yiqun Xie , Xiaowei Jia

Frequency-domain analysis has emerged as a powerful paradigm for time series analysis, offering unique advantages over traditional time-domain approaches while introducing new theoretical and practical challenges. This survey provides a…

Computational Engineering, Finance, and Science · Computer Science 2025-10-21 Qianru Zhang , Yuting Sun , Honggang Wen , Peng Yang , Xinzhu Li , Ming Li , Kwok-Yan Lam , Siu-Ming Yiu , Hongzhi Yin

Foundation models (FMs) are a popular topic of research in AI. Their ability to generalize to new tasks and datasets without retraining or needing an abundance of data makes them an appealing candidate for applications on specialist…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Marga Don , Stijn Pinson , Blanca Guillen Cebrian , Yuki M. Asano

Time series data is one of the most ubiquitous data modalities existing in a diverse critical domains such as healthcare, seismology, manufacturing and energy. Recent years, there are increasing interest of the data mining community to…

Machine Learning · Computer Science 2025-03-20 Li Zhang