English
Related papers

Related papers: Performance of Zero-Shot Time Series Foundation Mo…

200 papers

Time Series Forecasting has been an active area of research due to its many applications ranging from network usage prediction, resource allocation, anomaly detection, and predictive maintenance. Numerous publications published in the last…

Machine Learning · Computer Science 2022-11-08 Aryan Jadon , Avinash Patil , Shruti Jadon

Time series forecasting (TSF) has long been a crucial task in both industry and daily life. Most classical statistical models may have certain limitations when applied to practical scenarios in fields such as energy, healthcare, traffic,…

Machine Learning · Computer Science 2025-03-14 Xiangjie Kong , Zhenghao Chen , Weiyao Liu , Kaili Ning , Lechao Zhang , Syauqie Muhammad Marier , Yichen Liu , Yuhao Chen , Feng Xia

Masked diffusion models (MDMs) have emerged as a popular research topic for generative modeling of discrete data, thanks to their superior performance over other discrete diffusion models, and are rivaling the auto-regressive models (ARMs)…

Machine Learning · Computer Science 2025-05-01 Kaiwen Zheng , Yongxin Chen , Hanzi Mao , Ming-Yu Liu , Jun Zhu , Qinsheng Zhang

Traditional foundation models are pre-trained on broad datasets to reduce the training resources (e.g., time, energy, labeled samples) needed for fine-tuning a wide range of downstream tasks. However, traditional foundation models struggle…

Machine Learning · Computer Science 2025-04-24 Majid Farhadloo , Arun Sharma , Mingzhou Yang , Bharat Jayaprakash , William Northrop , Shashi Shekhar

In economics and many other forecasting domains, the real world problems are too complex for a single model that assumes a specific data generation process. The forecasting performance of different methods changes depending on the nature of…

Machine Learning · Computer Science 2023-09-26 Li Li , Feng Li , Yanfei Kang

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Forecasting state evolution of network systems, such as the spread of information on social networks, is significant for effective policy interventions and resource management. However, the underlying propagation dynamics constantly shift…

Computational Engineering, Finance, and Science · Computer Science 2025-10-13 Shihe Zhou , Ruikun Li , Huandong Wang , Yong Li

Among various soft computing approaches for time series forecasting, Fuzzy Cognitive Maps (FCM) have shown remarkable results as a tool to model and analyze the dynamics of complex systems. FCM have similarities to recurrent neural networks…

Artificial Intelligence · Computer Science 2022-01-11 Omid Orang , Petrônio Cândido de Lima e Silva , Frederico Gadelha Guimarães

Modern Foundation Models (FMs) are typically trained on corpora spanning a wide range of different data modalities, topics and downstream tasks. Utilizing these models can be very computationally expensive and is out of reach for most…

Machine Learning · Computer Science 2025-06-09 Andrey Zhmoginov , Jihwan Lee , Mark Sandler

Many businesses and industries nowadays rely on large quantities of time series data making time series forecasting an important research area. Global forecasting models that are trained across sets of time series have shown a huge…

Machine Learning · Computer Science 2021-10-25 Rakshitha Godahewa , Christoph Bergmeir , Geoffrey I. Webb , Rob J. Hyndman , Pablo Montero-Manso

Diffusion models, initially developed for image synthesis, demonstrate remarkable generative capabilities. Recently, their application has expanded to time series forecasting (TSF), yielding promising results. Existing surveys on time…

Machine Learning · Statistics 2025-09-03 Chen Su , Zhengzhou Cai , Yuanhe Tian , Zhuochao Chang , Zihong Zheng , Yan Song

Foundation models (FMs) have revolutionized computer vision, enabling effective learning across different domains. However, their performance under domain shift is yet underexplored. This paper investigates the zero-shot domain adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ugur Ali Kaplan , Margret Keuper , Anna Khoreva , Dan Zhang , Yumeng Li

Long-term time series forecasting (LTSF) involves predicting a large number of future values of a time series based on the past values. This is an essential task in a wide range of domains including weather forecasting, stock market…

Quantum Physics · Physics 2025-03-19 Hari Hara Suthan Chittoor , Paul Robert Griffin , Ariel Neufeld , Jayne Thompson , Mile Gu

The zero-shot evaluation of time series foundation models (TSFMs) for classification typically uses a frozen encoder followed by a task-specific classifier. However, this practice violates the training-free premise of zero-shot deployment…

Machine Learning · Computer Science 2026-02-03 Juntao Fang , Shifeng Xie , Shengbin Nie , Yuhui Ling , Yuming Liu , Zijian Li , Keli Zhang , Lujia Pan , Themis Palpanas , Ruichu Cai

Data analysis focuses on harnessing advanced statistics, programming, and machine learning techniques to extract valuable insights from vast datasets. An increasing volume and variety of research emerged, addressing datasets of diverse…

Databases · Computer Science 2025-01-06 Chen Liang , Donghua Yang , Zheng Liang , Zhiyu Liang , Tianle Zhang , Boyu Xiao , Yuqing Yang , Wenqi Wang , Hongzhi Wang

Recent advances in time series research facilitate the development of foundation models. While many state-of-the-art time series foundation models have been introduced, few studies examine their effectiveness in specific downstream…

Machine Learning · Computer Science 2025-12-01 Junyang He , Judy Fox , Alireza Jafari , Ying-Jung Chen , Geoffrey Fox

Federated Learning (FL) provides a decentralized machine learning approach, where multiple devices or servers collaboratively train a model without sharing their raw data, thus enabling data privacy. This approach has gained significant…

Machine Learning · Computer Science 2025-02-17 Mahad Ali , Curtis Lisle , Patrick W. Moore , Tammer Barkouki , Brian J. Kirkwood , Laura J. Brattain

Foundation models are trained on vast amounts of data at scale using self-supervised learning, enabling adaptation to a wide range of downstream tasks. At test time, these models exhibit zero-shot capabilities through which they can…

Artificial Intelligence · Computer Science 2023-11-28 Shiladitya Dutta , Hongbo Wei , Lars van der Laan , Ahmed M. Alaa

Forecasting multivariate time series data, which involves predicting future values of variables over time using historical data, has significant practical applications. Although deep learning-based models have shown promise in this field,…

Machine Learning · Computer Science 2023-06-16 Zahra Fatemi , Minh Huynh , Elena Zheleva , Zamir Syed , Xiaojun Di

Foundation models (FMs) are recognized as a transformative breakthrough that has started to reshape the future of artificial intelligence (AI) across both academia and industry. The integration of FMs into wireless networks is expected to…

Networking and Internet Architecture · Computer Science 2026-01-07 Han Zhang , Mohammad Farzanullah , Mohammad Ghassemi , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci