English
Related papers

Related papers: FETS Benchmark: Foundation Models Outperform Datas…

200 papers

Recent advances in deep learning have driven rapid progress in time series forecasting, yet many state-of-the-art models continue to struggle with robust performance in real-world applications, even when they achieve strong results on…

Machine Learning · Computer Science 2025-10-24 Qitai Tan , Yiyun Chen , Mo Li , Ruiwen Gu , Yilin Su , Xiao-Ping Zhang

Food security remains a global concern as population grows and climate change intensifies, demanding innovative solutions for sustainable agricultural productivity. Recent advances in foundation models have demonstrated remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Vishal Nedungadi , Xingguo Xiong , Aike Potze , Ron Van Bree , Tao Lin , Marc Rußwurm , Ioannis N. Athanasiadis

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Machine Learning · Computer Science 2025-08-15 Luca-Andrei Fechete , Mohamed Sana , Fadhel Ayed , Nicola Piovesan , Wenjie Li , Antonio De Domenico , Tareq Si Salem

While recent advancements in foundation models have significantly impacted machine learning, rigorous tests on the performance of time series foundation models (TSFMs) remain largely underexplored. This paper presents an empirical study…

Machine Learning · Computer Science 2025-01-09 Syamantak Datta Gupta

Time-series forecasting is a challenging problem that traditionally requires specialized models custom-trained for the specific task at hand. Recently, inspired by the success of large language models, foundation models pre-trained on vast…

Machine Learning · Computer Science 2025-03-20 Yuanzhao Zhang , William Gilpin

Multivariate Time Series (MTS) analysis is crucial to understanding and managing complex systems, such as traffic and energy systems, and a variety of approaches to MTS forecasting have been proposed recently. However, we often observe…

Machine Learning · Computer Science 2024-10-18 Zezhi Shao , Fei Wang , Yongjun Xu , Wei Wei , Chengqing Yu , Zhao Zhang , Di Yao , Tao Sun , Guangyin Jin , Xin Cao , Gao Cong , Christian S. Jensen , Xueqi Cheng

We survey applications of pretrained foundation models in robotics. Traditional deep learning models in robotics are trained on small datasets tailored for specific tasks, which limits their adaptability across diverse applications. In…

Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent…

Machine Learning · Computer Science 2025-09-18 Jiexia Ye , Yongzi Yu , Weiqi Zhang , Le Wang , Jia Li , Fugee Tsung

Recent progress in self-supervision has shown that pre-training large neural networks on vast amounts of unsupervised data can lead to substantial increases in generalization to downstream tasks. Such models, recently coined foundation…

There has been active investigation into deep learning approaches for time series analysis, including foundation models. However, most studies do not address significant scientific applications. This paper aims to identify key features in…

Machine Learning · Computer Science 2025-09-22 Junyang He , Ying-Jung Chen , Alireza Jafari , Anushka Idamekorala , Geoffrey Fox

Time series are generated in diverse domains such as economic, traffic, health, and energy, where forecasting of future values has numerous important applications. Not surprisingly, many forecasting methods are being proposed. To ensure…

Time-series forecasting is crucial for numerous real-world applications including weather prediction and financial market modeling. While temporal-domain methods remain prevalent, frequency-domain approaches can effectively capture…

Machine Learning · Computer Science 2025-08-05 Zhixuan Li , Naipeng Chen , Seonghwa Choi , Sanghoon Lee , Weisi Lin

Most time series foundation models are pretrained by directly predicting future observations, which often yields weakly structured latent representations that capture surface noise rather than coherent and predictable temporal dynamics. In…

Machine Learning · Computer Science 2026-02-17 Xinxing Zhou , Qingren Yao , Yiji Zhao , Chenghao Liu , Flora Salim , Xiaojie Yuan , Yanlong Wen , Ming Jin

Recent progress in foundation models has enabled strong zero-shot performance for time series forecasting. In this work, we show that such capabilities can also emerge from tabular foundation models. We introduce TabPFN-TS, a simple method…

Machine Learning · Computer Science 2026-01-28 Shi Bin Hoo , Samuel Müller , David Salinas , Frank Hutter

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Time-series foundation models have emerged as a new paradigm for forecasting, yet their ability to effectively leverage exogenous features -- critical for electricity demand forecasting -- remains unclear. This paper empirically evaluates…

Machine Learning · Computer Science 2026-02-06 Wei Soon Cheong , Lian Lian Jiang , Jamie Ng Suat Ling

Multi-tasking machine learning (ML) models exhibit prediction abilities in domains with little to no training data available (few-shot and zero-shot learning). Over-parameterized ML models are further capable of zero-loss training and…

Machine Learning · Computer Science 2023-11-14 Arsam Aryandoust , Thomas Rigoni , Francesco di Stefano , Anthony Patt

Energy is a critical driver of modern economic systems. Accurate energy price forecasting plays an important role in supporting decision-making at various levels, from operational purchasing decisions at individual business organizations to…

Machine Learning · Computer Science 2024-11-07 Alexandru-Victor Andrei , Georg Velev , Filip-Mihai Toma , Daniel Traian Pele , Stefan Lessmann

Artificial Intelligence (AI) technologies have profoundly transformed the field of remote sensing, revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, remote…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Siqi Lu , Junlin Guo , James R Zimmer-Dauphinee , Jordan M Nieusma , Xiao Wang , Parker VanValkenburgh , Steven A Wernke , Yuankai Huo

This study investigates zero-shot forecasting capabilities of Time Series Foundation Models (TSFMs) for macroeconomic indicators. We apply TSFMs to forecasting economic indicators under univariate conditions, bypassing the need for train…

Machine Learning · Computer Science 2025-11-05 Jittarin Jetwiriyanon , Teo Susnjak , Surangika Ranathunga