English
Related papers

Related papers: FETS Benchmark: Foundation Models Outperform Datas…

200 papers

Weather foundation models (WFMs) have recently set new benchmarks in global forecast skill, yet their concrete value for the weather-sensitive infrastructure that powers modern society remains largely unexplored. In this study, we fine-tune…

Foundation models (FMs) have emerged as a promising approach for time series forecasting. While effective, FMs typically remain fixed during deployment due to the high computational costs of learning them online. Consequently, deployed FMs…

Machine Learning · Computer Science 2025-07-31 Thomas L. Lee , William Toner , Rajkarn Singh , Artjom Joosen , Martin Asenov

Inspired by recent advances in large language models, foundation models have been developed for zero-shot time series forecasting, enabling prediction on datasets unseen during pretraining. These large-scale models, trained on vast…

Machine Learning · Computer Science 2025-12-01 Morad Laglil , Emilie Devijver , Eric Gaussier , Bertrand Pracca

Foundation models (FMs) currently dominate news headlines. They employ advanced deep learning architectures to extract structural information autonomously from vast datasets through self-supervision. The resulting rich representations of…

Time-series foundation models (TSFMs) achieve strong forecast accuracy, yet accuracy alone does not determine practical value. The form of a forecast -- point, quantile, parametric, or trajectory ensemble -- fundamentally constrains which…

Machine Learning · Computer Science 2025-10-23 Alvaro Perez-Diaz , James C. Loach , Danielle E. Toutoungi , Lee Middleton

Data analysis focuses on harnessing advanced statistics, programming, and machine learning techniques to extract valuable insights from vast datasets. An increasing volume and variety of research emerged, addressing datasets of diverse…

Databases · Computer Science 2025-01-06 Chen Liang , Donghua Yang , Zheng Liang , Zhiyu Liang , Tianle Zhang , Boyu Xiao , Yuqing Yang , Wenqi Wang , Hongzhi Wang

While recent advances in machine learning have equipped Weather Foundation Models (WFMs) with substantial generalization capabilities across diverse downstream tasks, the escalating computational requirements associated with their expanding…

Accurate and reliable energy forecasting is essential for power grid operators who strive to minimize extreme forecasting errors that pose significant operational challenges and incur high intra-day trading costs. Incorporating planning…

Computers and Society · Computer Science 2026-05-13 Raffael Theiler , Leandro Von Krannichfeldt , Giovanni Sansavini , Michael F. Howland , Olga Fink

Benchmark quality is critical for meaningful evaluation and sustained progress in time series forecasting, particularly with the rise of pretrained models. Existing benchmarks often have limited domain coverage or overlook real-world…

Our planet is facing increasingly frequent extreme events, which pose major risks to human lives and ecosystems. Recent advances in machine learning (ML), especially with foundation models (FMs) trained on extensive datasets, excel in…

Machine Learning · Computer Science 2025-05-14 Shan Zhao , Zhitong Xiong , Jie Zhao , Xiao Xiang Zhu

To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. Despite urgency, heterogeneous meteorological sensors across countries…

Machine Learning · Computer Science 2023-05-30 Shengchao Chen , Guodong Long , Tao Shen , Jing Jiang

Multi-task and few-shot time series forecasting tasks are commonly encountered in scenarios such as the launch of new products in different cities. However, traditional time series forecasting methods suffer from insufficient historical…

Machine Learning · Computer Science 2025-06-25 Pengpeng Ouyang , Dong Chen , Tong Yang , Shuo Feng , Zhao Jin , Mingliang Xu

Energy-Based Models (EBMs) have proven to be a highly effective approach for modelling densities on finite-dimensional spaces. Their ability to incorporate domain-specific choices and constraints into the structure of the model through…

Machine Learning · Computer Science 2023-02-24 Jen Ning Lim , Sebastian Vollmer , Lorenz Wolf , Andrew Duncan

Accurate forecasting of transportation dynamics is essential for urban mobility and infrastructure planning. Although recent work has achieved strong performance with deep learning models, these methods typically require dataset-specific…

Machine Learning · Computer Science 2026-05-19 Javier Yanes-Pulido , Filipe Rodrigues

Time-series forecasting models (TSFM) have evolved from classical statistical methods to sophisticated foundation models, yet understanding why and when these models succeed or fail remains challenging. Despite this known limitation, time…

Machine Learning · Computer Science 2025-08-29 Michael Widener , Kausik Lakkaraju , John Aydin , Biplav Srivastava

The prediction of residential power usage is essential in assisting a smart grid to manage and preserve energy to ensure efficient use. An accurate energy forecasting at the customer level will reflect directly into efficiency improvements…

Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs),…

Machine Learning · Computer Science 2025-03-17 Xu Liu , Taha Aksu , Juncheng Liu , Qingsong Wen , Yuxuan Liang , Caiming Xiong , Silvio Savarese , Doyen Sahoo , Junnan Li , Chenghao Liu

The rise of foundation models marks a paradigm shift in machine learning: instead of training specialized models from scratch, foundation models are first trained on massive datasets before being adapted or fine-tuned to make predictions on…

Machine Learning · Computer Science 2025-05-01 Keyon Vafa , Susan Athey , David M. Blei

Recent research on time series foundation models has primarily focused on forecasting, leaving it unclear how generalizable their learned representations are. In this study, we examine whether frozen pre-trained forecasting models can…

Machine Learning · Computer Science 2025-10-31 Andreas Auer , Daniel Klotz , Sebastinan Böck , Sepp Hochreiter

This study investigates the key characteristics and suitability of widely used Facial Expression Recognition (FER) datasets for training deep learning models. In the field of affective computing, FER is essential for interpreting human…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 F. Xavier Gaya-Morey , Cristina Manresa-Yee , Célia Martinie , Jose M. Buades-Rubio