English
Related papers

Related papers: Impermanent: A Live Benchmark for Temporal General…

200 papers

Temporal reasoning is the task of predicting temporal relations of event pairs. While temporal reasoning models can perform reasonably well on in-domain benchmarks, we have little idea of these systems' generalizability due to existing…

Computation and Language · Computer Science 2023-06-01 Yu Feng , Ben Zhou , Haoyu Wang , Helen Jin , Dan Roth

We develop a novel continuous-time asymptotic framework for inference on whether the predictive ability of a given forecast model remains stable over time. We formally define forecast instability from the economic forecaster's perspective…

Econometrics · Economics 2018-12-04 Alessandro Casini

The rapid advancement of Large Language Models (LLMs) has led to the development of benchmarks that consider temporal dynamics, however, there remains a gap in understanding how well these models can generalize across temporal contexts due…

Computation and Language · Computer Science 2025-07-02 Chenghao Zhu , Nuo Chen , Yufei Gao , Yunyi Zhang , Prayag Tiwari , Benyou Wang

The recent surge in Time Series Foundation Models has rapidly advanced the field, yet the heterogeneous training setups across studies make it difficult to attribute improvements to architectural innovations versus data engineering. In this…

Machine Learning · Computer Science 2026-02-09 Yunshi Wen , Wesley M. Gifford , Chandra Reddy , Lam M. Nguyen , Jayant Kalagnanam , Anak Agung Julius

Time series forecasting is critical across finance, healthcare, and cloud computing, yet progress is constrained by a fundamental bottleneck: the scarcity of large-scale, high-quality benchmarks. To address this gap, we introduce…

Machine Learning · Computer Science 2026-03-30 Siqiao Xue , Zhaoyang Zhu , Wei Zhang , Rongyao Cai , Rui Wang , Yixiang Mu , Fan Zhou , Jianguo Li , Peng Di , Hang Yu

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

Machine Learning · Computer Science 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Recent research on time-series foundation models (TSFMs) has underscored the scarcity of real-world data, often supplemented with synthetic sources in existing datasets, whose generalizability remains however debated. As such, in this work,…

Artificial Intelligence · Computer Science 2025-12-01 Lujun Li , Lama Sleem , Yiqun Wang , Yangjie Xu , Niccolò Gentile , Radu State

Accurate forecasting of electric load and renewable generation is essential for reliable and cost effective power system operations. Recent advances in transformer based and foundation machine learning models, driven by large scale…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Muhy Eddin Za'ter , Bri-Mathias Hodge

This paper is concerned with online time series forecasting, where unknown distribution shifts occur over time, i.e., latent variables influence the mapping from historical to future observations. To develop an automated way of online time…

Machine Learning · Computer Science 2025-10-22 Zijian Li , Changze Zhou , Minghao Fu , Sanjay Manjunath , Fan Feng , Guangyi Chen , Yingyao Hu , Ruichu Cai , Kun Zhang

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. These models are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series…

Risk Management · Quantitative Finance 2025-05-19 Anubha Goel , Puneet Pasricha , Martin Magris , Juho Kanniainen

Time series anomaly detection is a vital task in many domains, including patient monitoring in healthcare, forecasting in finance, and predictive maintenance in energy industries. This has led to a proliferation of anomaly detection…

Machine Learning · Computer Science 2024-11-26 Sarah Alnegheimish , Laure Berti-Equille , Kalyan Veeramachaneni

A time series represents a set of observations collected over time. Typically, these observations are captured with a uniform sampling frequency (e.g. daily). When data points are observed in uneven time intervals the time series is…

Machine Learning · Computer Science 2022-01-03 Pedro Costa , Vitor Cerqueira , João Vinagre

The past decade has witnessed significant advances in time series modeling with deep learning. While achieving state-of-the-art results, the best-performing architectures vary highly across applications and domains. Meanwhile, for natural…

Machine Learning · Computer Science 2024-04-03 Defu Cao , Furong Jia , Sercan O Arik , Tomas Pfister , Yixiang Zheng , Wen Ye , Yan Liu

The development of Time-Series Forecasting (TSF) models is often constrained by the lack of comprehensive datasets, especially in Global Station Weather Forecasting (GSWF), where existing datasets are small, temporally short, and spatially…

Machine Learning · Computer Science 2026-04-01 Tao Han , Zhibin Wen , Zhenghao Chen , Dazhao Du , Song Guo , Lei Bai

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

Linear models are foundational tools in statistics and ubiquitous across the applied sciences. However, conventional statistical inference -- such as $t$-tests and $F$-tests -- are only valid at fixed sample sizes, making them unsuitable…

Methodology · Statistics 2025-07-08 Michael Lindon , Dae Woong Ham , Martin Tingley , Iavor Bojinov

Time series foundation models have recently gained a lot of attention due to their ability to model complex time series data encompassing different domains including traffic, energy, and weather. Although they exhibit strong average…

Machine Learning · Computer Science 2026-01-21 Shivani Tomar , Seshu Tirupathi , Elizabeth Daly , Ivana Dusparic

Time Series Foundation Models (TSFMs) advance generalization and data efficiency in time series forecasting by unified large-scale pretraining. But TSFMs remain lacking when adapting to specific downstream forecasting tasks for two reasons.…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Siyang Li , Yize Chen , Zijie Zhu , Yuxin Pan , Yan Guo , Ming Huang , Hui Xiong

Recent advances in deep learning have driven rapid progress in time series forecasting, yet many state-of-the-art models continue to struggle with robust performance in real-world applications, even when they achieve strong results on…

Machine Learning · Computer Science 2025-10-24 Qitai Tan , Yiyun Chen , Mo Li , Ruiwen Gu , Yilin Su , Xiao-Ping Zhang

Time series foundation models are pre-trained on large datasets and are able to achieve state-of-the-art performance in diverse tasks. However, to date, there has been limited work demonstrating how well these models perform in medical…

Machine Learning · Computer Science 2024-11-21 Mingzhu Liu , Angela H. Chen , George H. Chen