中文
相关论文

相关论文: Enhancing Transformer-Based Foundation Models for …

200 篇论文

Time series foundation models (TSFMs) have become increasingly popular for zero-shot forecasting. However, for a new time series domain not fully covered by the pretraining set, performance can suffer. Therefore, when a practitioner cares…

机器学习 · 计算机科学 2026-03-04 Thomas L. Lee , Edoardo M. Ponti , Amos Storkey

Recent research on time-series foundation models (TSFMs) has underscored the scarcity of real-world data, often supplemented with synthetic sources in existing datasets, whose generalizability remains however debated. As such, in this work,…

人工智能 · 计算机科学 2025-12-01 Lujun Li , Lama Sleem , Yiqun Wang , Yangjie Xu , Niccolò Gentile , Radu State

Time series foundation models (TSFMs) have recently achieved remarkable success in universal forecasting by leveraging large-scale pretraining on diverse time series data. Complementing this progress, incorporating frequency-domain…

机器学习 · 计算机科学 2026-04-14 Shunyu Wu , Jiawei Huang , Weibin Feng , Boxin Li , Xiao Zhang , Erli Meng , Dan Li , Jian Lou , See-Kiong Ng

Time Series Foundation Models (TSFMs) have borrowed the long context paradigm from natural language processing under the premise that feeding more history into the model improves forecast quality. But in stochastic domains, distant history…

机器学习 · 计算机科学 2026-05-12 Rishi Ahuja , Kumar Prateek , Simranjit Singh , Vijay Kumar

Time series forecasting is critical for decision-making across dynamic domains such as energy, finance, transportation, and cloud computing. However, real-world time series often exhibit non-stationarity, including temporal distribution…

机器学习 · 计算机科学 2025-12-01 Junkai Lu , Peng Chen , Chenjuan Guo , Yang Shu , Meng Wang , Bin Yang

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. These models are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series…

风险管理 · 定量金融 2025-05-19 Anubha Goel , Puneet Pasricha , Martin Magris , Juho Kanniainen

Time-series data augmentation mitigates the issue of insufficient training data for deep learning models. Yet, existing augmentation methods are mainly designed for classification, where class labels can be preserved even if augmentation…

机器学习 · 计算机科学 2023-03-28 Xiyuan Zhang , Ranak Roy Chowdhury , Jingbo Shang , Rajesh Gupta , Dezhi Hong

Forecasting agricultural markets remains challenging due to nonlinear dynamics, structural breaks, and sparse data. A long-standing belief holds that simple time-series methods outperform more advanced alternatives. This paper provides the…

计量经济学 · 经济学 2026-01-21 Le Wang , Boyuan Zhang

With large quantities of data typically available nowadays, forecasting models that are trained across sets of time series, known as Global Forecasting Models (GFM), are regularly outperforming traditional univariate forecasting models that…

机器学习 · 计算机科学 2021-09-22 Rakshitha Godahewa , Kasun Bandara , Geoffrey I. Webb , Slawek Smyl , Christoph Bergmeir

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

计算与语言 · 计算机科学 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Multi-task and few-shot time series forecasting tasks are commonly encountered in scenarios such as the launch of new products in different cities. However, traditional time series forecasting methods suffer from insufficient historical…

机器学习 · 计算机科学 2025-06-25 Pengpeng Ouyang , Dong Chen , Tong Yang , Shuo Feng , Zhao Jin , Mingliang Xu

Time Series Foundation Models (TSFMs) have introduced zero-shot prediction capabilities that bypass the need for task-specific training. Whether these capabilities translate to mission-critical applications such as electricity demand…

机器学习 · 计算机科学 2026-02-12 Luigi Simeone

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

机器学习 · 计算机科学 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

Self-supervised representation learning, particularly through contrastive methods like TS2Vec, has advanced the analysis of time series data. However, these models often falter in forecasting tasks because their objective functions…

机器学习 · 计算机科学 2025-12-01 Ganeshan Niroshan , Uthayasanker Thayasivam

Time series forecasting has played a pivotal role across various industries, including finance, transportation, energy, healthcare, and climate. Due to the abundant seasonal information they contain, timestamps possess the potential to…

机器学习 · 计算机科学 2024-11-21 Chengsen Wang , Qi Qi , Jingyu Wang , Haifeng Sun , Zirui Zhuang , Jinming Wu , Jianxin Liao

Recent developments related to the energy transition pose particular challenges for distribution grids. Hence, precise load forecasts become more and more important for effective grid management. Novel modeling approaches such as the…

机器学习 · 计算机科学 2023-05-19 Elena Giacomazzi , Felix Haag , Konstantin Hopf

Time-series foundation models have emerged as a new paradigm for forecasting, yet their ability to effectively leverage exogenous features -- critical for electricity demand forecasting -- remains unclear. This paper empirically evaluates…

机器学习 · 计算机科学 2026-02-06 Wei Soon Cheong , Lian Lian Jiang , Jamie Ng Suat Ling

Foundation models (FMs) have transformed natural language processing, but their success has not yet translated to time series forecasting. Existing time series foundation models (TSFMs), often based on transformer variants, struggle with…

机器学习 · 计算机科学 2025-08-20 Lars Graf , Thomas Ortner , Stanisław Woźniak , Angeliki Pantazi

Time Series Foundation Models (TSFMs) represent a new paradigm for time-series forecasting, promising zero-shot predictions without the need for task-specific training or fine-tuning. However, similar to Large Language Models (LLMs), the…

机器学习 · 计算机科学 2026-02-26 Marcel Meyer , Sascha Kaltenpoth , Kevin Zalipski , Oliver Müller

Time-series forecasting has seen significant advancements with the introduction of token prediction mechanisms such as multi-head attention. However, these methods often struggle to achieve the same performance as in language modeling,…

机器学习 · 计算机科学 2024-12-03 Panayiotis Christou , Shichu Chen , Xupeng Chen , Parijat Dube