English
Related papers

Related papers: Enhancing Transformer-Based Foundation Models for …

200 papers

Accurate weather forecasting holds significant importance, serving as a crucial tool for decision-making in various industrial sectors. The limitations of statistical models, assuming independence among data points, highlight the need for…

Machine Learning · Computer Science 2025-01-22 Anuvab Sen , Udayon Sen , Mayukhi Paul , Apurba Prasad Padhy , Sujith Sai , Aakash Mallik , Chhandak Mallick

Time series forecasting plays a crucial role in diverse fields, necessitating the development of robust models that can effectively handle complex temporal patterns. In this article, we present a novel feature selection method embedded in…

Machine Learning · Computer Science 2024-01-01 Raquel Espinosa , Fernando Jiménez , José Palma

Time series forecasting is a fundamental tool with wide ranging applications, yet recent debates question whether complex nonlinear architectures truly outperform simple linear models. Prior claims of dominance of the linear model often…

Machine Learning · Computer Science 2026-02-13 Md Rakibul Haque , Vishwa Goudar , Shireen Elhabian , Warren Woodrich Pettine

Nowadays, weather prediction is based on numerical weather prediction (NWP) models to produce an ensemble of forecasts. Despite of large improvements over the last few decades, they still tend to exhibit systematic bias and dispersion…

Applications · Statistics 2024-02-02 David Jobst , Annette Möller , Jürgen Groß

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

Machine Learning · Computer Science 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

Conventional forecasting methods rely on unimodal time series data, limiting their ability to exploit rich textual information. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demonstrated powerful…

Machine Learning · Computer Science 2025-05-16 Chengsen Wang , Qi Qi , Zhongwen Rao , Lujia Pan , Jingyu Wang , Jianxin Liao

Predicting missing facts for temporal knowledge graphs (TKGs) is a fundamental task, called temporal knowledge graph completion (TKGC). One key challenge in this task is the imbalance in data distribution, where facts are unevenly spread…

Machine Learning · Computer Science 2025-01-03 Jiasheng Zhang , Deqiang Ouyang , Shuang Liang , Jie Shao

The advancement of Time Series Foundation Models (TSFMs) has been driven primarily by large-scale pre-training, but inference-time compute potential remains largely untapped. This work systematically investigates two questions: how do TSFMs…

Machine Learning · Computer Science 2026-01-27 Ruijin Hua , Zichuan Liu , Kun Zhang , Yiyuan Yang

Recently, deep learning has driven significant advancements in multivariate time series forecasting (MTSF) tasks. However, much of the current research in MTSF tends to evaluate models from a holistic perspective, which obscures the…

Machine Learning · Computer Science 2025-09-23 Shuang Liang , Chaochuan Hou , Xu Yao , Shiping Wang , Minqi Jiang , Songqiao Han , Hailiang Huang

Time Series Forecasting (TSF) is a crucial task in various domains, yet existing TSF models rely heavily on high-quality data and insufficiently exploit all available data. This paper explores a novel self-supervised approach to re-label…

Machine Learning · Computer Science 2025-12-17 Yuxuan Yang , Dalin Zhang , Yuxuan Liang , Hua Lu , Gang Chen , Huan Li

Long-term time series forecasting (LTSF) remains challenging due to the trade-off between parallel efficiency and sequential modeling of temporal coherence. Direct multi-step forecasting (DMS) methods enable fast, parallel prediction of all…

Machine Learning · Computer Science 2026-02-03 Sunho Kim , Susik Yoon

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Machine Learning · Computer Science 2025-08-15 Luca-Andrei Fechete , Mohamed Sana , Fadhel Ayed , Nicola Piovesan , Wenjie Li , Antonio De Domenico , Tareq Si Salem

Recently, channel-independent methods have achieved state-of-the-art performance in multivariate time series (MTS) forecasting. Despite reducing overfitting risks, these methods miss potential opportunities in utilizing channel dependence…

Machine Learning · Computer Science 2024-08-14 Lifan Zhao , Yanyan Shen

We introduce LatentTimePFN (LaT-PFN), a foundational Time Series model with a strong embedding space that enables zero-shot forecasting. To achieve this, we perform in-context learning in latent space utilizing a novel integration of the…

Machine Learning · Computer Science 2024-05-24 Stijn Verdenius , Andrea Zerio , Roy L. M. Wang

Time Series Foundation Models (TSFMs) achieve strong zero-shot forecasting through large-scale pre-training, but adapting them to downstream domains under distribution shift remains challenging. Existing solutions face a trade-off:…

Machine Learning · Computer Science 2026-02-13 Sisuo Lyu , Siru Zhong , Tiegang Chen , Weilin Ruan , Qingxiang Liu , Taiqiang Lv , Qingsong Wen , Raymond Chi-Wing Wong , Yuxuan Liang

In this work, we propose an ensemble forecasting approach based on randomized neural networks. Improved randomized learning streamlines the fitting abilities of individual learners by generating network parameters in accordance with the…

Machine Learning · Computer Science 2021-07-12 Grzegorz Dudek , Paweł Pełka

Training a general-purpose time series foundation models with robust generalization capabilities across diverse applications from scratch is still an open challenge. Efforts are primarily focused on fusing cross-domain time series datasets…

Machine Learning · Computer Science 2024-12-13 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

Existing generative models for time series forecasting often transform simple priors (typically Gaussian) into complex data distributions. However, their sampling initialization, independent of historical data, hinders the capture of…

Machine Learning · Computer Science 2025-08-12 Huibo Xu , Runlong Yu , Likang Wu , Xianquan Wang , Qi Liu

Ensemble models are powerful model building tools that are developed with a focus to improve the accuracy of model predictions. They find applications in time series forecasting in varied scenarios including but not limited to process…

Nowadays, weather forecasts are commonly generated by ensemble forecasts based on multiple runs of numerical weather prediction models. However, such forecasts are usually miscalibrated and/or biased, thus require statistical…

Applications · Statistics 2024-12-13 David Jobst