English
Related papers

Related papers: Enhancing Transformer-Based Foundation Models for …

200 papers

Time-series foundation models (TSFMs) have achieved strong univariate forecasting through large-scale pre-training, yet effectively extending this success to multivariate forecasting remains challenging. To address this, we propose…

Machine Learning · Computer Science 2026-02-26 Jinpeng Li , Zhongyi Pei , Huaze Xue , Bojian Zheng , Chen Wang , Jianmin Wang

In Das and Politis(2020), a model-free bootstrap(MFB) paradigm was proposed for generating prediction intervals of univariate, (locally) stationary time series. Theoretical guarantees for this algorithm was resolved in Wang and…

Methodology · Statistics 2021-12-17 Yiren Wang , Dimitris N. Politis

We investigate nonlinear prediction/regression in an online setting and introduce a hybrid model that effectively mitigates, via a joint mechanism through a state space formulation, the need for domain-specific feature engineering issues of…

Machine Learning · Statistics 2023-09-20 Mustafa E. Aydın , Arda Fazla , Suleyman S. Kozat

Time series data is a key element of big data analytics, commonly found in domains such as finance, healthcare, climate forecasting, and transportation. In large scale real world settings, such data is often high dimensional and…

Machine Learning · Computer Science 2025-08-14 Younghwi Kim , Dohee Kim , Joongrock Kim , Sunghyun Sim

This paper suggests parametrically transformed nested error regression models (TNERM), which transform the data flexibly to follow the normal linear mixed regression. We provide a procedure for estimating consistently the parameters of the…

Methodology · Statistics 2018-03-14 Shonosuke Sugasawa , Tatsuya Kubokawa

Time series forecasting presents significant challenges due to the complex temporal dependencies at multiple time scales. This paper introduces ScatterFusion, a novel framework that synergistically integrates scattering transforms with…

Machine Learning · Computer Science 2026-01-29 Wei Li

Time series forecasting (TSF) remains a challenging problem due to the intricate entanglement of intraperiod-fluctuations and interperiod-trends. While recent advances have attempted to reshape 1D sequences into 2D period-phase…

Machine Learning · Computer Science 2026-03-04 Yixin Wang , Yifan Hu , Peiyuan Liu , Naiqi Li , Dai Tao , Shu-Tao Xia

Diffusion models achieve remarkable success in processing images and text, and have been extended to special domains such as time series forecasting (TSF). Existing diffusion-based approaches for TSF primarily focus on modeling…

Computation and Language · Computer Science 2025-04-29 Chen Su , Yuanhe Tian , Yan Song

Pre-trained Time Series Foundational Models (TSFMs) represent a significant advance, capable of forecasting diverse time series with complex characteristics, including varied seasonalities, trends, and long-range dependencies. Despite their…

Transformers are the de-facto choice for sequence modelling, yet their quadratic self-attention and weak temporal bias can make long-range forecasting both expensive and brittle. We introduce FreezeTST, a lightweight hybrid that interleaves…

Machine Learning · Computer Science 2025-10-21 Pradeep Singh , Mehak Sharma , Anupriya Dey , Balasubramanian Raman

In the current context of Big Data, the nature of many forecasting problems has changed from predicting isolated time series to predicting many time series from similar sources. This has opened up the opportunity to develop competitive…

Machine Learning · Computer Science 2021-03-23 Hansika Hewamalage , Christoph Bergmeir , Kasun Bandara

This work presents ensemble forecasting of monthly electricity demand using pattern similarity-based forecasting methods (PSFMs). PSFMs applied in this study include $k$-nearest neighbor model, fuzzy neighborhood model, kernel regression…

Machine Learning · Computer Science 2020-04-02 Paweł Pełka , Grzegorz Dudek

Time series foundation models (TSFMs) are increasingly being adopted as highly-capable general-purpose time series representation learners. Although their training corpora are vast, they exclude astronomical time series data. Observations…

Solar and Stellar Astrophysics · Physics 2026-02-19 Weijian Li , Hong-Yu Chen , Nabeel Rehemtulla , Ved G. Shah , Dennis Wu , Dongho Kim , Qinjie Lin , Adam A. Miller , Han Liu

Improvement of time series forecasting accuracy through combining multiple models is an important as well as a dynamic area of research. As a result, various forecasts combination methods have been developed in literature. However, most of…

Artificial Intelligence · Computer Science 2013-02-28 Ratnadip Adhikari , R. K. Agrawal

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

Machine Learning · Computer Science 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

In this paper, we propose a new short-term load forecasting (STLF) model based on contextually enhanced hybrid and hierarchical architecture combining exponential smoothing (ES) and a recurrent neural network (RNN). The model is composed of…

Machine Learning · Computer Science 2022-12-20 Slawek Smyl , Grzegorz Dudek , Paweł Pełka

The recent boom of large pre-trained models witnesses remarkable success in developing foundation models (FMs) for time series forecasting. Despite impressive performance across diverse downstream forecasting tasks, existing time series FMs…

Machine Learning · Computer Science 2025-10-23 Hui He , Kun Yi , Yuanchi Ma , Qi Zhang , Zhendong Niu , Guansong Pang

While previous research in multivariate time series forecasting has focused on developing complex holistic models, this work advocates for a shift toward a granular, component-level understanding of their impacts. We propose TSCOMP, the…

Machine Learning · Computer Science 2026-05-27 Shuang Liang , Chaochuan Hou , Xu Yao , Shiping Wang , Hailiang Huang , Songqiao Han , Minqi Jiang

Data augmentation is a crucial technique for improving model generalization and robustness, particularly in deep learning models where training data is limited. Although many augmentation methods have been developed for time series…

Machine Learning · Computer Science 2026-04-13 Jafar Bakhshaliyev , Johannes Burchert , Niels Landwehr , Lars Schmidt-Thieme

We present TimeFound, an encoder-decoder transformer-based time series foundation model for out-of-the-box zero-shot forecasting. To handle time series data from various domains, TimeFound employs a multi-resolution patching strategy to…

Machine Learning · Computer Science 2025-03-07 Congxi Xiao , Jingbo Zhou , Yixiong Xiao , Xinjiang Lu , Le Zhang , Hui Xiong
‹ Prev 1 8 9 10 Next ›