English
Related papers

Related papers: Hyperparameter Tuning MLPs for Probabilistic Time …

200 papers

Deep learning models have grown increasingly popular in time series applications. However, the large quantity of newly proposed architectures, together with often contradictory empirical results, makes it difficult to assess which…

Machine Learning · Computer Science 2025-12-30 Valentina Moretti , Andrea Cini , Ivan Marisca , Cesare Alippi

Real-world time-series datasets are often multivariate with complex dynamics. To capture this complexity, high capacity architectures like recurrent- or attention-based sequential deep learning models have become popular. However, recent…

Machine Learning · Computer Science 2023-09-12 Si-An Chen , Chun-Liang Li , Nate Yoder , Sercan O. Arik , Tomas Pfister

In this paper we survey the most recent advances in supervised machine learning and high-dimensional models for time series forecasting. We consider both linear and nonlinear alternatives. Among the linear methods we pay special attention…

Econometrics · Economics 2021-04-12 Ricardo P. Masini , Marcelo C. Medeiros , Eduardo F. Mendes

Hyperparameter optimization has remained a central topic within the machine learning community due to its ability to produce state-of-the-art results. With the recent interest growing in the usage of CNNs for time series prediction, we…

Machine Learning · Computer Science 2021-01-20 Taniya Seth , Pranab K. Muhuri

Recent years have witnessed tremendously improved efficiency of Automated Machine Learning (AutoML), especially Automated Deep Learning (AutoDL) systems, but recent work focuses on tabular, image, or NLP tasks. So far, little attention has…

Machine Learning · Computer Science 2022-07-25 Difan Deng , Florian Karl , Frank Hutter , Bernd Bischl , Marius Lindauer

The long horizon forecasting (LHF) problem has come up in the time series literature for over the last 35 years or so. This review covers aspects of LHF in this period and how deep learning has incorporated variants of trend, seasonality,…

Machine Learning · Computer Science 2025-06-17 Hans Krupakar , Kandappan V A

Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities…

Machine Learning · Computer Science 2026-02-06 Jiecheng Lu , Yan Sun , Shihao Yang

Multivariate Time Series Forecasting (MTSF) plays a crucial role across diverse fields, ranging from economic, energy, to traffic. In recent years, deep learning has demonstrated outstanding performance in MTSF tasks. In MTSF, modeling the…

Machine Learning · Computer Science 2026-01-28 Xiangfei Qiu , Hanyin Cheng , Xingjian Wu , Junkai Lu , Jilin Hu , Chenjuan Guo , Christian S. Jensen , Bin Yang

Model selection is a critical step in time series forecasting, traditionally requiring extensive performance evaluations across various datasets. Meta-learning approaches aim to automate this process, but they typically depend on…

Machine Learning · Computer Science 2025-04-04 Wang Wei , Tiankai Yang , Hongjie Chen , Ryan A. Rossi , Yue Zhao , Franck Dernoncourt , Hoda Eldardiry

In recent years, both online and offline deep learning models have been developed for time series forecasting. However, offline deep forecasting models fail to adapt effectively to changes in time-series data, while online deep forecasting…

Machine Learning · Computer Science 2024-02-06 Mohamed Mejri , Chandramouli Amarnath , Abhijit Chatterjee

Time series neural networks perform exceptionally well in real-world applications but encounter challenges such as limited scalability, poor generalization, and suboptimal zero-shot performance. Inspired by large language models, there is…

Machine Learning · Computer Science 2025-01-28 Yongzhi Qi , Hao Hu , Dazhou Lei , Jianshen Zhang , Zhengxin Shi , Yulin Huang , Zhengyu Chen , Xiaoming Lin , Zuo-Jun Max Shen

Using pre-trained large language models (LLMs) as a backbone for time series prediction has recently attracted growing research interest. Existing approaches typically split time series into patches, map them to the token space of LLMs via…

Machine Learning · Computer Science 2026-03-09 Xinyu Zhang , Shanshan Feng , Xutao Li , Kenghong Lin , Fan Li , Pengfei Jia

Deep time series forecasting has emerged as a rapidly growing field in recent years. Despite the exponential growth of community interests, progress on standard benchmarks is often limited to marginal improvements. A common consensus of the…

Machine Learning · Computer Science 2026-05-05 Yuxuan Wang , Haixu Wu , Yuezhou Ma , Yuchen Fang , Ziyi Zhang , Yong Liu , Shiyu Wang , Zhou Ye , Yang Xiang , Jianmin Wang , Mingsheng Long

Time series forecasting is a subject of significant scientific and industrial importance. Despite the widespread utilization of forecasting methods, there is a dearth of research aimed at comprehending the conditions under which these…

Machine Learning · Computer Science 2024-10-23 Moisés Santos , André de Carvalho , Carlos Soares

Spatiotemporal time series forecasting plays a key role in a wide range of real-world applications. While significant progress has been made in this area, fully capturing and leveraging spatiotemporal heterogeneity remains a fundamental…

Machine Learning · Computer Science 2024-09-04 Zheng Dong , Renhe Jiang , Haotian Gao , Hangchen Liu , Jinliang Deng , Qingsong Wen , Xuan Song

The rapid advancement of Large Language Models (LLMs) has sparked growing interest in their application to time series analysis tasks. However, their ability to perform complex reasoning over temporal data in real-world application domains…

Machine Learning · Computer Science 2025-09-03 Wen Ye , Jinbo Liu , Defu Cao , Wei Yang , Yan Liu

Accurate forecasting of multivariate time series data remains a formidable challenge, particularly due to the growing complexity of temporal dependencies in real-world scenarios. While neural network-based models have achieved notable…

Machine Learning · Computer Science 2025-12-09 Andrey Savchenko , Oleg Kachan

Machine learning models have made significant progress in load forecasting, but their forecast accuracy is limited in cases where historical load data is scarce. Inspired by the outstanding performance of large language models (LLMs) in…

Machine Learning · Computer Science 2024-12-02 Wenlong Liao , Fernando Porte-Agel , Jiannong Fang , Christian Rehtanz , Shouxiang Wang , Dechang Yang , Zhe Yang

Time series modeling for predictive purpose has been an active research area of machine learning for many years. However, no sufficiently comprehensive and meanwhile substantive survey was offered so far. This survey strives to meet this…

Machine Learning · Computer Science 2021-09-28 Fatoumata Dama , Christine Sinoquet

Time-series forecasting is an essential task with wide real-world applications across domains. While recent advances in deep learning have enabled time-series forecasting models with accurate predictions, there remains considerable debate…

Machine Learning · Computer Science 2026-03-26 Zhiyuan Zhao , Juntong Ni , Shangqing Xu , Haoxin Liu , Wei Jin , B. Aditya Prakash