English
Related papers

Related papers: You May Not Need Order in Time Series Forecasting

200 papers

The majority of real-world processes are spatiotemporal, and the data generated by them exhibits both spatial and temporal evolution. Weather is one of the most essential processes in this domain, and weather forecasting has become a…

Machine Learning · Computer Science 2024-09-24 Shakir Showkat Sofi , Ivan Oseledets

Deep learning time-series models are often used to make forecasts that inform downstream decisions. Since these decisions can differ from those in the training set, there is an implicit requirement that time-series models will generalize…

Machine Learning · Computer Science 2024-11-04 Thomas Crasson , Yacine Nabet , Mathias Lécuyer

Many planning and decision activities in logistics and supply chain management are based on forecasts of multiple time dependent factors. Therefore, the quality of planning depends on the quality of the forecasts. We compare various…

Machine Learning · Statistics 2024-06-07 Lena Schmid , Moritz Roidl , Markus Pauly

In the context of time series forecasting, it is a common practice to evaluate multiple methods and choose one of these methods or an ensemble for producing the best forecasts. However, choosing among different ensembles over multiple…

Machine Learning · Computer Science 2021-12-16 Himanshi Charotia , Abhishek Garg , Gaurav Dhama , Naman Maheshwari

Recent efforts have been dedicated to enhancing time series forecasting accuracy by introducing advanced network architectures and self-supervised pretraining strategies. Nevertheless, existing approaches still exhibit two critical…

Machine Learning · Computer Science 2024-06-19 Zhiding Liu , Jiqian Yang , Mingyue Cheng , Yucong Luo , Zhi Li

Recent works have demonstrated the effectiveness of adapting pre-trained language models (LMs) for forecasting time series in the low-data regime. We build upon these findings by analyzing the effective transfer from language models to time…

Computation and Language · Computer Science 2025-06-30 Roland Riachi , Kashif Rasul , Arjun Ashok , Prateek Humane , Alexis Roger , Andrew R. Williams , Yuriy Nevmyvaka , Irina Rish

The recent breakthrough of Transformers in deep learning has drawn significant attention of the time series community due to their ability to capture long-range dependencies. However, like other deep learning models, Transformers face…

Machine Learning · Computer Science 2024-01-15 Subina Khanal , Seshu Tirupathi , Giulio Zizzo , Ambrish Rawat , Torben Bach Pedersen

Transformers are the de-facto choice for sequence modelling, yet their quadratic self-attention and weak temporal bias can make long-range forecasting both expensive and brittle. We introduce FreezeTST, a lightweight hybrid that interleaves…

Machine Learning · Computer Science 2025-10-21 Pradeep Singh , Mehak Sharma , Anupriya Dey , Balasubramanian Raman

Time series prediction underpins a broad range of downstream tasks across many scientific domains. Recent advances and increasing adoption of black-box machine learning models for time series prediction highlight the critical need for…

Machine Learning · Computer Science 2026-03-23 Junghwan Lee , Chen Xu , Yao Xie

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2)…

Artificial Intelligence · Computer Science 2024-05-13 Jianli Xiao , Baichao Long

In recent years, learning-based approaches have revolutionized motion planning. The data generation process for these methods involves caching a large number of high quality paths for different queries (start, goal pairs) in various…

Robotics · Computer Science 2023-03-14 Sagar Suhas Joshi , Panagiotis Tsiotras

We introduce a Gaussian process-based model for handling of non-stationarity. The warping is achieved non-parametrically, through imposing a prior on the relative change of distance between subsequent observation inputs. The model allows…

Machine Learning · Statistics 2019-12-06 David Tolpin

Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. Transformers' key feature, the attention mechanism,…

Machine Learning · Computer Science 2024-02-09 PeiSong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

A reliable long-term time-series forecaster is highly demanded in practice but comes across many challenges such as low computational and memory footprints as well as robustness against dynamic learning environments. This paper proposes…

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

In this paper it is reconsidered the prediction problem in time series framework by using a new non-parametric approach. Through this reconsideration, the prediction is obtained by a weighted sum of past observed data. These weights are…

Machine Learning · Statistics 2021-01-27 Pedro Cadahía , Jose Manuel Bravo Caro

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Task sequencing (TS) is one of the core open problems in Deep Learning, arising in a plethora of real-world domains, from robotic assembly lines to autonomous driving. Unfortunately, prior work has not convincingly demonstrated the…

Machine Learning · Computer Science 2026-03-17 Jan Kobiolka , Christian Frey , Arlind Kadra , Gresa Shala , Josif Grabocka

Non-stationary sequences arise naturally in control, forecasting, and decision-making. The data-generating process shifts at unknown times, and models must detect the change, discard or downweight obsolete evidence, and adapt to new…

Machine Learning · Computer Science 2026-04-21 Carson Dudley , Yutong Bi , Xiaofeng Liu , Samet Oymak

Much of model-based reinforcement learning involves learning a model of an agent's world, and training an agent to leverage this model to perform a task more efficiently. While these models are demonstrably useful for agents, every…

Neural and Evolutionary Computing · Computer Science 2019-11-01 C. Daniel Freeman , Luke Metz , David Ha