English
Related papers

Related papers: Inter-Series Transformer: Attending to Products in…

200 papers

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Time series forecasting is one of the most essential and ubiquitous tasks in many business problems, including demand forecasting and logistics optimization. Traditional time series forecasting methods, however, have resulted in small…

Machine Learning · Computer Science 2024-03-01 Young-Jin Park , Donghyun Kim , Frédéric Odermatt , Juho Lee , Kyung-Min Kim

Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between…

Machine Learning · Computer Science 2019-09-20 Shun-Yao Shih , Fan-Keng Sun , Hung-yi Lee

In recent decades, new methods and approaches have been developed for forecasting intermittent demand series. However, the majority of research has focused on point forecasting, with little exploration into probabilistic intermittent demand…

Applications · Statistics 2024-04-16 Shengjie Wang , Yanfei Kang , Fotios Petropoulos

Time series forecasting is extensively applied across diverse domains. Transformer-based models demonstrate significant potential in modeling cross-time and cross-variable interaction. However, we notice that the cross-variable correlation…

Machine Learning · Computer Science 2024-10-08 Ao Hu , Dongkai Wang , Yong Dai , Shiyi Qi , Liangjian Wen , Jun Wang , Zhi Chen , Xun Zhou , Zenglin Xu , Jiang Duan

Time series modeling and forecasting has fundamental importance to various practical domains. Thus a lot of active research works is going on in this subject during several years. Many important models have been proposed in literature for…

Machine Learning · Computer Science 2013-02-28 Ratnadip Adhikari , R. K. Agrawal

Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities…

Machine Learning · Computer Science 2026-02-06 Jiecheng Lu , Yan Sun , Shihao Yang

With the advent of Transformers, time series forecasting has seen significant advances, yet it remains challenging due to the need for effective sequence representation, memory construction, and accurate target projection. Time series…

Artificial Intelligence · Computer Science 2025-07-09 Robert Leppich , Michael Stenger , André Bauer , Samuel Kounev

Time series forecasting has always been a thought-provoking topic in the field of machine learning. Machine learning scientists define a time series as a set of observations recorded over consistent time steps. And, time series forecasting…

Quantum Physics · Physics 2022-07-19 Payal Kaushik , Sayantan Pramanik , M Girish Chandra , C V Sridhar

Transformer-based models have achieved remarkable success in multivariate time series forecasting (MTSF) by capturing long-range dependencies. However, their widespread adoption is hindered by the quadratic computational complexity of…

Machine Learning · Computer Science 2026-05-12 Fanpu Cao , Shu Yang , Zhengjian Chen , Ye Liu , Laizhong Cui

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

Machine Learning · Computer Science 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Time series refer to a series of data points indexed in time order, which can be found in various fields, e.g., transportation, healthcare, and finance. Accurate time series forecasting can enhance optimization planning and decision-making…

Machine Learning · Computer Science 2023-12-12 Ling Chen , Jiahua Cui

Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and…

Machine Learning · Computer Science 2024-05-29 Robert Leppich , Vanessa Borst , Veronika Lesch , Samuel Kounev

Recently, Transformer-based models for long sequence time series forecasting have demonstrated promising results. The self-attention mechanism as the core component of these Transformer-based models exhibits great potential in capturing…

Machine Learning · Computer Science 2024-12-17 Zhicheng Zhang , Yong Wang , Shaoqi Tan , Bowei Xia , Yujie Luo

Intermittency is a common and challenging problem in demand forecasting. We introduce a new, unified framework for building intermittent demand forecasting models, which incorporates and allows to generalize existing methods in several…

Machine Learning · Computer Science 2020-10-06 Ali Caner Turkmen , Tim Januschowski , Yuyang Wang , Ali Taylan Cemgil

Recent innovations in transformers have shown their superior performance in natural language processing (NLP) and computer vision (CV). The ability to capture long-range dependencies and interactions in sequential data has also triggered a…

Statistical Finance · Quantitative Finance 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Kitae Kim , Seong-Bae Park , Choong Seon Hong

Transformers have become the de-facto standard in the natural language processing (NLP) field. They have also gained momentum in computer vision and other domains. Transformers can enable artificial intelligence (AI) models to dynamically…

Machine Learning · Computer Science 2021-11-09 Liya Wang , Amy Mykityshyn , Craig Johnson , Jillian Cheng

Multivariate time series forecasting is widely applied in fields such as transportation, energy, and finance. However, the data commonly suffers from issues of multi-scale characteristics, weak correlations, and noise interference, which…

Machine Learning · Computer Science 2026-03-02 Xiang Ao

Origin-Destination (OD) matrices record directional flow data between pairs of OD regions. The intricate spatiotemporal dependency in the matrices makes the OD matrix forecasting (ODMF) problem not only intractable but also non-trivial.…

Artificial Intelligence · Computer Science 2022-08-18 Jin Huang , Bosong Huang , Weihao Yu , Jing Xiao , Ruzhong Xie , Ke Ruan

This survey delves into the application of diffusion models in time-series forecasting. Diffusion models are demonstrating state-of-the-art results in various fields of generative AI. The paper includes comprehensive background information…

Machine Learning · Computer Science 2024-01-18 Caspar Meijer , Lydia Y. Chen