English
Related papers

Related papers: Leveraging Multivariate Long-Term History Represen…

200 papers

Time-series forecasting has seen significant advancements with the introduction of token prediction mechanisms such as multi-head attention. However, these methods often struggle to achieve the same performance as in language modeling,…

Machine Learning · Computer Science 2024-12-03 Panayiotis Christou , Shichu Chen , Xupeng Chen , Parijat Dube

Selecting an appropriate look-back horizon remains a fundamental challenge in time series forecasting (TSF), particularly in the federated learning scenarios where data is decentralized, heterogeneous, and often non-independent. While…

Machine Learning · Computer Science 2026-01-06 Dahao Tang , Nan Yang , Yanli Li , Zhiyu Zhu , Zhibo Jin , Dong Yuan

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Multivariate Long Sequence Time-series Forecasting (LSTF) has been a critical task across various real-world applications. Recent advancements focus on the application of transformer architectures attributable to their ability to capture…

Machine Learning · Computer Science 2024-11-19 Shubham Tanaji Kakde , Rony Mitra , Jasashwi Mandal , Manoj Kumar Tiwari

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

The non-stationary nature of real-world Multivariate Time Series (MTS) data presents forecasting models with a formidable challenge of the time-variant distribution of time series, referred to as distribution shift. Existing studies on the…

Machine Learning · Computer Science 2024-07-19 Hui He , Qi Zhang , Kun Yi , Xiaojun Xue , Shoujin Wang , Liang Hu , Longbing Cao

Time Series Forecasting has made significant progress with the help of Patching technique, which partitions time series into multiple patches to effectively retain contextual semantic information into a representation space beneficial for…

Machine Learning · Computer Science 2025-12-17 Xingjian Wu , Xiangfei Qiu , Hanyin Cheng , Zhengyu Li , Jilin Hu , Chenjuan Guo , Bin Yang

The forecasting of Multivariate Time Series (MTS) has long been an important but challenging task. Due to the non-stationary problem across long-distance time steps, previous studies primarily adopt stationarization method to attenuate the…

Machine Learning · Computer Science 2024-03-11 Muyao Wang , Wenchao Chen , Bo Chen

Multivariate Time Series (MTS) analysis is crucial to understanding and managing complex systems, such as traffic and energy systems, and a variety of approaches to MTS forecasting have been proposed recently. However, we often observe…

Machine Learning · Computer Science 2024-10-18 Zezhi Shao , Fei Wang , Yongjun Xu , Wei Wei , Chengqing Yu , Zhao Zhang , Di Yao , Tao Sun , Guangyin Jin , Xin Cao , Gao Cong , Christian S. Jensen , Xueqi Cheng

Learning compressed representations of multivariate time series (MTS) facilitates data analysis in the presence of noise and redundant information, and for a large number of variates and time steps. However, classical dimensionality…

Neural and Evolutionary Computing · Computer Science 2019-07-17 Filippo Maria Bianchi , Lorenzo Livi , Karl Øyvind Mikalsen , Michael Kampffmeyer , Robert Jenssen

Short term Load Forecasting (STLF) plays an important role in traditional and modern power systems. Most STLF models predominantly exploit temporal dependencies from historical data to predict future consumption. Nowadays, with the…

Machine Learning · Computer Science 2025-02-19 Quoc Viet Nguyen , Joaquin Delgado Fernandez , Sergio Potenciano Menci

Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting…

We present Higher-Order Tensor RNN (HOT-RNN), a novel family of neural sequence architectures for multivariate forecasting in environments with nonlinear dynamics. Long-term forecasting in such systems is highly challenging, since there…

Machine Learning · Computer Science 2019-08-27 Rose Yu , Stephan Zheng , Anima Anandkumar , Yisong Yue

Weather Forecasting is an attractive challengeable task due to its influence on human life and complexity in atmospheric motion. Supported by massive historical observed time series data, the task is suitable for data-driven approaches,…

Machine Learning · Computer Science 2022-09-20 Minbo Ma , Peng Xie , Fei Teng , Tianrui Li , Bin Wang , Shenggong Ji , Junbo Zhang

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

Machine Learning · Computer Science 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

Long-range sequence modeling is a crucial aspect of natural language processing and time series analysis. However, traditional models like Recurrent Neural Networks (RNNs) and Transformers suffer from computational and memory…

Artificial Intelligence · Computer Science 2025-01-15 Mohamed A. Taha

Multivariate time series data provide a robust framework for future predictions by leveraging information across multiple dimensions, ensuring broad applicability in practical scenarios. However, their high dimensionality and mixing…

Machine Learning · Computer Science 2024-11-28 Xuanbing Zhu , Dunbin Shen , Zhongwen Rao , Huiyi Ma , Yingguang Hao , Hongyu Wang

Optimal decision-making in social settings is often based on forecasts from time series (TS) data. Recently, several approaches using deep neural networks (DNNs) such as recurrent neural networks (RNNs) have been introduced for TS…

Machine Learning · Computer Science 2020-11-17 Philippe Chatigny , Jean-Marc Patenaude , Shengrui Wang

Analysis of time-series data allows to identify long-term trends and make predictions that can help to improve our lives. With the rapid development of artificial neural networks, long short-term memory (LSTM) recurrent neural network (RNN)…

Emerging Technologies · Computer Science 2018-09-11 Kazybek Adam , Kamilya Smagulova , Alex Pappachen James

Accurate forecasting of long-term time series has important applications for decision making and planning. However, it remains challenging to capture the long-term dependencies in time series data. To better extract long-term dependencies,…

Machine Learning · Computer Science 2024-05-15 Feifei Li , Suhan Guo , Feng Han , Jian Zhao , Furao Shen