English
Related papers

Related papers: Scalable Transformer for High Dimensional Multivar…

200 papers

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

Machine Learning · Computer Science 2024-12-30 Peiwang Tang , Weitai Zhang

Spatial-temporal graphs are widely used in a variety of real-world applications. Spatial-Temporal Graph Neural Networks (STGNNs) have emerged as a powerful tool to extract meaningful insights from this data. However, in real-world…

Machine Learning · Computer Science 2024-12-18 Zhenyu Lei , Yushun Dong , Jundong Li , Chen Chen

This paper introduces a novel spatiotemporal feature representation model designed to address the limitations of traditional methods in multidimensional time series (MTS) analysis. The proposed approach converts MTS into one-dimensional…

Machine Learning · Computer Science 2024-10-10 Xu Yan , Yaoting Jiang , Wenyi Liu , Didi Yi , Jianjun Wei

Multivariate time series (MTS) forecasting is vital across various domains but remains challenging due to the need to simultaneously model temporal and inter-variate dependencies. Existing channel-dependent models, where Transformer-based…

Machine Learning · Computer Science 2025-02-03 Junwoo Ha , Hyukjae Kwon , Sungsoo Kim , Kisu Lee , Seungjae Park , Ha Young Kim

High-dimensional multivariate time series are challenging due to the dependent and high-dimensional nature of the data, but in many applications there is additional structure that can be exploited to reduce computing time along with…

Methodology · Statistics 2020-03-13 Michael Schweinberger , Sergii Babkin , Katherine Ensor

Multivariate time-series (MTS) forecasting is a challenging task in many real-world non-stationary dynamic scenarios. In addition to intra-series temporal signals, the inter-series dependency also plays a crucial role in shaping future…

Machine Learning · Computer Science 2023-12-29 Weijun Chen , Heyuan Wang , Ye Tian , Shijie Guan , Ning Liu

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are…

Machine Learning · Computer Science 2022-08-22 William T. Ng , K. Siu , Albert C. Cheung , Michael K. Ng

Large vision models (LVMs) have recently proven to be surprisingly effective time series forecasters, simply by rendering temporal data as images. This success, how ever, rests on a largely unexamined premise: the rendered time series…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Mingrui Zhang , Hanchen Yang , Wengen Li , Xudong Jiang , Yichao Zhang , Jihong Guan , Shuigeng Zhou

Long-term satellite image time series (SITS) analysis in heterogeneous landscapes faces significant challenges, particularly in Mediterranean regions where complex spatial patterns, seasonal variations, and multi-decade environmental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ido Faran , Nathan S. Netanyahu , Maxim Shoshany

Speech super-resolution (SR) reconstructs high-fidelity wideband speech from low-resolution inputs-a task that necessitates reconciling global harmonic coherence with local transient sharpness. While diffusion-based generative models yield…

Sound · Computer Science 2026-01-01 Jiajun Yuan , Xiaochen Wang , Yuhang Xiao , Yulin Wu , Chenhao Hu , Xueyang Lv

Transformer-based architectures have achieved remarkable success in natural language processing and computer vision. However, their performance in multivariate long-term forecasting often falls short compared to simpler linear baselines.…

Machine Learning · Computer Science 2025-07-09 Dizhen Liang

Long-term time series forecasting (LTSF) offers broad utility in practical settings like energy consumption and weather prediction. Accurately predicting long-term changes, however, is demanding due to the intricate temporal patterns and…

Machine Learning · Computer Science 2025-05-19 Boshi Gao , Qingjian Ni , Fanbo Ju , Yu Chen , Ziqi Zhao

The massive generation of time-series data by largescale Internet of Things (IoT) devices necessitates the exploration of more effective models for multivariate time-series forecasting. In previous models, there was a predominant use of the…

Machine Learning · Computer Science 2024-03-15 Wenyong Han , Tao Zhu Member , Liming Chen , Huansheng Ning , Yang Luo , Yaping Wan

Solving large-scale multistage stochastic programming (MSP) problems poses a significant challenge as commonly used stagewise decomposition algorithms, including stochastic dual dynamic programming (SDDP), face growing time complexity as…

Machine Learning · Computer Science 2025-02-12 Chanyeong Kim , Jongwoong Park , Hyunglip Bae , Woo Chang Kim

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

As the most representative scenario of spatial-temporal forecasting tasks, the traffic forecasting task attracted numerous attention from machine learning community due to its intricate correlation both in space and time dimension. Existing…

Machine Learning · Computer Science 2024-09-16 Xinyu Ning

Multivariate time series forecasting is widely applied in fields such as transportation, energy, and finance. However, the data commonly suffers from issues of multi-scale characteristics, weak correlations, and noise interference, which…

Machine Learning · Computer Science 2026-03-02 Xiang Ao

Multivariate Time Series Forecasting (MTSF) has long been a key research focus. Traditionally, these studies assume a fixed number of variables, but in real-world applications, Cyber-Physical Systems often expand as new sensors are…

Machine Learning · Computer Science 2025-06-03 Minbo Ma , Kai Tang , Huan Li , Fei Teng , Dalin Zhang , Tianrui Li

In recent years, effectively modeling multivariate time series has gained significant popularity, mainly due to its wide range of applications, ranging from healthcare to financial markets and energy management. Transformers, MLPs, and…

Machine Learning · Computer Science 2025-11-04 Asal Meskin , Alireza Mirrokni , Ali Najar , Ali Behrouz

Multivariate time series (MTS) forecasting plays an important role in the automation and optimization of intelligent applications. It is a challenging task, as we need to consider both complex intra-variable dependencies and inter-variable…

Machine Learning · Computer Science 2023-04-11 Ling Chen , Donghui Chen , Zongjiang Shang , Binqing Wu , Cen Zheng , Bo Wen , Wei Zhang