English
Related papers

Related papers: HDT: Hierarchical Discrete Transformer for Multiva…

200 papers

The forecasting of Multivariate Time Series (MTS) has long been an important but challenging task. Due to the non-stationary problem across long-distance time steps, previous studies primarily adopt stationarization method to attenuate the…

Machine Learning · Computer Science 2024-03-11 Muyao Wang , Wenchao Chen , Bo Chen

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

Machine Learning · Computer Science 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

Discrete Token Modeling (DTM), which employs vector quantization techniques, has demonstrated remarkable success in modeling non-natural language modalities, particularly in time series generation. While our prior work SDformer established…

Machine Learning · Computer Science 2026-04-07 Shibo Feng , Zhicheng Chen , Xi Xiao , Zhong Zhang , Qing Li , Xingyu Gao , Peilin Zhao

Accurate forecasting of multivariate time series data remains a formidable challenge, particularly due to the growing complexity of temporal dependencies in real-world scenarios. While neural network-based models have achieved notable…

Machine Learning · Computer Science 2025-12-09 Andrey Savchenko , Oleg Kachan

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

While generative modeling on time series facilitates more capable and flexible probabilistic forecasting, existing generative time series models do not address the multi-dimensional properties of time series data well. The prevalent…

Machine Learning · Computer Science 2026-02-09 Haoran Zhang , Haixuan Liu , Yong Liu , Yunzhong Qiu , Yuxuan Wang , Jianmin Wang , Mingsheng Long

Time series forecasting is a critical and challenging task in practical application. Recent advancements in pre-trained foundation models for time series forecasting have gained significant interest. However, current methods often overlook…

Machine Learning · Computer Science 2024-08-02 Shubao Zhao , Ming Jin , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Qingsong Wen , Yi Wang

We propose a novel approach to the problem of clustering hierarchically aggregated time-series data, which has remained an understudied problem though it has several commercial applications. We first group time series at each aggregated…

Machine Learning · Computer Science 2022-05-30 Xing Han , Tongzheng Ren , Jing Hu , Joydeep Ghosh , Nhat Ho

Time Series forecasting (TSF) in the modern era faces significant computational and storage cost challenges due to the massive scale of real-world data. Dataset Distillation (DD), a paradigm that synthesizes a small, compact dataset to…

Machine Learning · Computer Science 2026-03-05 Seungha Hong , Sanghwan Jang , Wonbin Kweon , Suyeon Kim , Gyuseok Lee , Hwanjo Yu

Recent efforts have been dedicated to enhancing time series forecasting accuracy by introducing advanced network architectures and self-supervised pretraining strategies. Nevertheless, existing approaches still exhibit two critical…

Machine Learning · Computer Science 2024-06-19 Zhiding Liu , Jiqian Yang , Mingyue Cheng , Yucong Luo , Zhi Li

Deep models for Multivariate Time Series (MTS) forecasting have recently demonstrated significant success. Channel-dependent models capture complex dependencies that channel-independent models cannot capture. However, the number of channels…

Machine Learning · Computer Science 2024-08-09 Xin Zhou , Weiqing Wang , Wray Buntine , Shilin Qu , Abishek Sriramulu , Weicong Tan , Christoph Bergmeir

This paper introduces a novel spatiotemporal feature representation model designed to address the limitations of traditional methods in multidimensional time series (MTS) analysis. The proposed approach converts MTS into one-dimensional…

Machine Learning · Computer Science 2024-10-10 Xu Yan , Yaoting Jiang , Wenyi Liu , Didi Yi , Jianjun Wei

Multivariate Time Series (MTS) forecasting involves modeling temporal dependencies within historical records. Transformers have demonstrated remarkable performance in MTS forecasting due to their capability to capture long-term…

Machine Learning · Computer Science 2024-07-17 Yifan Zhang , Rui Wu , Sergiu M. Dascalu , Frederick C. Harris

Forecasting on sparse multivariate time series (MTS) aims to model the predictors of future values of time series given their incomplete past, which is important for many emerging applications. However, most existing methods process MTS's…

Machine Learning · Computer Science 2021-03-04 Yinjun Wu , Jingchao Ni , Wei Cheng , Bo Zong , Dongjin Song , Zhengzhang Chen , Yanchi Liu , Xuchao Zhang , Haifeng Chen , Susan Davidson

Multivariate time series forecasting is widely used in various fields. Reasonable prediction results can assist people in planning and decision-making, generate benefits and avoid risks. Normally, there are two characteristics of time…

Machine Learning · Computer Science 2021-03-23 Yifu Zhou , Ziheng Duan , Haoyan Xu , Jie Feng , Anni Ren , Yueyang Wang , Xiaoqian Wang

Accurate trajectory forecasting is crucial for the performance of various systems, such as advanced driver-assistance systems and self-driving vehicles. These forecasts allow us to anticipate events that lead to collisions and, therefore,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Adrien Lafage , Mathieu Barbier , Gianni Franchi , David Filliat

In order to enhance the performance of Transformer models for long-term multivariate forecasting while minimizing computational demands, this paper introduces the Joint Time-Frequency Domain Transformer (JTFT). JTFT combines time and…

Machine Learning · Computer Science 2023-10-31 Yushu Chen , Shengzhuo Liu , Jinzhe Yang , Hao Jing , Wenlai Zhao , Guangwen Yang

Industrial Multivariate Time Series (MTS) is a critical view of the industrial field for people to understand the state of machines. However, due to data collection difficulty and privacy concerns, available data for building industrial…

Machine Learning · Computer Science 2024-10-23 Lei Ren , Haiteng Wang , Yuanjun Laili

Dynamical system models (including RNNs) often lack the ability to adapt the sequence generation or prediction to a given context, limiting their real-world application. In this paper we show that hierarchical multi-task dynamical systems…

Machine Learning · Computer Science 2019-10-14 Alex Bird , Christopher K. I. Williams

Coherently forecasting the behaviour of a target variable across both coarse and fine temporal scales is crucial for profit-optimized decision-making in several business applications, and remains an open research problem in temporal…

Machine Learning · Computer Science 2025-06-25 Alessandro Salatiello , Stefan Birr , Manuel Kunz
‹ Prev 1 2 3 10 Next ›