English
Related papers

Related papers: Stecformer: Spatio-temporal Encoding Cascaded Tran…

200 papers

Multivariate time-series forecasting plays a crucial role in many real-world applications. It is a challenging problem as one needs to consider both intra-series temporal correlations and inter-series correlations simultaneously. Recently,…

Machine Learning · Computer Science 2021-03-16 Defu Cao , Yujing Wang , Juanyong Duan , Ce Zhang , Xia Zhu , Conguri Huang , Yunhai Tong , Bixiong Xu , Jing Bai , Jie Tong , Qi Zhang

A variety of real-world applications rely on far future information to make decisions, thus calling for efficient and accurate long sequence multivariate time series forecasting. While recent attention-based forecasting models show strong…

Machine Learning · Computer Science 2022-05-02 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang , Tung Kieu , Xuanyi Dong , Shirui Pan

Multivariate time series (MTS) forecasting is vital in fields like weather, energy, and finance. However, despite deep learning advancements, traditional Transformer-based models often diminish the effect of crucial inter-variable…

Machine Learning · Computer Science 2025-03-03 Yanhong Li , David C. Anastasiu

Predicting high-dimensional dynamical systems with irregular time steps presents significant challenges for current data-driven algorithms. These irregularities arise from missing data, sparse observations, or adaptive computational…

Machine Learning · Computer Science 2026-03-27 Kewei Zhu , Yanze Xin , Jinwei Hu , Xiaoyuan Cheng , Yiming Yang , Sibo Cheng

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

Machine Learning · Computer Science 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

Time series generation focuses on modeling the underlying data distribution and resampling to produce authentic time series data. Key components, such as trend and seasonality, drive temporal fluctuations, yet many existing approaches fail…

Machine Learning · Computer Science 2025-11-04 Zixuan Ma , Chenfeng Huang

We introduce a temporal feature encoding architecture called Time Series Representation Model (TSRM) for multivariate time series forecasting and imputation. The architecture is structured around CNN-based representation layers, each…

Machine Learning · Computer Science 2025-04-29 Robert Leppich , Michael Stenger , Daniel Grillmeyer , Vanessa Borst , Samuel Kounev

Transformers are widely used deep learning architectures. Existing transformers are mostly designed for sequences (texts or time series), images or videos, and graphs. This paper proposes a novel transformer model for massive (up to a…

Machine Learning · Computer Science 2023-11-09 Wenchong He , Zhe Jiang , Tingsong Xiao , Zelin Xu , Shigang Chen , Ronald Fick , Miles Medina , Christine Angelini

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

Machine Learning · Computer Science 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

Detectors with high coverage have direct and far-reaching benefits for road users in route planning and avoiding traffic congestion, but utilizing these data presents unique challenges including: the dynamic temporal correlation, and the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 He Li , Shiyu Zhang , Xuejiao Li , Liangcai Su , Hongjie Huang , Duo Jin , Linghao Chen , Jianbing Huang , Jaesoo Yoo

A recent variation of Transformer, Performer, scales Transformer to longer sequences with a linear attention mechanism. However, it is not compatible with relative position encoding, which has advantages over absolute position encoding. In…

Computation and Language · Computer Science 2021-09-09 Peng Chen

Leveraging spatio-temporal correlations among wind farms can significantly enhance the accuracy of ultra-short-term wind power forecasting. However, the complex and dynamic nature of these correlations presents significant modeling…

Machine Learning · Computer Science 2024-12-17 Xiaochong Dong , Xuemin Zhang , Ming Yang , Shengwei Mei

Recent innovations in diffusion probabilistic models have paved the way for significant progress in image, text and audio generation, leading to their applications in generative time series forecasting. However, leveraging such abilities to…

Machine Learning · Computer Science 2025-11-07 Yuansan Liu , Sudanthi Wijewickrema , Dongting Hu , Christofer Bester , Stephen O'Leary , James Bailey

Traffic forecasting, which aims to predict traffic conditions based on historical observations, has been an enduring research topic and is widely recognized as an essential component of intelligent transportation. Recent proposals on…

Machine Learning · Computer Science 2025-12-23 Zezhi Shao , Fei Wang , Tao Sun , Chengqing Yu , Yuchen Fang , Guangyin Jin , Zhulin An , Yang Liu , Xiaobo Qu , Yongjun Xu

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

Time-series forecasts are essential for planning and decision-making in many domains. Explainability is key to building user trust and meeting transparency requirements. Shapley Additive Explanations (SHAP) is a popular explainable AI…

Machine Learning · Computer Science 2025-12-24 Matthias Hertel , Sebastian Pütz , Ralf Mikut , Veit Hagenmeyer , Benjamin Schäfer

A target recognition framework relying on near-field integrated sensing and communication (ISAC) systems is proposed. By exploiting the distance-dependent spatial signatures provided by the near-field spherical wavefront, high-accuracy…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Zongyao Zhao , Zhaolin Wang , Lincong Han , Jing Jin , Kaibin Huang

Long-term time series forecasting (LTSF) is a challenging task that has been investigated in various domains such as finance investment, health care, traffic, and weather forecasting. In recent years, Linear-based LTSF models showed better…

Machine Learning · Computer Science 2023-11-13 Seonkyu Lim , Jaehyeon Park , Seojin Kim , Hyowon Wi , Haksoo Lim , Jinsung Jeon , Jeongwhan Choi , Noseong Park

We consider $N$-way data arrays and low-rank tensor factorizations where the time mode is coded as a sparse linear combination of temporal elements from an over-complete library. Our method, Shape Constrained Tensor Decomposition (SCTD) is…

Machine Learning · Statistics 2016-08-17 Bethany Lusch , Eric C. Chi , J. Nathan Kutz