English
Related papers

Related papers: MCST-Mamba: Multivariate Mamba-Based Model for Tra…

200 papers

Network traffic classification is a crucial research area aiming to enhance service quality, streamline network management, and bolster cybersecurity. To address the growing complexity of transmission encryption techniques, various machine…

Machine Learning · Computer Science 2024-10-22 Tongze Wang , Xiaohui Xie , Wenduo Wang , Chuyi Wang , Youjian Zhao , Yong Cui

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Long-short range time series forecasting is essential for predicting future trends and patterns over extended periods. While deep learning models such as Transformers have made significant strides in advancing time series forecasting, they…

Machine Learning · Computer Science 2024-09-16 Wenqing Zhang , Junming Huang , Ruotong Wang , Changsong Wei , Wenqian Huang , Yuxin Qiao

Recently, spatio-temporal time-series prediction has developed rapidly, yet existing deep learning methods struggle with learning complex long-term spatio-temporal dependencies efficiently. The long-term spatio-temporal dependency learning…

Machine Learning · Computer Science 2026-05-25 Haolong Chen , Liang Zhang , Zhengyuan Xin , Guangxu Zhu

The development of a cross-city accident prevention system is particularly challenging due to the heterogeneity, inconsistent reporting, and inherently clustered, sparse, cyclical, and noisy nature of urban accident data. These intrinsic…

Machine Learning · Computer Science 2026-01-12 Jiayu Fang , Zhiqi Shao , Haoning Xi , Boris Choy , Junbin Gao

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

Machine Learning · Computer Science 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

Multi-task dense scene understanding, which learns a model for multiple dense prediction tasks, has a wide range of application scenarios. Modeling long-range dependency and enhancing cross-task interactions are crucial to multi-task dense…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Baijiong Lin , Weisen Jiang , Pengguang Chen , Yu Zhang , Shu Liu , Ying-Cong Chen

In multivariate time series forecasting (MTSF), existing strategies for processing sequences are typically categorized as channel-independent and channel-mixing. The former treats all temporal information of each variable as a token,…

Artificial Intelligence · Computer Science 2025-07-08 Bing Fan , Shusen Ma , Yun-Bo Zhao , Yu Kang

Accurately forecasting traffic flows is critically important to many real applications including public safety and intelligent transportation systems. The challenges of this problem include both the dynamic mobility patterns of the people…

Machine Learning · Computer Science 2024-04-24 Hao Miao , Senzhang Wang , Meiyue Zhang , Diansheng Guo , Funing Sun , Fan Yang

In multichannel speech enhancement, effectively capturing spatial and spectral information across different microphones is crucial for noise reduction. Traditional methods, such as CNN or LSTM, attempt to model the temporal dynamics of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Wenze Ren , Haibin Wu , Yi-Cheng Lin , Xuanjun Chen , Rong Chao , Kuo-Hsuan Hung , You-Jin Li , Wen-Yuan Ting , Hsin-Min Wang , Yu Tsao

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

Machine Learning · Computer Science 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Accurate and efficient multivariate time series (MTS) analysis is increasingly critical for a wide range of intelligent applications. Within this realm, Transformers have emerged as the predominant architecture due to their strong ability…

Machine Learning · Computer Science 2026-05-19 Rui An , Haohao Qu , Wenqi Fan , Xuequn Shang , Qing Li

Cellular traffic forecasting is essential for network planning, resource allocation, or load-balancing traffic across cells. However, accurate forecasting is difficult due to intricate spatial and temporal patterns that exist due to the…

Networking and Internet Architecture · Computer Science 2025-08-14 Zineddine Bettouche , Khalid Ali , Andreas Fischer , Andreas Kassler

Traffic prediction is necessary not only for management departments to dispatch vehicles but also for drivers to avoid congested roads. Many traffic forecasting methods based on deep learning have been proposed in recent years, and their…

Machine Learning · Computer Science 2020-05-12 Jichen Wang , Weiguo Zhu , Yongqi Sun , Chunzi Tian

Learning human motion based on a time-dependent input signal presents a challenging yet impactful task with various applications. The goal of this task is to generate or estimate human movement that consistently reflects the temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Quang Nguyen , Tri Le , Baoru Huang , Minh Nhat Vu , Ngan Le , Thieu Vo , Anh Nguyen

This study proposes a hybrid model based on Transformers, named MSCMHMST, aimed at addressing key challenges in traffic flow prediction. Traditional single-method approaches show limitations in traffic prediction tasks, whereas hybrid…

Machine Learning · Computer Science 2025-03-19 Weiyang Geng , Yiming Pan , Zhecong Xing , Dongyu Liu , Rui Liu , Yuan Zhu

Traffic image restoration under adverse weather conditions remains a critical challenge for intelligent transportation systems. Existing methods primarily focus on spatial-domain modeling but neglect frequency-domain priors. Although the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Liwen Pan , Longguang Wang , Guangwei Gao , Jun Wang , Jun Shi , Juncheng Li

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often convert images into 1D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chaodong Xiao , Minghan Li , Zhengqiang Zhang , Deyu Meng , Lei Zhang

Long-term forecasting of chaotic systems remains a fundamental challenge due to the intrinsic sensitivity to initial conditions and the complex geometry of strange attractors. Conventional approaches, such as reservoir computing, typically…

Machine Learning · Computer Science 2025-09-29 Chang Liu , Bohao Zhao , Jingtao Ding , Huandong Wang , Yong Li