English
Related papers

Related papers: TSkel-Mamba: Temporal Dynamic Modeling via State S…

200 papers

Mamba-based models have drawn much attention in offline RL. However, their selective mechanism often detrimental when key steps in RL sequences are omitted. To address these issues, we propose a simple yet effective structure, called…

Machine Learning · Computer Science 2026-02-27 Wall Kim , Chaeyoung Song , Hanul Kim

Motor imagery (MI) classification is key for brain-computer interfaces (BCIs). Until recent years, numerous models had been proposed, ranging from classical algorithms like Common Spatial Pattern (CSP) to deep learning models such as…

Human-Computer Interaction · Computer Science 2024-09-20 Xiaoxiao Yang , Ziyu Jia

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

Transformer-based methods for 3D human pose estimation face significant computational challenges due to the quadratic growth of self-attention mechanism complexity with sequence length. Recently, the Mamba model has substantially reduced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zenghao Zheng , Lianping Yang , Jinshan Pan , Hegui Zhu

While the conditional sequence modeling with the transformer architecture has demonstrated its effectiveness in dealing with offline reinforcement learning (RL) tasks, it is struggle to handle out-of-distribution states and actions.…

Machine Learning · Computer Science 2025-01-23 Qi Lv , Xiang Deng , Gongwei Chen , Michael Yu Wang , Liqiang Nie

Accurate traffic prediction plays a vital role in intelligent transportation systems by enabling efficient routing, congestion mitigation, and proactive traffic control. However, forecasting is challenging due to the combined effects of…

Machine Learning · Computer Science 2025-07-08 Mohamed Hamad , Mohamed Mabrok , Nizar Zorba

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

With intelligent room-side sensing and service robots widely deployed, human motion prediction (HMP) is essential for safe, proactive assistance. However, many existing HMP methods either produce a single, deterministic forecast that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junqiao Fan , Pengfei Liu , Haocong Rao

State space models (SSMs), such as Mamba, have emerged as an efficient alternative to transformers for long-context sequence modeling. However, despite their growing adoption, SSMs lack the interpretability tools that have been crucial for…

Computation and Language · Computer Science 2025-02-26 Hugo Pitorro , Marcos Treviso

Training urban spatio-temporal foundation models that generalize well across diverse regions and cities is critical for deploying urban services in unseen or data-scarce regions. Recent studies have typically focused on fusing cross-domain…

Machine Learning · Computer Science 2026-02-04 Rui An , Yifeng Zhang , Ziran Liang , Wenqi Fan , Yuxuan Liang , Xuequn Shang , Qing Li

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Time series foundation models have demonstrated strong performance in zero-shot learning, making them well-suited for predicting rapidly evolving patterns in real-world applications where relevant training data are scarce. However, most of…

Machine Learning · Computer Science 2024-11-06 Haoyu Ma , Yushu Chen , Wenlai Zhao , Jinzhe Yang , Yingsheng Ji , Xinghua Xu , Xiaozhu Liu , Hao Jing , Shengzhuo Liu , Guangwen Yang

The vision-language tracking task aims to perform object tracking based on various modality references. Existing Transformer-based vision-language tracking methods have made remarkable progress by leveraging the global modeling ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xinqi Liu , Li Zhou , Zikun Zhou , Jianqiu Chen , Zhenyu He

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

The field of neuromorphic computing has gained significant attention in recent years, aiming to bridge the gap between the efficiency of biological neural networks and the performance of artificial intelligence systems. This paper…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Jiahao Qin , Feng Liu

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

State Space Models (SSMs), particularly the Mamba architecture, have recently emerged as powerful alternatives to Transformers for sequence modeling, offering linear computational complexity while achieving competitive performance. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Mohamed A. Mabrok , Yalda Zafari

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

Physics-informed machine learning (PIML) has emerged as a promising alternative to classical methods for predicting dynamical systems, offering faster and more generalizable solutions. However, existing models, including recurrent neural…

Machine Learning · Computer Science 2025-01-28 Zheyuan Hu , Nazanin Ahmadi Daryakenari , Qianli Shen , Kenji Kawaguchi , George Em Karniadakis