English
Related papers

Related papers: CPMamba: Selective State Space Models for MIMO Cha…

200 papers

Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture to more efficiently and effectively model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tao Zhang , Haobo Yuan , Lu Qi , Jiangning Zhang , Qianyu Zhou , Shunping Ji , Shuicheng Yan , Xiangtai Li

Micro-gesture recognition (MGR) targets the identification of subtle and fine-grained human motions and requires accurate modeling of both long-range and local spatiotemporal dependencies. While CNNs are effective at capturing local…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Deng Li , Jun Shao , Bohao Xing , Rong Gao , Bihan Wen , Heikki Kälviäinen , Xin Liu

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ke Cao , Xuanhua He , Tao Hu , Chengjun Xie , Man Zhou , Jie Zhang

With the explosive growth of data, long-sequence modeling has become increasingly important in tasks such as natural language processing and bioinformatics. However, existing methods face inherent trade-offs between efficiency and memory.…

Machine Learning · Computer Science 2025-10-07 Youjin Wang , Yangjingyi Chen , Jiahao Yan , Jiaxuan Lu , Xiao Sun

Sequential recommendation aims to estimate the dynamic user preferences and sequential dependencies among historical user behaviors. Although Transformer-based models have proven to be effective for sequential recommendation, they suffer…

Information Retrieval · Computer Science 2024-07-02 Chengkai Liu , Jianghao Lin , Jianling Wang , Hanzhou Liu , James Caverlee

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Distributed massive MIMO is considered a key advancement for improving the performance of next-generation wireless telecommunication systems. However, its efficacy in scenarios involving user mobility is limited due to channel aging. To…

Information Theory · Computer Science 2024-10-16 Phillip Stephan , Florian Euchner , Stephan ten Brink

In various domains, Sequential Recommender Systems (SRS) have become essential due to their superior capability to discern intricate user preferences. Typically, SRS utilize transformer-based architectures to forecast the subsequent item…

Artificial Intelligence · Computer Science 2024-12-25 Ziwei Liu , Qidong Liu , Yejing Wang , Wanyu Wang , Pengyue Jia , Maolin Wang , Zitao Liu , Yi Chang , Xiangyu Zhao

Automated detection of surgical errors can improve robotic-assisted surgery. Despite promising progress, existing methods still face challenges in capturing rich temporal context to establish long-term dependencies while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Jialang Xu , Nazir Sirajudeen , Matthew Boal , Nader Francis , Danail Stoyanov , Evangelos Mazomenos

Existing Transformer-based models for point cloud analysis suffer from quadratic complexity, leading to compromised point cloud resolution and information loss. In contrast, the newly proposed Mamba model, based on state space models (SSM),…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xu Han , Yuan Tang , Zhaoxuan Wang , Xianzhi Li

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

Long-short range time series forecasting is essential for predicting future trends and patterns over extended periods. While deep learning models such as Transformers have made significant strides in advancing time series forecasting, they…

Machine Learning · Computer Science 2024-09-16 Wenqing Zhang , Junming Huang , Ruotong Wang , Changsong Wei , Wenqian Huang , Yuxin Qiao

Scene flow estimation aims to predict 3D motion from consecutive point cloud frames, which is of great interest in autonomous driving field. Existing methods face challenges such as insufficient spatio-temporal modeling and inherent loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jiehao Luo , Jintao Cheng , Xiaoyu Tang , Qingwen Zhang , Bohuan Xue , Rui Fan

The attention mechanism has become a dominant operator in point cloud learning, but its quadratic complexity leads to limited inter-point interactions, hindering long-range dependency modeling between objects. Due to excellent long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Kanglin Qu , Pan Gao , Qun Dai , Yuanhao Sun

Scaling inference-time compute has emerged as an important driver of LLM performance, making inference efficiency a central focus of model design alongside model quality. While the current Transformer-based models deliver strong model…

Machine Learning · Computer Science 2026-03-17 Aakash Lahoti , Kevin Y. Li , Berlin Chen , Caitlin Wang , Aviv Bick , J. Zico Kolter , Tri Dao , Albert Gu

The strength of carrier-sense multiple access with collision avoidance (CSMA/CA) can be combined with that of time-division multiple access (TDMA) to enhance the channel access performance in wireless networks such as the IEEE…

Networking and Internet Architecture · Computer Science 2016-11-18 Bharat Shrestha , Ekram Hossain , Kae Won Choi

Inter-frame modeling is pivotal in generating intermediate frames for video frame interpolation (VFI). Current approaches predominantly rely on convolution or attention-based models, which often either lack sufficient receptive fields or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Guozhen Zhang , Chunxu Liu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

Convolutional neural networks have primarily led 3D medical image segmentation but may be limited by small receptive fields. Transformer models excel in capturing global relationships through self-attention but are challenged by high…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ao Chang , Jiajun Zeng , Ruobing Huang , Dong Ni

CNN- and Transformer-based architectures have achieved strong performance in medical image segmentation, but CNNs are limited in modeling long-range dependencies, while Transformers often suffer from quadratic computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Diego Adame , Fabian Vazquez , Jose A. Nunez , Huimin Li , Jinghao Yang , Erik Enriquez , DongChul Kim , Haoteng Tang , Bin Fu , Pengfei Gu

Physical field reconstruction (PFR) aims to predict the state distribution of physical quantities (e.g., velocity, pressure, and temperature) based on limited sensor measurements. It plays a critical role in domains such as fluid dynamics…

Machine Learning · Computer Science 2025-05-23 Jiahuan Long , Wenzhe Zhang , Ning Wang , Tingsong Jiang , Wen Yao