English
Related papers

Related papers: Enhancing Mamba Decoder with Bidirectional Interac…

200 papers

The Vision Transformer (ViT) model has long struggled with the challenge of quadratic complexity, a limitation that becomes especially critical in unmanned aerial vehicle (UAV) tracking systems, where data must be processed in real time. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Bingxi Liu , Calvin Chen , Junhao Li , Guyang Yu , Haoqian Song , Xuchen Liu , Jinqiang Cui , Hong Zhang

Multi-task dense prediction solves complementary pixel-level tasks in a unified model, such as semantic segmentation, depth estimation, surface normal estimation, and edge detection. Existing decoder-side interactions use attention,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Meihua Zhou , Li Yang

Human-human interaction generation has garnered significant attention in motion synthesis due to its vital role in understanding humans as social beings. However, existing methods typically rely on transformer-based architectures, which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zizhao Wu , Yingying Sun , Yiming Chen , Xiaoling Gu , Ruyu Liu , Jiazhou Chen

In recent years, Visual Question Localized-Answering in robotic surgery (Surgical-VQLA) has gained significant attention for its potential to assist medical students and junior doctors in understanding surgical scenes. Recently, the rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pengfei Hao , Hongqiu Wang , Shuaibo Li , Zhaohu Xing , Guang Yang , Kaishun Wu , Lei Zhu

Underwater Instance Segmentation (UIS) tasks are crucial for underwater complex scene detection. Mamba, as an emerging state space model with inherently linear complexity and global receptive fields, is highly suitable for processing image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Runmin Cong , Zongji Yu , Hao Fang , Haoyan Sun , Sam Kwong

In multimodal sentiment analysis (MSA), the performance of a model highly depends on the quality of synthesized embeddings. These embeddings are generated from the upstream process called multimodal fusion, which aims to extract and combine…

Computation and Language · Computer Science 2021-09-17 Wei Han , Hui Chen , Soujanya Poria

Acquiring high-quality annotated data for medical image segmentation is tedious and costly. Semi-supervised segmentation techniques alleviate this burden by leveraging unlabeled data to generate pseudo labels. Recently, advanced state space…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shumeng Li , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

In data-scarce scenarios, deep learning models often overfit to noise and irrelevant patterns, which limits their ability to generalize to unseen samples. To address these challenges in medical image segmentation, we introduce Diff-UMamba,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Dhruv Jain , Romain Modzelewski , Romain Herault , Clement Chatelain , Eva Torfeh , Sebastien Thureau

In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 T-Mai Bui , Fares Bougourzi , Fadi Dornaika , Vinh Truong Hoang

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Rui Xu , Shu Yang , Yihui Wang , Yu Cai , Bo Du , Hao Chen

We introduce a novel deep learning method for decoding error correction codes based on the Mamba architecture, enhanced with Transformer layers. Our approach proposes a hybrid decoder that leverages Mamba's efficient sequential modeling…

Information Theory · Computer Science 2025-05-26 Shy-el Cohen , Yoni Choukroun , Eliya Nachmani

Existing state-of-the-art feature matchers capture long-range dependencies with Transformers but are hindered by high spatial complexity, leading to demanding training and highlatency inference. Striking a better balance between performance…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Xiaoyong Lu , Songlin Du

Wearable sensor-based human activity recognition (HAR) is a critical research domain in activity perception. However, achieving high efficiency and long sequence recognition remains a challenge. Despite the extensive investigation of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Shuangjian Li , Tao Zhu , Furong Duan , Liming Chen , Huansheng Ning , Christopher Nugent , Yaping Wan

Micro-expressions are typically regarded as unconscious manifestations of a person's genuine emotions. However, their short duration and subtle signals pose significant challenges for downstream recognition. We propose a multi-task learning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Xuxiong Liu , Tengteng Dong , Fei Wang , Weijie Feng , Xiao Sun

Mamba and Vision Mamba (Vim) models have shown their potential as an alternative to methods based on Transformer architecture. This work introduces Fast Mamba for Vision (Famba-V), a cross-layer token fusion technique to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Hui Shen , Zhongwei Wan , Xin Wang , Mi Zhang

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal

Human engagement estimation in conversational scenarios is essential for applications such as adaptive tutoring, remote healthcare assessment, and socially aware human--computer interaction. Engagement is a dynamic, multimodal signal…

Artificial Intelligence · Computer Science 2025-09-23 Shenwei Kang , Xin Zhang , Wen Liu , Bin Li , Yujie Liu , Bo Gao

Reconstructing high-fidelity MR images from undersampled k-space data remains a challenging problem in MRI. While Mamba variants for vision tasks offer promising long-range modeling capabilities with linear-time complexity, their direct…

Image and Video Processing · Electrical Eng. & Systems 2026-05-05 Hongli Chen , Pengcheng Fang , Yuxia Chen , Yingxuan Ren , Jing Hao , Fangfang Tang , Xiaohao Cai , Shanshan Shan , Feng Liu

Numerous CNN-Transformer hybrid models rely on high-complexity global attention mechanisms to capture long-range dependencies, which introduces non-linear computational complexity and leads to significant resource consumption. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dayu Tan , Ziwei Zhang , Yansan Su , Xin Peng , Yike Dai , Chunhou Zheng , Weimin Zhong