English
Related papers

Related papers: ReMamber: Referring Image Segmentation with Mamba …

200 papers

The Transformer architecture has shown a remarkable ability in modeling global relationships. However, it poses a significant computational challenge when processing high-dimensional medical images. This hinders its development and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhaohu Xing , Tian Ye , Yijun Yang , Guang Liu , Lei Zhu

Referring Image Segmentation (RIS) aims to segment the target object in an image given a natural language expression. While recent methods leverage pre-trained vision backbones and more training corpus to achieve impressive results, they…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Zhenjie Mao , Yuhuan Yang , Chaofan Ma , Dongsheng Jiang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Transformer-based methods have demonstrated remarkable capabilities in 3D semantic segmentation through their powerful attention mechanisms, but the quadratic complexity limits their modeling of long-range dependencies in large-scale point…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Xinyu Wang , Jinghua Hou , Zhe Liu , Yingying Zhu

Transformers have demonstrated impressive results for 3D point cloud semantic segmentation. However, the quadratic complexity of transformer makes computation costs high, limiting the number of points that can be processed simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhuoyuan Li , Yubo Ai , Jiahao Lu , ChuXin Wang , Jiacheng Deng , Hanzhi Chang , Yanzhe Liang , Wenfei Yang , Shifeng Zhang , Tianzhu Zhang

Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yiheng Lyu , Lian Xu , Mohammed Bennamoun , Farid Boussaid , Coen Arrow , Girish Dwivedi

Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Md Maklachur Rahman , Abdullah Aman Tutul , Ankur Nath , Lamyanba Laishram , Soon Ki Jung , Tracy Hammond

Despite the remarkable quality of LLM-based text-to-speech systems, their reliance on autoregressive Transformers leads to quadratic computational complexity, which severely limits practical applications. Linear-time alternatives, notably…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-16 Tan Dat Nguyen , Sangmin Bae , Joon Son Chung , Ji-Hoon Kim

Magnetic resonance imaging (MRI) is a cornerstone of modern clinical diagnosis, offering unparalleled soft-tissue contrast without ionizing radiation. However, prolonged scan times remain a major barrier to patient throughput and comfort.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Weiyi Lyu , Xinming Fang , Jun Wang , Jun Shi , Guixu Zhang , Juncheng Li

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Mingya Zhang , Yue Yu , Limei Gu , Tingsheng Lin , Xianping Tao

Semantic segmentation of remote sensing images is a fundamental task in geoscience research. However, there are some significant shortcomings for the widely used convolutional neural networks (CNNs) and Transformers. The former is limited…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Xianping Ma , Xiaokang Zhang , Man-On Pun

Transformers are the cornerstone of modern large language models, but their quadratic computational complexity limits efficiency in long-sequence processing. Recent advancements in Mamba, a state space model (SSM) with linear complexity,…

Machine Learning · Computer Science 2026-01-08 Yixing Li , Ruobing Xie , Zhen Yang , Xingwu Sun , Shuaipeng Li , Weidong Han , Zhanhui Kang , Yu Cheng , Chengzhong Xu , Di Wang , Jie Jiang

Mamba has shown great potential for computer vision due to its linear complexity in modeling the global context with respect to the input length. However, existing lightweight Mamba-based backbones cannot demonstrate performance that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xiaowen Ma , Zhenliang Ni , Xinghao Chen

Image inpainting, or image completion, is a crucial task in computer vision that aims to restore missing or damaged regions of images with semantically coherent content. This technique requires a precise balance of local texture replication…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Shuang Chen , Amir Atapour-Abarghouei , Haozheng Zhang , Hubert P. H. Shum

The Mamba architecture has been widely applied to various low-level vision tasks due to its exceptional adaptability and strong performance. Although the Mamba architecture has been adopted for spectral reconstruction, it still faces the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Yuze Zhang , Lingjie Li , Qiuzhen Lin , Zhong Ming , Fei Yu , Victor C. M. Leung

Image generation models have encountered challenges related to scalability and quadratic complexity, primarily due to the reliance on Transformer-based backbones. In this study, we introduce MaskMamba, a novel hybrid model that combines…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Wenchao Chen , Liqiang Niu , Ziyao Lu , Fandong Meng , Jie Zhou

While the Mamba architecture demonstrates superior inference efficiency and competitive performance on short-context natural language processing (NLP) tasks, empirical evidence suggests its capacity to comprehend long contexts is limited…

Computation and Language · Computer Science 2025-01-03 Danlong Yuan , Jiahao Liu , Bei Li , Huishuai Zhang , Jingang Wang , Xunliang Cai , Dongyan Zhao

Image restoration aims to recover details and enhance contrast in degraded images. With the growing demand for high-quality imaging (\textit{e.g.}, 4K and 8K), achieving a balance between restoration quality and computational efficiency has…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Long Peng , Xin Di , Zhanfeng Feng , Wenbo Li , Renjing Pei , Yang Wang , Xueyang Fu , Yang Cao , Zheng-Jun Zha

3D assets have rapidly expanded in quantity and diversity due to the growing popularity of virtual reality and gaming. As a result, text-to-shape retrieval has become essential in facilitating intuitive search within large repositories.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Khanh Nguyen , Dasith de Silva Edirimuni , Ghulam Mubashar Hassan , Ajmal Mian

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Diffusion models have achieved great success in image generation, with the backbone evolving from U-Net to Vision Transformers. However, the computational cost of Transformers is quadratic to the number of tokens, leading to significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yao Teng , Yue Wu , Han Shi , Xuefei Ning , Guohao Dai , Yu Wang , Zhenguo Li , Xihui Liu