English
Related papers

Related papers: InceptionMamba: An Efficient Hybrid Network with L…

200 papers

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

Multi-modal medical image synthesis involves nonlinear transformation of tissue signals between source and target modalities, where tissues exhibit contextual interactions across diverse spatial distances. As such, the utility of a network…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Omer F. Atli , Bilal Kabas , Fuat Arslan , Arda C. Demirtas , Mahmut Yurt , Onat Dalmaz , Tolga Çukur

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

Capturing long-range dependencies (LRD) efficiently is a core challenge in visual recognition, and state-space models (SSMs) have recently emerged as a promising alternative to self-attention for addressing it. However, adapting SSMs into…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yunusa Haruna , Adamu Lawan , Shamsuddeen Hassan Muhammad , Jiaquan Zhang , Chaoning Zhang

Remote sensing image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral data and a low-resolution image rich in spectral information. Current deep learning (DL)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Siran Peng , Xiangyu Zhu , Haoyu Deng , Liang-Jian Deng , Zhen Lei

Graph Neural Networks (GNNs) have shown great success in various graph-based learning tasks. However, it often faces the issue of over-smoothing as the model depth increases, which causes all node representations to converge to a single…

Machine Learning · Computer Science 2026-04-13 Xin He , Yili Wang , Wenqi Fan , Xu Shen , Xin Juan , Rui Miao , Xin Wang

Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Yan He , Bing Tu , Bo Liu , Jun Li , Antonio Plaza

In scene text detection, Transformer-based methods have addressed the global feature extraction limitations inherent in traditional convolution neural network-based methods. However, most directly rely on native Transformer attention layers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiyan Zhao , Yue Yan , Da-Han Wang

The advent of Transformer and Mamba-based architectures has significantly advanced 3D medical image segmentation by enabling global contextual modeling, a capability traditionally limited in Convolutional Neural Networks (CNNs). However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Duy D. Nguyen , Phat T. Tran-Truong

Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yiheng Lyu , Lian Xu , Mohammed Bennamoun , Farid Boussaid , Coen Arrow , Girish Dwivedi

In the design of surgical guides for implant placement, determining the precise implant position is a critical step. However, the implant region itself is often characterized by a lack of distinctive texture in medical images. Consequently,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Xinquan Yang , Congmin Wang , Xuguang Li , Yulei Li , Linlin Shen , Yongqiang Deng He Meng

Deep learning models, specifically convolutional neural networks, have transformed the landscape of image classification by autonomously extracting features directly from raw pixel data. This article introduces an innovative image…

Image and Video Processing · Electrical Eng. & Systems 2024-12-19 Fatemeh Froughirad , Reza Bakhoda Eshtivani , Hamed Khajavi , Amir Rastgoo

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao

Mamba, a recently proposed linear-time sequence model, has attracted significant attention for its computational efficiency and strong empirical performance. However, a rigorous theoretical understanding of its underlying mechanisms remains…

Machine Learning · Computer Science 2026-02-13 Junsoo Oh , Wei Huang , Taiji Suzuki

Deep learning, particularly convolutional neural networks (CNNs) and Transformers, has significantly advanced 3D medical image segmentation. While CNNs are highly effective at capturing local features, their limited receptive fields may…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Chenyuan Bian , Nan Xia , Xia Yang , Feifei Wang , Fengjiao Wang , Bin Wei , Qian Dong

In a real-world traffic scenario, varying-scale objects are usually distributed in a cluttered background, which poses great challenges to accurate detection. Although current Mamba-based methods can efficiently model long-range…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jun Li , Yingying Shi , Zhixuan Ruan , Nan Guo , Jianhua Xu

Recently, Mamba-based methods have become popular in medical image segmentation due to their lightweight design and long-range dependency modeling capabilities. However, current segmentation methods frequently encounter challenges in fetal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Caixu Xu , Junming Wei , Huizhen Chen , Pengchen Liang , Bocheng Liang , Ying Tan , Xintong Wei

While the Mamba architecture demonstrates superior inference efficiency and competitive performance on short-context natural language processing (NLP) tasks, empirical evidence suggests its capacity to comprehend long contexts is limited…

Computation and Language · Computer Science 2025-01-03 Danlong Yuan , Jiahao Liu , Bei Li , Huishuai Zhang , Jingang Wang , Xunliang Cai , Dongyan Zhao

Linear modeling methods like Mamba have been merged as the effective backbone for the 3D object detection task. However, previous Mamba-based methods utilize the bidirectional encoding for the whole non-empty voxel sequence, which contains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Runze Yang , Huiying Xu , Xinzhong Zhu , Jie Yang , Wei Liu

Network traffic classification is a crucial research area aiming to enhance service quality, streamline network management, and bolster cybersecurity. To address the growing complexity of transmission encryption techniques, various machine…

Machine Learning · Computer Science 2024-10-22 Tongze Wang , Xiaohui Xie , Wenduo Wang , Chuyi Wang , Youjian Zhao , Yong Cui