English
Related papers

Related papers: ConvVitMamba: Efficient Multiscale Convolution, Tr…

200 papers

Remote sensing image classification forms the foundation of various understanding tasks, serving a crucial function in remote sensing image interpretation. The recent advancements of Convolutional Neural Networks (CNNs) and Transformers…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Keyan Chen , Bowen Chen , Chenyang Liu , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

Convolutional Neural Networks (CNNs) and Vision Transformers (ViT) have been pivotal in biomedical image segmentation, yet their ability to manage long-range dependencies remains constrained by inherent locality and computational overhead.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-03 Tianrun Chen , Chaotao Ding , Lanyun Zhu , Tao Xu , Deyi Ji , Yan Wang , Ying Zang , Zejian Li

Transformers have become foundational for visual tasks such as object detection, semantic segmentation, and video understanding, but their quadratic complexity in attention mechanisms presents scalability challenges. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Fady Ibrahim , Guangjun Liu , Guanghui Wang

Deep learning has profoundly transformed remote sensing, yet prevailing architectures like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) remain constrained by critical trade-offs: CNNs suffer from limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Muyi Bao , Shuchang Lyu , Zhaoyang Xu , Huiyu Zhou , Jinchang Ren , Shiming Xiang , Xiangtai Li , Guangliang Cheng

Point cloud segmentation is an important topic in 3D understanding that has traditionally has been tackled using either the CNN or Transformer. Recently, Mamba has emerged as a promising alternative, offering efficient long-range contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yong Xien Chng , Xuchong Qiu , Yizeng Han , Yifan Pu , Jiewei Cao , Gao Huang

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Rui Xu , Shu Yang , Yihui Wang , Yu Cai , Bo Du , Hao Chen

Food classification is the foundation for developing food vision tasks and plays a key role in the burgeoning field of computational nutrition. Due to the complexity of food requiring fine-grained classification, recent academic research…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Chi-Sheng Chen , Guan-Ying Chen , Dong Zhou , Di Jiang , Dai-Shi Chen

Recently the state space models (SSMs) with efficient hardware-aware designs, i.e., the Mamba deep learning model, have shown great potential for long sequence modeling. Meanwhile building efficient and generic vision backbones purely upon…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Lianghui Zhu , Bencheng Liao , Qian Zhang , Xinlong Wang , Wenyu Liu , Xinggang Wang

In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 T-Mai Bui , Fares Bougourzi , Fadi Dornaika , Vinh Truong Hoang

Hyperspectral images are of crucial importance in order to better understand features of different materials. To reach this goal, they leverage on a high number of spectral bands. However, this interesting characteristic is often paid by a…

Image and Video Processing · Electrical Eng. & Systems 2020-06-01 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng , Tai-Xiang Jiang , Gemine Vivone , Jocelyn Chanussot

Convolutional neural networks have primarily led 3D medical image segmentation but may be limited by small receptive fields. Transformer models excel in capturing global relationships through self-attention but are challenged by high…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ao Chang , Jiajun Zeng , Ruobing Huang , Dong Ni

In this paper, we propose a new architecture, called Deform-Mamba, for MR image super-resolution. Unlike conventional CNN or Transformer-based super-resolution approaches which encounter challenges related to the local respective field or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zexin Ji , Beiji Zou , Xiaoyan Kui , Pierre Vera , Su Ruan

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou

Hyperspectral image (HSI) classification is widely used for the analysis of remotely sensed images. Hyperspectral imagery includes varying bands of images. Convolutional Neural Network (CNN) is one of the most frequently used deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Swalpa Kumar Roy , Gopal Krishna , Shiv Ram Dubey , Bidyut B. Chaudhuri

High-resolution Large Multimodal Models (LMMs) encounter the challenges of excessive visual tokens and quadratic visual complexity. Current high-resolution LMMs address the quadratic complexity while still generating excessive visual…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Chunjiang Ge , Sijie Cheng , Ziming Wang , Jiale Yuan , Yuan Gao , Jun Song , Shiji Song , Gao Huang , Bo Zheng

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

Video super-resolution remains a major challenge in low-level vision tasks. To date, CNN- and Transformer-based methods have delivered impressive results. However, CNNs are limited by local receptive fields, while Transformers struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Dinh Phu Tran , Dao Duy Hung , Daeyoung Kim

Efficient evaluation of three-dimensional (3D) medical images is crucial for diagnostic and therapeutic practices in healthcare. Recent years have seen a substantial uptake in applying deep learning and computer vision to analyse and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Wei Dai , Jun Liu

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi

The Mamba architecture has been widely applied to various low-level vision tasks due to its exceptional adaptability and strong performance. Although the Mamba architecture has been adopted for spectral reconstruction, it still faces the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Yuze Zhang , Lingjie Li , Qiuzhen Lin , Zhong Ming , Fei Yu , Victor C. M. Leung