English
Related papers

Related papers: Deformable Mamba for Wide Field of View Segmentati…

200 papers

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shufan Li , Harkanwar Singh , Aditya Grover

Driven by the rapid development of deep learning technology, the YOLO series has set a new benchmark for real-time object detectors. Additionally, transformer-based structures have emerged as the most powerful solution in the field, greatly…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zeyu Wang , Chen Li , Huiying Xu , Xinzhong Zhu , Hongbo Li

This study explores replacing Transformers in Visual Language Models (VLMs) with Mamba, a recent structured state space model (SSM) that demonstrates promising performance in sequence modeling. We test models up to 3B parameters under…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Georgios Pantazopoulos , Malvina Nikandrou , Alessandro Suglia , Oliver Lemon , Arash Eshghi

Currently, Transformer is the most popular architecture for image dehazing, but due to its large computational complexity, its ability to handle long-range dependency is limited on resource-constrained devices. To tackle this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Zhuoran Zheng , Chen Wu

Images corrupted by rain streaks often lose vital frequency information for perception, and image deraining aims to solve this issue which relies on global and local degradation modeling. Recent studies have witnessed the effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zou Zhen , Yu Hu , Zhao Feng

Cell detection in pathological images presents unique challenges due to densely packed objects, subtle inter-class differences, and severe background clutter. In this paper, we propose CellMamba, a lightweight and accurate one-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Ruochen Liu , Yi Tian , Jiahao Wang , Hongbin Liu , Xianxu Hou , Jingxin Liu

Video understanding requires the extraction of rich spatio-temporal representations, which transformer models achieve through self-attention. Unfortunately, self-attention poses a computational burden. In NLP, Mamba has surfaced as an…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Hui Lu , Albert Ali Salah , Ronald Poppe

Convolutional neural network (CNN) and Transformer-based architectures are two dominant deep learning models for polyp segmentation. However, CNNs have limited capability for modeling long-range dependencies, while Transformers incur…

Image and Video Processing · Electrical Eng. & Systems 2025-05-12 Diego Adame , Jose A. Nunez , Fabian Vazquez , Nayeli Gurrola , Huimin Li , Haoteng Tang , Bin Fu , Pengfei Gu

Translating NIR to the visible spectrum is challenging due to cross-domain complexities. Current models struggle to balance a broad receptive field with computational efficiency, limiting practical use. Although the Selective Structured…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Huiyu Zhai , Guang Jin , Xingxing Yang , Guosheng Kang

Ground-based cloud image segmentation is a critical research domain for photovoltaic power forecasting. Current deep learning approaches primarily focus on encoder-decoder architectural refinements. However, existing methodologies exhibit…

Machine Learning · Computer Science 2026-02-17 Penghui Niu , Jiashuai She , Taotao Cai , Yajuan Zhang , Ping Zhang , Junhua Gu , Jianxin Li

Cracks pose safety risks to infrastructure and cannot be overlooked. The prevailing structures in existing crack segmentation networks predominantly consist of CNNs or Transformers. However, CNNs exhibit a deficiency in global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili He , Yu-Hsing Wang

Multimodal Large Language Models (MLLMs) have attracted much attention for their multifunctionality. However, traditional Transformer architectures incur significant overhead due to their secondary computational complexity. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Wenjun Huang , Jiakai Pan , Jiahao Tang , Yanyu Ding , Yifei Xing , Yuhe Wang , Zhengzhuo Wang , Jianguo Hu

Recently, Mamba-based methods have become popular in medical image segmentation due to their lightweight design and long-range dependency modeling capabilities. However, current segmentation methods frequently encounter challenges in fetal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Caixu Xu , Junming Wei , Huizhen Chen , Pengchen Liang , Bocheng Liang , Ying Tan , Xintong Wei

Age-related macular degeneration (AMD) is a leading cause of irreversible vision loss, making effective prognosis crucial for timely intervention. In this work, we propose AMD-Mamba, a novel multi-modal framework for AMD prognosis, and…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Puzhen Wu , Mingquan Lin , Qingyu Chen , Emily Y. Chew , Zhiyong Lu , Yifan Peng , Hexin Dong

Current image tampering localization methods primarily rely on Convolutional Neural Networks (CNNs) and Transformers. While CNNs suffer from limited local receptive fields, Transformers offer global context modeling at the expense of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Kun Guo , Gang Cao , Zijie Lou , Xianglin Huang , Jiaoyun Liu

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

Machine Learning · Computer Science 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

Volume Electron Microscopy (VEM) is crucial for 3D tissue imaging but often produces anisotropic data with poor axial resolution, hindering visualization and downstream analysis. Existing methods for isotropic reconstruction often suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Longmi Gao , Pan Gao

Accurate segmentation of coronary arteries from computed tomography angiography (CTA) images is of paramount clinical importance for the diagnosis and treatment planning of cardiovascular diseases. However, coronary artery segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xiaochan Yuan , Pai Zeng

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

Hyperspectral image (HSI) classification remains challenging due to high spectral dimensionality, redundancy, and limited labeled data. Although convolutional neural networks (CNNs) and Vision Transformers (ViTs) achieve strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Mohammed Q. Alkhatib