English
Related papers

Related papers: Efficient Segment Anything with Depth-Aware Fusion…

200 papers

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

The recent Segment Anything Model (SAM) demonstrates strong instance segmentation performance across various downstream tasks. However, SAM is trained solely on RGB data, limiting its direct applicability to RGB-thermal (RGB-T) semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dong Xing , Xianxun Zhu , Wei Zhou , Qika Lin , Hang Yang , Yuqing Wang

Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf{segment everything…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chaoning Zhang , Dongshen Han , Sheng Zheng , Jinwoo Choi , Tae-Ho Kim , Choong Seon Hong

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

The Segment Anything Model (SAM) has achieved remarkable successes in the realm of natural image segmentation, but its deployment in the medical imaging sphere has encountered challenges. Specifically, the model struggles with medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shreyank N Gowda , David A. Clifton

Segment Anything Model (SAM) has shown impressive zero-shot transfer performance for various computer vision tasks recently. However, its heavy computation costs remain daunting for practical applications. MobileSAM proposes to replace the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Ao Wang , Hui Chen , Zijia Lin , Jungong Han , Guiguang Ding

Surgical scene understanding is a key technical component for enabling intelligent and context aware systems that can transform various aspects of surgical interventions. In this work, we focus on the semantic segmentation task, propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Muhammad Abdullah Jamal , Omid Mohareri

Recently, Segment Anything Model (SAM) shows exceptional performance in generating high-quality object masks and achieving zero-shot image segmentation. However, as a versatile vision model, SAM is primarily trained with large-scale natural…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Tianyu Yan , Zifu Wan , Xinhao Deng , Pingping Zhang , Yang Liu , Huchuan Lu

Recently, Segment Anything Model (SAM) has become a research hotspot in the fields of multimedia and computer vision, which exhibits powerful yet versatile capabilities on various (un) conditional image segmentation tasks. Although SAM can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Xiaorui Huang , Gen Luo , Chaoyang Zhu , Bo Tong , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

Plane instance segmentation from RGB-D data is a crucial research topic for many downstream tasks. However, most existing deep-learning-based methods utilize only information within the RGB bands, neglecting the important role of the depth…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Zhongchen Deng , Zhechen Yang , Chi Chen , Cheng Zeng , Yan Meng , Bisheng Yang

The objective of this paper is motion segmentation -- discovering and segmenting the moving objects in a video. This is a much studied area with numerous careful, and sometimes complex, approaches and training schemes including:…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Junyu Xie , Charig Yang , Weidi Xie , Andrew Zisserman

Recently, the Segment Anything Model (SAM) has demonstrated promising segmentation capabilities in a variety of downstream segmentation tasks. However in the context of universal medical image segmentation there exists a notable performance…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Chao Qin , Jiale Cao , Huazhu Fu , Fahad Shahbaz Khan , Rao Muhammad Anwer

Medical image segmentation models built on Segment Anything Model (SAM) achieve strong performance on clean benchmarks, yet their reliability often degrades under realistic image corruptions such as noise, blur, motion artifacts, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jieru Li , Matthew Chen , Micky C. Nnamdi , J. Ben Tamo , Benoit L. Marteau , May D. Wang

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

Efficient RGB-D semantic segmentation has received considerable attention in mobile robots, which plays a vital role in analyzing and recognizing environmental information. According to previous studies, depth information can provide…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yang Zhang , Chenyun Xiong , Junjie Liu , Xuhui Ye , Guodong Sun

This paper introduces Lite-SAM, an efficient end-to-end solution for the SegEvery task designed to reduce computational costs and redundancy. Lite-SAM is composed of four main components: a streamlined CNN-Transformer hybrid encoder…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jianhai Fu , Yuanjie Yu , Ningchuan Li , Yi Zhang , Qichao Chen , Jianping Xiong , Jun Yin , Zhiyu Xiang

Current RGB-D methods usually leverage large-scale backbones to improve accuracy but sacrifice efficiency. Meanwhile, several existing lightweight methods are difficult to achieve high-precision performance. To balance the efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Songsong Duan , Xi Yang , Nannan Wang , Xinbo Gao

Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted. Interactivity is a key strength of SAMs, allowing users…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Yiqing Shen , Jingxing Li , Xinyuan Shao , Blanca Inigo Romillo , Ankush Jindal , David Dreizin , Mathias Unberath

Segment Anything Model (SAM) has attracted significant attention due to its impressive zero-shot transfer performance and high versatility for numerous vision applications (like image editing with fine-grained control). Many of such…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Chaoning Zhang , Dongshen Han , Yu Qiao , Jung Uk Kim , Sung-Ho Bae , Seungkyu Lee , Choong Seon Hong

Salient Object Detection (SOD) aims to identify and segment the most prominent objects in images. Advanced SOD methods often utilize various Convolutional Neural Networks (CNN) or Transformers for deep feature extraction. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Shixuan Gao , Pingping Zhang , Tianyu Yan , Huchuan Lu