English
Related papers

Related papers: MGD-SAM2: Multi-view Guided Detail-enhanced Segmen…

200 papers

The Foundation model for image segmentation, Segment Anything (SAM), has been actively researched in various fields since its proposal. Various researches have been proposed to adapt SAM to specific domains, with one notable approach…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Joohyeok Kim , Joonhyeon Song , Seohwan Yun , Seongho Yoon , Sangmin Lee

Segment Anything Model 2 (SAM 2) has demonstrated strong performance in object segmentation tasks and has become the state-of-the-art for visual object tracking. The model stores information from previous frames in a memory bank, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Alen Adamyan , Tomáš Čížek , Matej Straka , Klara Janouskova , Martin Schmid

We introduce SAM4MLLM, an innovative approach which integrates the Segment Anything Model (SAM) with Multi-Modal Large Language Models (MLLMs) for pixel-aware tasks. Our method enables MLLMs to learn pixel-level location information without…

Artificial Intelligence · Computer Science 2024-12-17 Yi-Chia Chen , Wei-Hua Li , Cheng Sun , Yu-Chiang Frank Wang , Chu-Song Chen

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

Medical image segmentation is a critical task in computer-aided diagnosis and treatment planning. However, deep learning models often struggle to generalize across datasets due to domain shifts arising from variations in imaging protocols,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Phuoc-Nguyen Bui , Van-Nguyen Pham , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

In this work, we propose SAM3D, a novel framework that is able to predict masks in 3D point clouds by leveraging the Segment-Anything Model (SAM) in RGB images without further training or finetuning. For a point cloud of a 3D scene with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Yunhan Yang , Xiaoyang Wu , Tong He , Hengshuang Zhao , Xihui Liu

Foundation models like the Segment Anything Model (SAM) have significantly advanced promptable image segmentation in computer vision. However, extending these capabilities to videos presents substantial challenges, particularly in ensuring…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Haiyang Mei , Pengyu Zhang , Mike Zheng Shou

We present SAM4EM, a novel approach for 3D segmentation of complex neural structures in electron microscopy (EM) data by leveraging the Segment Anything Model (SAM) alongside advanced fine-tuning strategies. Our contributions include the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Uzair Shah , Marco Agus , Daniya Boges , Vanessa Chiappini , Mahmood Alzubaidi , Jens Schneider , Markus Hadwiger , Pierre J. Magistretti , Mowafa Househ , Corrado Calı

This study investigates the application and performance of the Segment Anything Model 2 (SAM2) in the challenging task of video camouflaged object segmentation (VCOS). VCOS involves detecting objects that blend seamlessly in the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Yuli Zhou , Guolei Sun , Yawei Li , Guo-Sen Xie , Luca Benini , Ender Konukoglu

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiang Gao , Kai Lu

The Segment Anything Model (SAM) is widely used for segmenting a diverse range of objects in natural images from simple user prompts like points or bounding boxes. However, SAM's performance decreases substantially when applied to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tristan Piater , Björn Barz , Alexander Freytag

Detecting glass regions is a challenging task due to the ambiguity of their transparency and reflection properties. These transparent glasses share the visual appearance of both transmitted arbitrary background scenes and reflected objects,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Jing Hao , Moyun Liu , Kuo Feng Hung

Recent advances in autonomous driving (AD) have highlighted the potential of hyperspectral imaging (HSI) for enhanced environmental perception, particularly in challenging weather and lighting conditions. However, efficiently processing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Imad Ali Shah , Jiarong Li , Tim Brophy , Martin Glavin , Edward Jones , Enda Ward , Brian Deegan

Purpose: Accurate tumor segmentation is vital for adaptive radiation therapy (ART) but remains time-consuming and user-dependent. Segment Anything Model 2 (SAM2) shows promise for prompt-based segmentation but struggles with tumor accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Guoping Xu , Yan Dai , Hengrui Zhao , Ying Zhang , Jie Deng , Weiguo Lu , You Zhang

Prompt-free image segmentation aims to generate accurate masks without manual guidance. Typical pre-trained models, notably Segmentation Anything Model (SAM), generate prompts directly at a single granularity level. However, this approach…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Qiyang Yu , Yu Fang , Tianrui Li , Xuemei Cao , Yan Chen , Jianghao Li , Fan Min , Yi Zhang

The Segment Anything Model 2 (SAM2) is a powerful foundation model for promptable segmentation. However, its high computational and memory costs are a major barrier to deployment on resource-constrained devices. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Nicola Farronato , Florian Scheidegger , Mattia Rigotti , Cristiano Malossi , Michele Magno , Haotong Qin

Universal medical image segmentation models have emerged as a promising paradigm due to their strong generalizability across diverse tasks, showing great potential for a wide range of clinical applications. This potential has been partly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yanwu Yang , Guinan Su , Jiesi Hu , Francesco Sammarco , Jonas Geiping , Thomas Wolfers

Parotid gland lesion segmentation is essential for the treatment of parotid gland diseases. However, due to the variable size and complex lesion boundaries, accurate parotid gland lesion segmentation remains challenging. Recently, the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zhongyuan Wu , Chuan-Xian Ren , Yu Wang , Xiaohua Ban , Jianning Xiao , Xiaohui Duan

Autonomous-driving perception systems require robust Multi-Object Tracking (MOT) to operate reliably in dynamic environments. MOT maintains consistent object identities across frames while preserving spatial accuracy. Recent foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Diogo Mendonça , Tiago Barros , Cristiano Premebida , Urbano J. Nunes

While the Segment Anything Model (SAM) has achieved remarkable success in image segmentation, its direct application to medical imaging remains hindered by fundamental challenges, including ambiguous boundaries, insufficient modeling of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yu Li , Da Chang , Xi Xiao