English
Related papers

Related papers: Towards Fine-grained Interactive Segmentation in I…

200 papers

This paper presents MirrorSAM2, the first framework that adapts Segment Anything Model 2 (SAM2) to the task of RGB-D video mirror segmentation. MirrorSAM2 addresses key challenges in mirror detection, such as reflection ambiguity and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mingchen Xu , Yukun Lai , Ze Ji , Jing Wu

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

Due to the inherent flexibility of prompting, foundation models have emerged as the predominant force in the fields of natural language processing and computer vision. The recent introduction of the Segment Anything Model (SAM) signifies a…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Yichi Zhang , Zhenrong Shen , Rushi Jiao

Fully supervised deep learning (DL) models for surgical video segmentation have been shown to struggle with non-adversarial, real-world corruptions of image quality including smoke, bleeding, and low illumination. Foundation models for…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Yiqing Shen , Hao Ding , Xinyuan Shao , Mathias Unberath

Road masks obtained from remote sensing images effectively support a wide range of downstream tasks. In recent years, most studies have focused on improving the performance of fully automatic segmentation models for this task, achieving…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Chengcheng Lv , Rushi Li , Mincheng Wu , Xiufang Shi , Zhenyu Wen , Shibo He

Recently, Segment Anything Model (SAM) has become a research hotspot in the fields of multimedia and computer vision, which exhibits powerful yet versatile capabilities on various (un) conditional image segmentation tasks. Although SAM can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Xiaorui Huang , Gen Luo , Chaoyang Zhu , Bo Tong , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

Interactive segmentation models such as the Segment Anything Model (SAM) have demonstrated remarkable generalization on natural images, but they perform suboptimally on remote sensing imagery (RSI) due to severe domain shifts and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 M. Naseer Subhani

Surgical video segmentation is a critical task in computer-assisted surgery, essential for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has demonstrated remarkable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Ming Yin , Fu Wang , Xujiong Ye , Yanda Meng , Zeyu Fu

Accurate segmentation of neural structures in Electron Microscopy (EM) images is paramount for neuroscience. However, this task is challenged by intricate morphologies, low signal-to-noise ratios, and scarce annotations, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhenghua Li , Hang Chen , Zihao Sun , Kai Li , Xiaolin Hu

The interactive segmentation task consists in the creation of object segmentation masks based on user interactions. The most common way to guide a model towards producing a correct segmentation consists in clicks on the object and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Robin Schön , Julian Lorenz , Katja Ludwig , Rainer Lienhart

Referring video object segmentation (RVOS) aims to segment objects in a video according to textual descriptions, which requires the integration of multimodal information and temporal dynamics perception. The Segment Anything Model 2 (SAM 2)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

Surgical video segmentation is a critical task in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has shown superior advancements in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Haofeng Liu , Erli Zhang , Junde Wu , Mingxuan Hong , Yueming Jin

Visual Foundation Models (VFMs) such as the Segment Anything Model (SAM) have significantly advanced broad use of image segmentation. However, SAM and its variants necessitate substantial manual effort for prompt generation and additional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Minjae Lee , Sungwoo Hur , Soojin Hwang , Won Hwa Kim

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leveraging its rich priors…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jingze Su , Tianle Zhu , Jiaxin Cai , Zhiyi Wang , Qi Li , Xiao Zhang , Tong Tong , Shu Wang , Wenxi Liu

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

The recent Segment Anything Model 2 (SAM2) has demonstrated exceptional capabilities in interactive object segmentation for both images and videos. However, as a foundational model on interactive segmentation, SAM2 performs segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Qiushi Yang , Yuan Yao , Miaomiao Cui , Liefeng Bo

Video camouflaged object segmentation (VCOS), aiming at segmenting camouflaged objects that seamlessly blend into their environment, is a fundamental vision task with various real-world applications. With the release of SAM2, video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuli Zhou , Yawei Li , Yuqian Fu , Luca Benini , Ender Konukoglu , Guolei Sun