中文
相关论文

相关论文: SAM2 for Image and Video Segmentation: A Comprehen…

200 篇论文

Fully supervised deep learning (DL) models for surgical video segmentation have been shown to struggle with non-adversarial, real-world corruptions of image quality including smoke, bleeding, and low illumination. Foundation models for…

图像与视频处理 · 电气工程与系统科学 2024-08-19 Yiqing Shen , Hao Ding , Xinyuan Shao , Mathias Unberath

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

图像与视频处理 · 电气工程与系统科学 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Video segmentation is essential for advancing robotics and autonomous driving, particularly in open-world settings where continuous perception and object association across video frames are critical. While the Segment Anything Model (SAM)…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Pinxue Guo , Zixu Zhao , Jianxiong Gao , Chongruo Wu , Tong He , Zheng Zhang , Tianjun Xiao , Wenqiang Zhang

Robust and accurate segmentation of scenes has become one core functionality in various visual recognition and navigation tasks. This has inspired the recent development of Segment Anything Model (SAM), a foundation model for general mask…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Naoto Yokoya , Shijian Lu

The Segment Anything Model (SAM), introduced to the computer vision community by Meta in April 2023, is a groundbreaking tool that allows automated segmentation of objects in images based on prompts such as text, clicks, or bounding boxes.…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Athulya Sundaresan Geetha , Muhammad Hussain

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

Surgical video segmentation is crucial for computer-assisted surgery, enabling precise localization and tracking of instruments and tissues. Interactive Video Object Segmentation (iVOS) models such as Segment Anything Model 2 (SAM2) provide…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Haofeng Liu , Ziyue Wang , Sudhanshu Mishra , Mingqi Gao , Guanyi Qin , Chang Han Low , Alex Y. W. Kong , Yueming Jin

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging…

In this paper, we examine the recent Segment Anything Model (SAM) on medical images, and report both quantitative and qualitative zero-shot segmentation results on nine medical image segmentation benchmarks, covering various imaging…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Peilun Shi , Jianing Qiu , Sai Mu Dalike Abaxi , Hao Wei , Frank P. -W. Lo , Wu Yuan

The Segment Anything Model (SAM) has gained significant attention in the field of image segmentation due to its impressive capabilities and prompt-based interface. While SAM has already been extensively evaluated in various domains, its…

图像与视频处理 · 电气工程与系统科学 2023-09-01 Botond Fazekas , José Morano , Dmitrii Lachinov , Guilherme Aresta , Hrvoje Bogunović

Although new vision foundation models such as Segment Anything Model 2 (SAM2) have significantly enhanced zero-shot image segmentation capabilities, reliance on human-provided prompts poses significant challenges in adapting SAM2 to medical…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Yang Xing , Jiong Wu , Yuheng Bu , Kuang Gong

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

图像与视频处理 · 电气工程与系统科学 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have shown strong performance in various vision tasks, particularly image segmentation, due to their impressive zero-shot segmentation capabilities.…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Pengfei Gu , Haoteng Tang , Islam A. Ebeid , Jose A. Nunez , Fabian Vazquez , Diego Adame , Marcus Zhan , Huimin Li , Bin Fu , Danny Z. Chen

This paper presents MirrorSAM2, the first framework that adapts Segment Anything Model 2 (SAM2) to the task of RGB-D video mirror segmentation. MirrorSAM2 addresses key challenges in mirror detection, such as reflection ambiguity and…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Mingchen Xu , Yukun Lai , Ze Ji , Jing Wu

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

The Segment Anything Model 2 (SAM2) has demonstrated remarkable promptable visual segmentation capabilities in video data, showing potential for extension to medical image segmentation (MIS) tasks involving 3D volumes and temporally…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Meng Lan , Lefei Zhang , Xiaomeng Li

With the emergence of the Segment Anything Model (SAM) as a foundational model for image segmentation, its application has been extensively studied across various domains, including the medical field. However, its potential in the context…

计算机视觉与模式识别 · 计算机科学 2023-10-17 SeungKyu Kim , Hyun-Jic Oh , Seonghui Min , Won-Ki Jeong

The emergence of large foundation models has propelled significant advances in various domains. The Segment Anything Model (SAM), a leading model for image segmentation, exemplifies these advances, outperforming traditional methods.…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Saurabh Yadav , Avi Gupta , Koteswar Rao Jerripothula