English
Related papers

Related papers: SAM2-3dMed: Empowering SAM2 for 3D Medical Image S…

200 papers

Precise image segmentation provides clinical study with instructive information. Despite the remarkable progress achieved in medical image segmentation, there is still an absence of a 3D foundation segmentation model that can segment a wide…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yuxin Du , Fan Bai , Tiejun Huang , Bo Zhao

The recently released Segment Anything Model (SAM) has shown powerful zero-shot segmentation capabilities through a semi-automatic annotation setup in which the user can provide a prompt in the form of clicks or bounding boxes. There is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Benjamin Towle , Xin Chen , Ke Zhou

Foundation models have shown strong performance in multi-object segmentation with visual prompts, yet histopathology images remain challenging due to high cellular density, heterogeneity, and the gap between pixel-level supervision and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yonghuang Wu , Wenwen Zeng , Xuan Xie , Chengqian Zhao , Guoqing Wu , Jinhua Yu

Medical image segmentation is crucial for clinical decision-making, but the scarcity of annotated data presents significant challenges. Few-shot segmentation (FSS) methods show promise but often require training on the target domain and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lin Zhao , Xiao Chen , Eric Z. Chen , Yikang Liu , Terrence Chen , Shanhui Sun

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

Promptable segmentation has emerged as a powerful paradigm in computer vision, enabling users to guide models in parsing complex scenes with prompts such as clicks, boxes, or textual cues. Recent advances, exemplified by the Segment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yoonwoo Jeong , Cheng Sun , Yu-Chiang Frank Wang , Minsu Cho , Jaesung Choe

Promptable video object segmentation and tracking (VOST) has seen significant advances with the emergence of foundation models like Segment Anything Model 2 (SAM2); however, their application in surgical video analysis remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guoping Xu , Hua-Chieh Shao , You Zhang

Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Yizhe Zhang , Shuo Wang , Tao Zhou , Qi Dou , Danny Z. Chen

Image registration is a fundamental task in medical image analysis. Deformations are often closely related to the morphological characteristics of tissues, making accurate feature extraction crucial. Recent weakly supervised methods improve…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yue He , Min Liu , Qinghao Liu , Jiazheng Wang , Yaonan Wang , Hang Zhang , Xiang Chen

Previous work has reported that vision foundation models show promising zero-shot performance in eye image segmentation. Here we examine whether the latest iteration of the Segment Anything Model, SAM3, offers better eye image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Diederick C. Niehorster , Marcus Nyström

Fueled by recent advances in machine learning, there has been tremendous progress in the field of semantic segmentation for the medical image computing community. However, developed algorithms are often optimized and validated by hand based…

Image and Video Processing · Electrical Eng. & Systems 2020-05-21 Oliver Rippel , Leon Weninger , Dorit Merhof

The Segment Anything Model (SAM) made an eye-catching debut recently and inspired many researchers to explore its potential and limitation in terms of zero-shot generalization capability. As the first promptable foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongjie Cheng , Ziyuan Qin , Zekun Jiang , Shaoting Zhang , Qicheng Lao , Kang Li

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

The Segment Anything Model (SAM) and CLIP are remarkable vision foundation models (VFMs). SAM, a prompt driven segmentation model, excels in segmentation tasks across diverse domains, while CLIP is renowned for its zero shot recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Sidra Aleem , Fangyijie Wang , Mayug Maniparambil , Eric Arazo , Julia Dietlmeier , Guenole Silvestre , Kathleen Curran , Noel E. O'Connor , Suzanne Little

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

Purpose: Accurate tumor segmentation is vital for adaptive radiation therapy (ART) but remains time-consuming and user-dependent. Segment Anything Model 2 (SAM2) shows promise for prompt-based segmentation but struggles with tumor accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Guoping Xu , Yan Dai , Hengrui Zhao , Ying Zhang , Jie Deng , Weiguo Lu , You Zhang

Volumetric medical image segmentation is a fundamental problem in medical image analysis where the objective is to accurately classify a given 3D volumetric medical image with voxel-level precision. In this work, we propose a novel…

Image and Video Processing · Electrical Eng. & Systems 2024-10-22 Daniya Najiha Abdul Kareem , Mustansar Fiaz , Noa Novershtern , Jacob Hanna , Hisham Cholakkal

Video segmentation is essential for advancing robotics and autonomous driving, particularly in open-world settings where continuous perception and object association across video frames are critical. While the Segment Anything Model (SAM)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Pinxue Guo , Zixu Zhao , Jianxiong Gao , Chongruo Wu , Tong He , Zheng Zhang , Tianjun Xiao , Wenqiang Zhang