English
Related papers

Related papers: nnInteractive: Redefining 3D Promptable Segmentati…

200 papers

Foundation models for volumetric medical image segmentation have emerged as powerful tools in clinical workflows, enabling radiologists to delineate regions of interest through intuitive clicks. While these models demonstrate promising…

Image and Video Processing · Electrical Eng. & Systems 2025-06-24 Yifan Gao , Jiaxi Sheng , Wenbin Wu , Haoyue Li , Yaoxian Dong , Chaoyang Ge , Feng Yuan , Xin Gao

Biomedical image segmentation is a crucial part of both scientific research and clinical care. With enough labelled data, deep learning models can be trained to accurately automate specific biomedical image segmentation tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Hallee E. Wong , Marianne Rakic , John Guttag , Adrian V. Dalca

We present ENSAM (Equivariant, Normalized, Segment Anything Model), a lightweight and promptable model for universal 3D medical image segmentation. ENSAM combines a SegResNet-based encoder with a prompt encoder and mask decoder in a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Elias Stenhede , Agnar Martin Bjørnstad , Arian Ranjbar

Interactive Medical-SAM2 GUI is an open-source desktop application for semi-automatic annotation of 2D and 3D medical images. Built on the Napari multi-dimensional viewer, box/point prompting is integrated with SAM2-style propagation by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Woojae Hong , Jong Ha Hwang , Jiyong Chung , Joongyeon Choi , Hyunngun Kim , Yong Hwy Kim

The proliferation of 2D foundation models has sparked research into adapting them for open-world 3D instance segmentation. Recent methods introduce a paradigm that leverages superpoints as geometric primitives and incorporates 2D multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xi Yang , Xu Gu , Xingyilang Yin , Xinbo Gao

The Segment Anything Model (SAM) has recently emerged as a groundbreaking foundation model for prompt-driven image segmentation tasks. However, both the original SAM and its medical variants require slice-by-slice manual prompting of target…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yichi Zhang , Shiyao Hu , Sijie Ren , Chen Jiang , Yuan Cheng , Yuan Qi

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

Placenta volume measured from 3D ultrasound (3DUS) images is an important tool for tracking the growth trajectory and is associated with pregnancy outcomes. Manual segmentation is the gold standard, but it is time-consuming and subjective.…

Image and Video Processing · Electrical Eng. & Systems 2024-08-13 Hao Li , Baris Oguz , Gabriel Arenas , Xing Yao , Jiacheng Wang , Alison Pouch , Brett Byram , Nadav Schwartz , Ipek Oguz

Recent advances in promptable segmentation, such as the Segment Anything Model (SAM), have enabled flexible, high-quality mask generation across a wide range of visual domains. However, SAM and similar models remain fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Tyler Ward , Abdullah Imran

While 3D foundational models have shown promise for promptable segmentation of medical volumes, their robustness to imprecise prompts remains under-explored. In this work, we aim to address this gap by systematically studying the effect of…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Soumitri Chattopadhyay , Basar Demir , Marc Niethammer

Leveraging pre-trained models with tailored prompts for in-context learning has proven highly effective in NLP tasks. Building on this success, recent studies have applied a similar approach to the Segment Anything Model (SAM) within a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Hangyul Yoon , Doohyuk Jang , Jungeun Kim , Eunho Yang

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

The recent integration of artificial intelligence into medical imaging has driven remarkable advances in automated organ segmentation. However, most existing 3D segmentation frameworks rely exclusively on visual learning from large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Hasan Faraz Khan , Noor Fatima , Muzammil Behzad

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

The Medical Segment Anything Model (MedSAM) has shown remarkable performance in medical image segmentation, drawing significant attention in the field. However, its sensitivity to varying prompt types and locations poses challenges. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Nan Zhou , Ke Zou , Kai Ren , Mengting Luo , Linchao He , Meng Wang , Yidi Chen , Yi Zhang , Hu Chen , Huazhu Fu

Interactive segmentation enables users to segment as needed by providing cues of objects, which introduces human-computer interaction for many fields, such as image editing and medical image analysis. Typically, massive and expansive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Kehan Li , Yian Zhao , Zhennan Wang , Zesen Cheng , Peng Jin , Xiangyang Ji , Li Yuan , Chang Liu , Jie Chen