English
Related papers

Related papers: nnInteractive: Redefining 3D Promptable Segmentati…

200 papers

Interactive medical image segmentation (IMIS) has shown significant potential in enhancing segmentation accuracy by integrating iterative feedback from medical professionals. However, the limited availability of enough 3D medical data…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chuyun Shen , Wenhao Li , Yuhang Shi , Xiangfeng Wang

Semantic segmentation of medical images is an essential first step in computer-aided diagnosis systems for many applications. However, given many disparate imaging modalities and inherent variations in the patient data, it is difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Bhavani Sambaturu , Ashutosh Gupta , C. V. Jawahar , Chetan Arora

SlicerNNInteractive integrates nnInteractive, a state-of-the-art promptable deep learning-based framework for 3D image segmentation, into the widely used 3D Slicer platform. Our extension implements a client-server architecture that…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Coen de Vente , Kiran Vaidhya Venkadesh , Bram van Ginneken , Clara I. Sánchez

Segmenting 3D assets into their constituent parts is crucial for enhancing 3D understanding, facilitating model reuse, and supporting various applications such as part generation. However, current methods face limitations such as poor…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Changfeng Ma , Yang Li , Xinhao Yan , Jiachen Xu , Yunhan Yang , Chunshi Wang , Zibo Zhao , Yanwen Guo , Zhuo Chen , Chunchao Guo

Interactive 3D point cloud segmentation enables efficient annotation of complex 3D scenes through user-guided prompts. However, current approaches are typically restricted in scope to a single domain (indoor or outdoor), and to a single…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Aniket Gupta , Hanhui Wang , Charles Saunders , Aruni RoyChowdhury , Hanumant Singh , Huaizu Jiang

Interactive medical image segmentation refers to the accurate segmentation of the target of interest through interaction (e.g., click) between the user and the image. It has been widely studied in recent years as it is less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ao Chang , Xing Tao , Xin Yang , Yuhao Huang , Xinrui Zhou , Jiajun Zeng , Ruobing Huang , Dong Ni

We present Markov Map Nearest Neighbor V2 (M2N2V2), a novel and simple, yet effective approach which leverages depth guidance and attention maps for unsupervised and training-free point-prompt-based interactive segmentation. Following…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Markus Karmann , Peng-Tao Jiang , Bo Li , Onay Urfalioglu

Promptable Foundation Models (FMs), initially introduced for natural image segmentation, have also revolutionized medical image segmentation. The increasing number of models, along with evaluations varying in datasets, metrics, and compared…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Caroline Magg , Maaike A. ter Wee , Johannes G. G. Dobbe , Geert J. Streekstra , Leendert Blankevoort , Clara I. Sánchez , Hoel Kervadec

The increasing availability of digital 3D environments, whether through image-based 3D reconstruction, generation, or scans obtained by robots, is driving innovation across various applications. These come with a significant demand for 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Andrea Simonelli , Norman Müller , Peter Kontschieder

Many deep learning based automated medical image segmentation systems, in reality, face difficulties in deployment due to the cost of massive data annotation and high latency in model iteration. We propose a dynamic interactive learning…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Mu Tian , Xiaohui Chen , Yi Gao

Foundation models, such as the Segment Anything Model (SAM), have heightened interest in promptable zero-shot segmentation. Although these models perform strongly on natural images, their behavior on medical data remains insufficiently…

Image and Video Processing · Electrical Eng. & Systems 2026-04-07 Satrajit Chakrabarty , Ravi Soni

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Interactive segmentation entails a human marking an image to guide how a model either creates or edits a segmentation. Our work addresses limitations of existing methods: they either only support one gesture type for marking an image (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Josh Myers-Dean , Yifei Fan , Brian Price , Wilson Chan , Danna Gurari

The development of machine learning models for CT imaging depends on the availability of large, high-quality, and diverse annotated datasets. Although large volumes of CT images and reports are readily available in clinical picture…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Samuel Church , Joshua D. Warner , Danyal Maqbool , Xin Tie , Junjie Hu , Meghan G. Lubner , Tyler J. Bradshaw

Accurate segmentation of medical images is fundamental to tumor diagnosis and treatment planning. SAM-based interactive segmentation has gained attention for its strong generalization, but most methods follow a single-point-to-single-object…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jierui Qu , Jianchun Zhao

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su

Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), have shown promise as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yimu Pan , Sitao Zhang , Alison D. Gernand , Jeffery A. Goldstein , James Z. Wang

Nucleus instance segmentation in histology images is crucial for a broad spectrum of clinical applications. Current dominant algorithms rely on regression of nuclear proxy maps. Distinguishing nucleus instances from the estimated maps…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhongyi Shui , Yunlong Zhang , Kai Yao , Chenglu Zhu , Sunyi Zheng , Jingxiong Li , Honglin Li , Yuxuan Sun , Ruizhe Guo , Lin Yang

Interactive segmentation model leverages prompts from users to produce robust segmentation. This advancement is facilitated by prompt engineering, where interactive prompts serve as strong priors during test-time. However, this is an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz