English
Related papers

Related papers: One Click per Cell Type Suffices: Training-free Gr…

200 papers

Universal medical image segmentation seeks to use a single foundational model to handle diverse tasks across multiple imaging modalities. However, existing approaches often rely heavily on manual visual prompts or retrieved reference…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Haoyun Chen , Fenghe Tang , Wenxin Ma , Shaohua Kevin Zhou

Computed tomography (CT) is extensively used for accurate visualization and segmentation of organs and lesions. While deep learning models such as convolutional neural networks (CNNs) and vision transformers (ViTs) have significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuheng Li , Yuxiang Lai , Maria Thor , Deborah Marshall , Zachary Buchwald , David S. Yu , Xiaofeng Yang

We present a novel form of interactive video object segmentation where a few clicks by the user helps the system produce a full spatio-temporal segmentation of the object of interest. Whereas conventional interactive pipelines take the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-06 Suyog Dutt Jain , Kristen Grauman

The problem of learning the structure of a high dimensional graphical model from data has received considerable attention in recent years. In many applications such as sensor networks and proteomics it is often expensive to obtain samples…

Machine Learning · Statistics 2016-04-08 Gautam Dasarathy , Aarti Singh , Maria-Florina Balcan , Jong Hyuk Park

This paper provides insights on the effectiveness of the zero shot, prompt-based Segment Anything Model (SAM) and its updated versions, SAM 2 and SAM 2.1, along with the non-promptable conventional neural network (CNN), for segmenting solar…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Osher Rafaeli , Tal Svoray , Roni Blushtein-Livnon , Ariel Nahlieli

One-shot semantic image segmentation aims to segment the object regions for the novel class with only one annotated image. Recent works adopt the episodic training strategy to mimic the expected situation at testing time. However, these…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Tao Chen , Guosen Xie , Yazhou Yao , Qiong Wang , Fumin Shen , Zhenmin Tang , Jian Zhang

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

Purpose: Recent developments in computational pathology have been driven by advances in Vision Foundation Models, particularly the Segment Anything Model (SAM). This model facilitates nuclei segmentation through two primary methods:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Xueyuan Li , Can Cui , Ruining Deng , Yucheng Tang , Quan Liu , Tianyuan Yao , Shunxing Bao , Naweed Chowdhury , Haichun Yang , Yuankai Huo

In this work, we present SEEM, a promptable and interactive model for segmenting everything everywhere all at once in an image, as shown in Fig.1. In SEEM, we propose a novel decoding mechanism that enables diverse prompting for all types…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Xueyan Zou , Jianwei Yang , Hao Zhang , Feng Li , Linjie Li , Jianfeng Wang , Lijuan Wang , Jianfeng Gao , Yong Jae Lee

The accurate segmentation and tracking of cells in microscopy image sequences is an important task in biomedical research, e.g., for studying the development of tissues, organs or entire organisms. However, the segmentation of touching…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Tim Scherr , Katharina Löffler , Moritz Böhland , Ralf Mikut

3D instance segmentation methods often require fully-annotated dense labels for training, which are costly to obtain. In this paper, we present ClickSeg, a novel click-level weakly supervised 3D instance segmentation method that requires…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Leyao Liu , Tao Kong , Minzhao Zhu , Jiashuo Fan , Lu Fang

Interactive segmentation is a crucial research area in medical image analysis aiming to boost the efficiency of costly annotations by incorporating human feedback. This feedback takes the form of clicks, scribbles, or masks and allows for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Zdravko Marinov , Paul F. Jäger , Jan Egger , Jens Kleesiek , Rainer Stiefelhagen

Recently, CLIP has found practical utility in the domain of pixel-level zero-shot segmentation tasks. The present landscape features two-stage methodologies beset by issues such as intricate pipelines and elevated computational costs. While…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Wenhao Xu , Rongtao Xu , Changwei Wang , Shibiao Xu , Li Guo , Man Zhang , Xiaopeng Zhang

Most medical image lesion segmentation methods rely on hand-crafted accurate annotations of the original image for supervised learning. Recently, a series of weakly supervised or unsupervised methods have been proposed to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Jiawei Chen , Dingkang Yang , Yuxuan Lei , Lihua Zhang

Driven by large-data pre-training, Segment Anything Model (SAM) has been demonstrated as a powerful and promptable framework, revolutionizing the segmentation models. Despite the generality, customizing SAM for specific visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Renrui Zhang , Zhengkai Jiang , Ziyu Guo , Shilin Yan , Junting Pan , Xianzheng Ma , Hao Dong , Peng Gao , Hongsheng Li

While pre-training on object detection tasks, such as Common Objects in Contexts (COCO) [1], could significantly boost the performance of cell segmentation, it still consumes on massive fine-annotated cell images [2] with bounding boxes,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Weibin Liao , Xuhong Li , Qingzhong Wang , Yanwu Xu , Zhaozheng Yin , Haoyi Xiong

In interactive instance segmentation, users give feedback to iteratively refine segmentation masks. The user-provided clicks are transformed into guidance maps which provide the network with necessary cues on the whereabouts of the object…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Soumajit Majumder , Angela Yao

Promptable Foundation Models (FMs), initially introduced for natural image segmentation, have also revolutionized medical image segmentation. The increasing number of models, along with evaluations varying in datasets, metrics, and compared…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Caroline Magg , Maaike A. ter Wee , Johannes G. G. Dobbe , Geert J. Streekstra , Leendert Blankevoort , Clara I. Sánchez , Hoel Kervadec

Is Segment Anything Model 3 (SAM3) capable in segmenting Any Pathology Images? Digital pathology segmentation spans tissue-level and nuclei-level scales, where traditional methods often suffer from high annotation costs and poor…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qiuyu Kong , Shakiba Sharifi , Yiming Wang , Marco Cristani , Zanxi Ruan

Open-vocabulary semantic segmentation aims to assign semantic labels to each pixel without being constrained by a predefined set of categories. While Contrastive Language-Image Pre-training (CLIP) excels in zero-shot classification, it…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Dengke Zhang , Fagui Liu , Quan Tang