English
Related papers

Related papers: subCellSAM: Zero-Shot (Sub-)Cellular Segmentation …

200 papers

This paper proposes a novel approach to few-shot semantic segmentation for machinery with multiple parts that exhibit spatial and hierarchical relationships. Our method integrates the foundation models CLIPSeg and Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Michael Schwingshackl , Fabio Francisco Oberweger , Markus Murschitz

In this paper, we explore the zero-shot capability of the Segment Anything Model (SAM) for food image segmentation. To address the lack of class-specific information in SAM-generated masks, we propose a novel framework, called FoodSAM. This…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xing Lan , Jiayi Lyu , Hanyu Jiang , Kun Dong , Zehai Niu , Yi Zhang , Jian Xue

The Segmentation Anything Model (SAM) requires labor-intensive data labeling. We present Unsupervised SAM (UnSAM) for promptable and automatic whole-image segmentation that does not require human annotations. UnSAM utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 XuDong Wang , Jingfeng Yang , Trevor Darrell

The newly released Segment Anything Model (SAM) is a popular tool used in image processing due to its superior segmentation accuracy, variety of input prompts, training capabilities, and efficient model design. However, its current model is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Aimee Guo , Grace Fei , Hemanth Pasupuleti , Jing Wang

The recent segmentation foundation model, Segment Anything Model (SAM), exhibits strong zero-shot segmentation capabilities, but it falls short in generating fine-grained precise masks. To address this limitation, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Beomyoung Kim , Chanyong Shin , Joonhyun Jeong , Hyungsik Jung , Se-Yun Lee , Sewhan Chun , Dong-Hyun Hwang , Joonsang Yu

Foundation models have emerged as powerful tools across various domains including language, vision, and multimodal tasks. While prior works have addressed unsupervised image segmentation, they significantly lag behind supervised models. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Paul Couairon , Mustafa Shukor , Jean-Emmanuel Haugeard , Matthieu Cord , Nicolas Thome

Classifying and analyzing human cells is a lengthy procedure, often involving a trained professional. In an attempt to expedite this process, an active area of research involves automating cell classification through use of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Reece Walsh , Mohamed H. Abdelpakey , Mohamed S. Shehata , Mostafa M. Mohamed

Surgical image segmentation is highly challenging, primarily due to scarcity of annotated data. Generalist prompted segmentation models like the Segment-Anything Model (SAM) can help tackle this task, but because they require image-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Aditya Murali , Farahdiba Zarin , Adrien Meyer , Pietro Mascagni , Didier Mutter , Nicolas Padoy

This paper presents an approach developed to address the PlantClef 2025 challenge, which consists of a fine-grained multi-label species identification, over high-resolution images. Our solution focused on employing class prototypes obtained…

Artificial Intelligence · Computer Science 2025-12-24 Luciano Araujo Dourado Filho , Almir Moreira da Silva Neto , Rodrigo Pereira David , Rodrigo Tripodi Calumby

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Current zero-shot Camouflaged Object Segmentation methods typically employ a two-stage pipeline (discover-then-segment): using MLLMs to obtain visual prompts, followed by SAM segmentation. However, relying solely on MLLMs for camouflaged…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yilong Yang , Jianxin Tian , Shengchuan Zhang , Liujuan Cao

Accurate organ segmentation is essential for clinical tasks such as radiotherapy planning and disease monitoring. Recent foundation models like MedSAM achieve strong results using point or bounding-box prompts but still require manual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Wenjie Zhang , Liming Luo , Mengnan He , Jiarui Hai , Jiancheng Ye

Instance segmentation enables the analysis of spatial and temporal properties of cells in microscopy images by identifying the pixels belonging to each cell. However, progress is constrained by the scarcity of high-quality labeled…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Kaden Stillwagon , Alexandra Dunnum VandeLoo , Benjamin Magondu , Craig R. Forest

In some of object recognition problems, labeled data may not be available for all categories. Zero-shot learning utilizes auxiliary information (also called signatures) describing each category in order to find a classifier that can…

Computer Vision and Pattern Recognition · Computer Science 2016-06-01 Seyed Mohsen Shojaee , Mahdieh Soleymani Baghshah

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

Vision foundation models have achieved remarkable progress across various image analysis tasks. In the image segmentation task, foundation models like the Segment Anything Model (SAM) enable generalizable zero-shot segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xingxin He , Yifan Hu , Zhaoye Zhou , Mohamed Jarraya , Fang Liu

When it comes to deploying deep vision models, the behavior of these systems must be explicable to ensure confidence in their reliability and fairness. A common approach to evaluate deep learning models is to build a labeled test set with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jinqi Luo , Zhaoning Wang , Chen Henry Wu , Dong Huang , Fernando De la Torre

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Many practical applications of AI in medicine consist of semi-supervised discovery: The investigator aims to identify features of interest at a resolution more fine-grained than that of the available human labels. This is often the scenario…

Computation and Language · Computer Science 2020-04-08 Allen Schmaltz , Andrew Beam