English
Related papers

Related papers: SegSEM: Enabling and Enhancing SAM2 for SEM Contou…

200 papers

This work introduces a new framework, ProtoSAM, for one-shot medical image segmentation. It combines the use of prototypical networks, known for few-shot segmentation, with SAM - a natural image foundation model. The method proposed creates…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Lev Ayzenberg , Raja Giryes , Hayit Greenspan

Vision Foundation Models (VFMs) such as the Segment Anything Model (SAM) allow zero-shot or interactive segmentation of visual contents, thus they are quickly applied in a variety of visual scenes. However, their direct use in many Remote…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Lei Ding , Kun Zhu , Daifeng Peng , Hao Tang , Kuiwu Yang , Lorenzo Bruzzone

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Segment Anything (SAM) has recently pushed the boundaries of segmentation by demonstrating zero-shot generalization and flexible prompting after training on over one billion masks. Despite this, its mask prediction accuracy often falls…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zezhong Fan , Xiaohan Li , Topojoy Biswas , Kaushiki Nag , Kannan Achan

Segment Anything Model (SAM) has gained significant recognition in the field of semantic segmentation due to its versatile capabilities and impressive performance. Despite its success, SAM faces two primary limitations: (1) it relies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuchen Li , Li Zhang , Youwei Liang , Pengtao Xie

As the successor to the Segment Anything Model (SAM), the Segment Anything Model 2 (SAM2) not only improves performance in image segmentation but also extends its capabilities to video segmentation. However, its effectiveness in segmenting…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Leiping Jie

Industrial X-ray computed tomography (XCT) is a powerful tool for non-destructive characterization of materials and manufactured components. XCT commonly accompanied by advanced image analysis and computer vision algorithms to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Anika Tabassum , Amirkoushyar Ziabari

Surgical video segmentation is critical for AI to interpret spatial-temporal dynamics in surgery, yet model performance is constrained by limited annotated data. The SAM2 model, pretrained on natural videos, offers potential for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Cheng Yuan , Jian Jiang , Kunyi Yang , Lv Wu , Rui Wang , Zi Meng , Haonan Ping , Ziyu Xu , Yifan Zhou , Wanli Song , Hesheng Wang , Yueming Jin , Qi Dou , Yutong Ban

Given a single labeled example, in-context segmentation aims to segment corresponding objects. This setting, known as one-shot segmentation in few-shot learning, explores the segmentation model's generalization ability and has been applied…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Mengshi Qi , Pengfei Zhu , Xiangtai Li , Xiaoyang Bi , Lu Qi , Huadong Ma , Ming-Hsuan Yang

Cell segmentation is a fundamental task in microscopy image analysis. Several foundation models for cell segmentation have been introduced, virtually all of them are extensions of Segment Anything Model (SAM), improving it for microscopy…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Anwai Archit , Constantin Pape

Foundation segmentation models such as SAM and SAM-2 perform well on natural images but struggle with brain MRIs where structures like the caudate and thalamus lack sharp boundaries and have low contrast. Rather than fine tune these models…

Image and Video Processing · Electrical Eng. & Systems 2025-11-26 Keith Moore

Advances in machine learning, especially the introduction of transformer architectures and vision transformers, have led to the development of highly capable computer vision foundation models. The segment anything model (known colloquially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kenneth Ball , Erin Taylor , Nirav Patel , Andrew Bartels , Gary Koplik , James Polly , Jay Hineman

It has been shown that traditional deep learning methods for electronic microscopy segmentation usually suffer from low transferability when samples and annotations are limited, while large-scale vision foundation models are more robust…

Image and Video Processing · Electrical Eng. & Systems 2024-03-14 Yiran Wang , Li Xiao

Surgical video segmentation is a critical task in computer-assisted surgery, essential for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has demonstrated remarkable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Ming Yin , Fu Wang , Xujiong Ye , Yanda Meng , Zeyu Fu

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Foundation models are experiencing a surge in popularity. The Segment Anything model (SAM) asserts an ability to segment a wide spectrum of objects but required supervised training at unprecedented scale. We compared SAM's performance…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Danielle Ferreira , Rima Arnaout

As a specific semantic segmentation task, aerial imagery segmentation has been widely employed in high spatial resolution (HSR) remote sensing images understanding. Besides common issues (e.g. large scale variation) faced by general…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Lin Huang , Qiyuan Dong , Lijun Wu , Jia Zhang , Jiang Bian , Tie-Yan Liu

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

The recent wave of foundation models has witnessed tremendous success in computer vision (CV) and beyond, with the segment anything model (SAM) having sparked a passion for exploring task-agnostic visual foundation models. Empowered by its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Chunhui Zhang , Yawen Cui , Weilin Lin , Guanjie Huang , Yan Rong , Li Liu , Shiguang Shan

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart