English
Related papers

Related papers: nnSAM: Plug-and-play Segment Anything Model Improv…

200 papers

Semantic segmentations of pathological entities have crucial clinical value in computational pathology workflows. Foundation models, such as the Segment Anything Model (SAM), have been recently proposed for universal use in segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-07-20 Jingwei Zhang , Ke Ma , Saarthak Kapse , Joel Saltz , Maria Vakalopoulou , Prateek Prasanna , Dimitris Samaras

Medical imaging is essential for the diagnosis and treatment of diseases, with medical image segmentation as a subtask receiving high attention. However, automatic medical image segmentation models are typically task-specific and struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ruochen Gao , Donghang Lyu , Marius Staring

With the emergence of the Segment Anything Model (SAM) as a foundational model for image segmentation, its application has been extensively studied across various domains, including the medical field. However, its potential in the context…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 SeungKyu Kim , Hyun-Jic Oh , Seonghui Min , Won-Ki Jeong

We explore the feasibility and potential of building a ground-truth-free evaluation model to assess the quality of segmentations generated by the Segment Anything Model (SAM) and its variants in medical imaging. This evaluation model…

Image and Video Processing · Electrical Eng. & Systems 2024-09-25 Ahjol Senbi , Tianyu Huang , Fei Lyu , Qing Li , Yuhui Tao , Wei Shao , Qiang Chen , Chengyan Wang , Shuo Wang , Tao Zhou , Yizhe Zhang

The recently introduced Segment Anything Model (SAM) combines a clever architecture and large quantities of training data to obtain remarkable image segmentation capabilities. However, it fails to reproduce such results for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Tal Shaharabany , Aviad Dahan , Raja Giryes , Lior Wolf

Segment anything model (SAM) has emerged as the leading approach for zero-shot learning in segmentation tasks, offering the advantage of avoiding pixel-wise annotations. It is particularly appealing in medical image segmentation, where the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-29 Ziyi Huang , Hongshan Liu , Haofeng Zhang , Xueshen Li , Haozhe Liu , Fuyong Xing , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Wei-Ting Chen , Yu-Jiet Vong , Sy-Yen Kuo , Sizhuo Ma , Jian Wang

Multimodal image fusion and semantic segmentation are critical for autonomous driving. Despite advancements, current models often struggle with segmenting densely packed elements due to a lack of comprehensive fusion features for guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Daixun Li , Weiying Xie , Mingxiang Cao , Yunke Wang , Yusi Zhang , Leyuan Fang , Yunsong Li , Chang Xu

Segmentation of cellular structures in electron microscopy (EM) images is fundamental to analyzing the morphology of neurons and glial cells in the healthy and diseased brain tissue. Current neuronal segmentation applications are based on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Zewen Zhuo , Ilya Belevich , Ville Leinonen , Eija Jokitalo , Tarja Malm , Alejandra Sierra , Jussi Tohka

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

Nucleus segmentation is an important analysis task in digital pathology. However, methods for automatic segmentation often struggle with new data from a different distribution, requiring users to manually annotate nuclei and retrain…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Titus Griebel , Anwai Archit , Constantin Pape

The unprecedented developments in segmentation foundational models have become a dominant force in the field of computer vision, introducing a multitude of previously unexplored capabilities in a wide range of natural images and videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Yichi Zhang , Zhenrong Shen

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

Large foundation models, known for their strong zero-shot generalization capabilities, can be applied to a wide range of downstream tasks. However, developing foundation models for medical image segmentation poses a significant challenge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Sihan Yang , Jiadong Feng , Xuande Mi , Haixia Bi , Hai Zhang , Jian Sun

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Yizhe Zhang , Shuo Wang , Tao Zhou , Qi Dou , Danny Z. Chen

Robust and accurate segmentation of scenes has become one core functionality in various visual recognition and navigation tasks. This has inspired the recent development of Segment Anything Model (SAM), a foundation model for general mask…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Naoto Yokoya , Shijian Lu

In the evolving landscape of computer vision, foundation models have emerged as pivotal tools, exhibiting exceptional adaptability to a myriad of tasks. Among these, the Segment Anything Model (SAM) by Meta AI has distinguished itself in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Bo Li , Haoke Xiao , Lv Tang

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu