English
Related papers

Related papers: Revisiting foundation models for cell instance seg…

200 papers

Nucleus instance segmentation in histology images is crucial for a broad spectrum of clinical applications. Current dominant algorithms rely on regression of nuclear proxy maps. Distinguishing nucleus instances from the estimated maps…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhongyi Shui , Yunlong Zhang , Kai Yao , Chenglu Zhu , Sunyi Zheng , Jingxiong Li , Honglin Li , Yuxuan Sun , Ruizhe Guo , Lin Yang

Advances in machine learning, especially the introduction of transformer architectures and vision transformers, have led to the development of highly capable computer vision foundation models. The segment anything model (known colloquially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kenneth Ball , Erin Taylor , Nirav Patel , Andrew Bartels , Gary Koplik , James Polly , Jay Hineman

Accurate segmentation of cell nuclei in histopathology images is essential for numerous biomedical research and clinical applications. However, existing cell nucleus segmentation methods only consider a single dataset (i.e., primary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Jiahe Qian , Yaoyu Fang , Jinkui Hao , Bo Zhou

The segmentation foundation model, e.g., Segment Anything Model (SAM), has attracted increasing interest in the medical image community. Early pioneering studies primarily concentrated on assessing and improving SAM's performance from the…

Image and Video Processing · Electrical Eng. & Systems 2024-06-19 Qin Li , Yizhe Zhang , Yan Li , Jun Lyu , Meng Liu , Longyu Sun , Mengting Sun , Qirong Li , Wenyue Mao , Xinran Wu , Yajing Zhang , Yinghua Chu , Shuo Wang , Chengyan Wang

The Segment Anything Model (SAM) is a powerful foundation model for image segmentation, showing robust zero-shot generalization through prompt engineering. However, relying on manual prompts is impractical for real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yi Chen , Mu-Young Son , Chuanbo Hua , Joo-Young Kim

Promptable foundation models, particularly Segment Anything Model (SAM), have emerged as a promising alternative to the traditional task-specific supervised learning for image segmentation. However, many evaluation studies have found that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Rachana Sathish , Rahul Venkataramani , K S Shriram , Prasad Sudhakar

The recent Segment Anything Models (SAMs) have emerged as foundational visual models for general interactive segmentation. Despite demonstrating robust generalization abilities, they still suffer performance degradations in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yuan Yao , Qiushi Yang , Miaomiao Cui , Liefeng Bo

The Segment Anything Model (SAM) exhibits impressive capabilities in zero-shot segmentation for natural images. Recently, SAM has gained a great deal of attention for its applications in medical image segmentation. However, to our best…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Pengfei Gu , Zihan Zhao , Hongxiao Wang , Yaopeng Peng , Yizhe Zhang , Nishchal Sapkota , Chaoli Wang , Danny Z. Chen

High-throughput screening using automated microscopes is a key driver in biopharma drug discovery, enabling the parallel evaluation of thousands of drug candidates for diseases such as cancer. Traditional image analysis and deep learning…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Jacob Hanimann , Daniel Siegismund , Mario Wieser , Stephan Steigele

Adapting large pre-trained foundation models, e.g., SAM, for medical image segmentation remains a significant challenge. A crucial step involves the formulation of a series of specialized prompts that incorporate specific clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiuqi Zheng , Yuhang Zhang , Haoran Zhang , Hongrui Liang , Xueqi Bao , Zhuqing Jiang , Qicheng Lao

Increasing data set sizes of 3D microscopy imaging experiments demand for an automation of segmentation processes to be able to extract meaningful biomedical information. Due to the shortage of annotated 3D image data that can be used for…

Image and Video Processing · Electrical Eng. & Systems 2022-02-02 Dennis Eschweiler , Richard S. Smith , Johannes Stegmaier

Nuclear instance segmentation and classification provide critical quantitative foundations for digital pathology diagnosis. With the advent of the foundational Segment Anything Model (SAM), the accuracy and efficiency of nuclear…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Liying Xu , Hongliang He , Wei Han , Hanbin Huang , Siwei Feng , Guohong Fu

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu

We have witnessed remarkable progress in foundation models in vision tasks. Currently, several recent works have utilized the segmenting anything model (SAM) to boost the segmentation performance in medical images, where most of them focus…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Haoran Wang , Lian Huai , Wenbin Li , Lei Qi , Xingqun Jiang , Yinghuan Shi

Studying the growth and metabolism of microbes provides critical insights into their evolutionary adaptations to harsh environments, which are essential for microbial research and biotechnology applications. In this study, we developed an…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Shuang Zhang , Carleton Coffin , Karyn L. Rogers , Catherine Ann Royer , Ge Wang

The segment anything model (SAM) was released as a foundation model for image segmentation. The promptable segmentation model was trained by over 1 billion masks on 11M licensed and privacy-respecting images. The model supports zero-shot…

Recently, the first foundation model developed specifically for image segmentation tasks was developed, termed the "Segment Anything Model" (SAM). SAM can segment objects in input imagery based on cheap input prompts, such as one (or more)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simiao Ren , Francesco Luzi , Saad Lahrichi , Kaleb Kassaw , Leslie M. Collins , Kyle Bradbury , Jordan M. Malof

Most state-of-the-art techniques for medical image segmentation rely on deep-learning models. These models, however, are often trained on narrowly-defined tasks in a supervised fashion, which requires expensive labeled datasets. Recent…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Heejong Kim , Victor Ion Butoi , Adrian V. Dalca , Daniel J. A. Margolis , Mert R. Sabuncu

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

Automatic cell segmentation in microscopy images works well with the support of deep neural networks trained with full supervision. Collecting and annotating images, though, is not a sustainable solution for every new microscopy database…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Youssef Dawoud , Julia Hornauer , Gustavo Carneiro , Vasileios Belagiannis