English
Related papers

Related papers: Revisiting foundation models for cell instance seg…

200 papers

The emergence of large models, also known as foundation models, has brought significant advancements to AI research. One such model is Segment Anything (SAM), which is designed for image segmentation tasks. However, as with other foundation…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Tianrun Chen , Lanyun Zhu , Chaotao Ding , Runlong Cao , Yan Wang , Zejian Li , Lingyun Sun , Papa Mao , Ying Zang

Automated nodule segmentation is essential for computer-assisted diagnosis in ultrasound images. Nevertheless, most existing methods depend on precise pixel-level annotations by medical professionals, a process that is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xingyue Zhao , Peiqi Li , Xiangde Luo , Meng Yang , Shi Chang , Zhongyu Li

This work aims to leverage pre-trained foundation models, such as contrastive language-image pre-training (CLIP) and segment anything model (SAM), to address weakly supervised semantic segmentation (WSSS) using image-level labels. To this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xiaobo Yang , Xiaojin Gong

The Segment Anything Model (SAM) exhibits a capability to segment a wide array of objects in natural images, serving as a versatile perceptual tool for various downstream image segmentation tasks. In contrast, medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yizhe Zhang , Tao Zhou , Shuo Wang , Ye Wu , Pengfei Gu , Danny Z. Chen

Foundation segmentation models such as SAM and SAM-2 perform well on natural images but struggle with brain MRIs where structures like the caudate and thalamus lack sharp boundaries and have low contrast. Rather than fine tune these models…

Image and Video Processing · Electrical Eng. & Systems 2025-11-26 Keith Moore

Accurate lesion segmentation is essential in medical image analysis, yet most existing methods are designed for specific anatomical sites or imaging modalities, limiting their generalizability. Recent vision-language foundation models…

Image and Video Processing · Electrical Eng. & Systems 2026-03-30 Guoping Xu , Jayaram K. Udupa , Yubing Tong , Xin Long , Ying Zhang , Jie Deng , Weiguo Lu , You Zhang

Although new vision foundation models such as Segment Anything Model 2 (SAM2) have significantly enhanced zero-shot image segmentation capabilities, reliance on human-provided prompts poses significant challenges in adapting SAM2 to medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yang Xing , Jiong Wu , Yuheng Bu , Kuang Gong

Medical image segmentation plays a pivotal role in clinical diagnostics and treatment planning, yet existing models often face challenges in generalization and in handling both 2D and 3D data uniformly. In this paper, we introduce Medical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiayuan Zhu , Abdullah Hamdi , Yunli Qi , Yueming Jin , Junde Wu

Cell segmentation is a fundamental task for computational biology analysis. Identifying the cell instances is often the first step in various downstream biomedical studies. However, many cell segmentation algorithms, including the recently…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Gihun Lee , Sangmook Kim , Joonkee Kim , Se-Young Yun

Foundation models, such as the Segment Anything Model (SAM), have heightened interest in promptable zero-shot segmentation. Although these models perform strongly on natural images, their behavior on medical data remains insufficiently…

Image and Video Processing · Electrical Eng. & Systems 2026-04-07 Satrajit Chakrabarty , Ravi Soni

The Segment Anything Model (SAM) is a recently proposed prompt-based segmentation model in a generic zero-shot segmentation approach. With the zero-shot segmentation capacity, SAM achieved impressive flexibility and precision on various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Can Cui , Ruining Deng , Quan Liu , Tianyuan Yao , Shunxing Bao , Lucas W. Remedios , Yucheng Tang , Yuankai Huo

Accurate medical image segmentation is essential for clinical diagnosis and treatment planning. While recent interactive foundation models (e.g., nnInteractive) enhance generalization through large-scale multimodal pretraining, they still…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ziyu Zhang , Yi Yu , Simeng Zhu , Ahmed Aly , Yunhe Gao , Ning Gu , Yuan Xue

Accurate lung tumor segmentation is crucial for improving diagnosis, treatment planning, and patient outcomes in oncology. However, the complexity of tumor morphology, size, and location poses significant challenges for automated…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Elena Mulero Ayllón , Massimiliano Mantegna , Linlin Shen , Paolo Soda , Valerio Guarrasi , Matteo Tortora

We present SAM4EM, a novel approach for 3D segmentation of complex neural structures in electron microscopy (EM) data by leveraging the Segment Anything Model (SAM) alongside advanced fine-tuning strategies. Our contributions include the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Uzair Shah , Marco Agus , Daniya Boges , Vanessa Chiappini , Mahmood Alzubaidi , Jens Schneider , Markus Hadwiger , Pierre J. Magistretti , Mowafa Househ , Corrado Calı

The unprecedented developments in segmentation foundational models have become a dominant force in the field of computer vision, introducing a multitude of previously unexplored capabilities in a wide range of natural images and videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Yichi Zhang , Zhenrong Shen

Fundamental models, trained on large-scale datasets and adapted to new data using innovative learning methods, have revolutionized various fields. In materials science, microstructure image segmentation plays a pivotal role in understanding…

Materials Science · Physics 2024-07-09 Xudong Ma , Yuqi Zhang , Chenchong Wang , Wei Xu

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

Background: The segment-anything model (SAM), introduced in April 2023, shows promise as a benchmark model and a universal solution to segment various natural images. It comes without previously-required re-training or fine-tuning specific…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Sheng He , Rina Bao , Jingpeng Li , Jeffrey Stout , Atle Bjornerud , P. Ellen Grant , Yangming Ou

The newly released Segment Anything Model (SAM) is a popular tool used in image processing due to its superior segmentation accuracy, variety of input prompts, training capabilities, and efficient model design. However, its current model is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Aimee Guo , Grace Fei , Hemanth Pasupuleti , Jing Wang

Medical image registration is a fundamental task in medical image analysis, aiming to establish spatial correspondences between paired images. However, existing unsupervised deformable registration methods rely solely on intensity-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Hao Xu , Tengfei Xue , Jianan Fan , Dongnan Liu , Yuqian Chen , Fan Zhang , Carl-Fredrik Westin , Ron Kikinis , Lauren J. O'Donnell , Weidong Cai