English
Related papers

Related papers: Input Augmentation with SAM: Boosting Medical Imag…

200 papers

The field of medical image segmentation is hindered by the scarcity of large, publicly available annotated datasets. Not all datasets are made public for privacy reasons, and creating annotations for a large dataset is time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Iira Häkkinen , Iaroslav Melekhov , Erik Englesson , Hossein Azizpour , Juho Kannala

Tumor lesion segmentation on CT or MRI images plays a critical role in cancer diagnosis and treatment planning. Considering the inherent differences in tumor lesion segmentation data across various medical imaging modalities and equipment,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Hairong Shi , Songhao Han , Shaofei Huang , Yue Liao , Guanbin Li , Xiangxing Kong , Hua Zhu , Xiaomu Wang , Si Liu

The Segment Anything Model (SAM) has gained significant attention in the field of image segmentation due to its impressive capabilities and prompt-based interface. While SAM has already been extensively evaluated in various domains, its…

Image and Video Processing · Electrical Eng. & Systems 2023-09-01 Botond Fazekas , José Morano , Dmitrii Lachinov , Guilherme Aresta , Hrvoje Bogunović

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Automated segmentation of ultrasound images can assist medical experts with diagnostic and therapeutic procedures. Although using the common modality of ultrasound, one typically needs separate datasets in order to segment, for example,…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Dongik Shin , Beomsuk Kim , Seungjun Baek

Curating annotations for medical image segmentation is a labor-intensive and time-consuming task that requires domain expertise, resulting in "narrowly" focused deep learning (DL) models with limited translational utility. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Pranav Kulkarni , Adway Kanhere , Dharmam Savani , Andrew Chan , Devina Chatterjee , Paul H. Yi , Vishwa S. Parekh

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

Iris segmentation is a critical component of an iris biometric system and it involves extracting the annular iris region from an ocular image. In this work, we develop a pixel-level iris segmentation model from a foundational model, viz.,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Parisa Farmanifard , Arun Ross

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiang Gao , Kai Lu

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

Segment anything model (SAM) has emerged as the leading approach for zero-shot learning in segmentation tasks, offering the advantage of avoiding pixel-wise annotations. It is particularly appealing in medical image segmentation, where the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-29 Ziyi Huang , Hongshan Liu , Haofeng Zhang , Xueshen Li , Haozhe Liu , Fuyong Xing , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

Segment Anything Model (SAM), a vision foundation model trained on large-scale annotations, has recently continued raising awareness within medical image segmentation. Despite the impressive capabilities of SAM on natural scenes, it…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Yinuo Wang , Kai Chen , Weimin Yuan , Cai Meng , XiangZhi Bai

Image segmentation is a crucial task in computer vision, with wide-ranging applications in industry. The Segment Anything Model (SAM) has recently attracted intensive attention; however, its application in industrial inspection,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zheming Zuo , Joseph Smith , Jonathan Stonehouse , Boguslaw Obara

Purpose: Recent developments in computational pathology have been driven by advances in Vision Foundation Models, particularly the Segment Anything Model (SAM). This model facilitates nuclei segmentation through two primary methods:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Xueyuan Li , Can Cui , Ruining Deng , Yucheng Tang , Quan Liu , Tianyuan Yao , Shunxing Bao , Naweed Chowdhury , Haichun Yang , Yuankai Huo

Medical image segmentation is a critical task in computer-aided diagnosis and treatment planning. However, deep learning models often struggle to generalize across datasets due to domain shifts arising from variations in imaging protocols,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Phuoc-Nguyen Bui , Van-Nguyen Pham , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunyang Xiong , Bala Varadarajan , Lemeng Wu , Xiaoyu Xiang , Fanyi Xiao , Chenchen Zhu , Xiaoliang Dai , Dilin Wang , Fei Sun , Forrest Iandola , Raghuraman Krishnamoorthi , Vikas Chandra

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

Vision foundation models like the Segment Anything Model (SAM), pretrained on large-scale natural image datasets, often struggle in medical image segmentation due to a lack of domain-specific adaptation. In clinical practice, fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zelin Liu , Sicheng Dong , Bocheng Li , Yixuan Yang , Jiacheng Ruan , Chenxu Zhou , Suncheng Xiang

The Segment Anything Model (SAM) has demonstrated impressive performance in zero-shot promptable segmentation on natural images. The recently released Segment Anything Model 2 (SAM 2) claims to outperform SAM on images and extends the…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Sourya Sengupta , Satrajit Chakrabarty , Ravi Soni

Segment Anything Model (SAM), known for its remarkable zero-shot segmentation capabilities, has garnered significant attention in the community. Nevertheless, its performance is challenged when dealing with what we refer to as visually…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Guangqian Guo , Pengfei Chen , Yong Guo , Huafeng Chen , Boqiang Zhang , Shan Gao