English
Related papers

Related papers: Efficient Knowledge Distillation of SAM for Medica…

200 papers

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tyler Ward , Abdullah-Al-Zubaer Imran

Foundation models have taken over natural language processing and image generation domains due to the flexibility of prompting. With the recent introduction of the Segment Anything Model (SAM), this prompt-driven paradigm has entered image…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Saikat Roy , Tassilo Wald , Gregor Koehler , Maximilian R. Rokuss , Nico Disch , Julius Holzschuh , David Zimmerer , Klaus H. Maier-Hein

Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Wei Ji , Jingjing Li , Qi Bi , Tingwei Liu , Wenbo Li , Li Cheng

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

The Segment Anything Model (SAM) has achieved a notable success in two-dimensional image segmentation in natural images. However, the substantial gap between medical and natural images hinders its direct application to medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Quan Quan , Fenghe Tang , Zikang Xu , Heqin Zhu , S. Kevin Zhou

The recently proposed Segment Anything Model (SAM) is a general tool for image segmentation, but it requires additional adaptation and careful fine-tuning for medical image segmentation, especially for small, irregularly-shaped, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Yaxi Chen , Aleksandra Ivanova , Shaheer U. Saeed , Rikin Hargunani , Jie Huang , Chaozong Liu , Yipeng Hu

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Li Zhang , Youwei Liang , Ruiyi Zhang , Amirhosein Javadi , Pengtao Xie

Segment Anything Model (SAM) exhibits remarkable zero-shot segmentation capability; however, its prohibitive computational costs make edge deployment challenging. Although post-training quantization (PTQ) offers a promising compression…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jing Zhang , Zhikai Li , Chengzhi Hu , Xuewen Liu , Qingyi Gu

Segment Anything Model (SAM) has shown impressive zero-shot transfer performance for various computer vision tasks recently. However, its heavy computation costs remain daunting for practical applications. MobileSAM proposes to replace the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Ao Wang , Hui Chen , Zijia Lin , Jungong Han , Guiguang Ding

Fully supervised deep learning (DL) models for surgical video segmentation have been shown to struggle with non-adversarial, real-world corruptions of image quality including smoke, bleeding, and low illumination. Foundation models for…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Yiqing Shen , Hao Ding , Xinyuan Shao , Mathias Unberath

Medical image segmentation is fundamental to clinical decision-making, yet existing models remain fragmented. They are usually trained on single knowledge sources and specific to individual tasks, modalities, or organs. This fragmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Bangwei Guo , Yunhe Gao , Meng Ye , Difei Gu , Yang Zhou , Leon Axel , Dimitris Metaxas

The Segment Anything Model 3 (SAM3) advances visual understanding with Promptable Concept Segmentation (PCS) across images and videos, but its unified architecture (shared vision backbone, DETR-style detector, dense-memory tracker) remains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chengxi Zeng , Yuxuan Jiang , Aaron Zhang

Optical Flow Estimation aims to find the 2D dense motion field between two frames. Due to the limitation of model structures and training datasets, existing methods often rely too much on local clues and ignore the integrity of objects,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Shili Zhou , Ruian He , Weimin Tan , Bo Yan

Accurate image segmentation is crucial in reservoir modelling and material characterization, enhancing oil and gas extraction efficiency through detailed reservoir models. This precision offers insights into rock properties, advancing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Zhaoyang Ma , Xupeng He , Shuyu Sun , Bicheng Yan , Hyung Kwak , Jun Gao

On top of Segment Anything Model (SAM), SAM 2 further extends its capability from image to video inputs through a memory bank mechanism and obtains a remarkable performance compared with previous methods, making it a foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Chong Zhou , Chenchen Zhu , Yunyang Xiong , Saksham Suri , Fanyi Xiao , Lemeng Wu , Raghuraman Krishnamoorthi , Bo Dai , Chen Change Loy , Vikas Chandra , Bilge Soran

Automated segmentation of ultrasound images can assist medical experts with diagnostic and therapeutic procedures. Although using the common modality of ultrasound, one typically needs separate datasets in order to segment, for example,…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Dongik Shin , Beomsuk Kim , Seungjun Baek

Tumor lesion segmentation on CT or MRI images plays a critical role in cancer diagnosis and treatment planning. Considering the inherent differences in tumor lesion segmentation data across various medical imaging modalities and equipment,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Hairong Shi , Songhao Han , Shaofei Huang , Yue Liao , Guanbin Li , Xiangxing Kong , Hua Zhu , Xiaomu Wang , Si Liu

Segmentation of anatomical structures and pathological regions in medical images is essential for modern clinical diagnosis, disease research, and treatment planning. While significant advancements have been made in deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao