English
Related papers

Related papers: Stitching, Fine-tuning, Re-training: A SAM-enabled…

200 papers

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

Medical image segmentation is vital for clinical diagnosis and quantitative analysis, yet remains challenging due to the heterogeneity of imaging modalities and the high cost of pixel-level annotations. Although general interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yujie Lu , Jingwen Li , Sibo Ju , Yanzhou Su , he yao , Yisong Liu , Min Zhu , Junlong Cheng

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-01-18 Yuhao Huang , Xin Yang , Lian Liu , Han Zhou , Ao Chang , Xinrui Zhou , Rusi Chen , Junxuan Yu , Jiongquan Chen , Chaoyu Chen , Sijing Liu , Haozhe Chi , Xindi Hu , Kejuan Yue , Lei Li , Vicente Grau , Deng-Ping Fan , Fajin Dong , Dong Ni

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang

We propose Semantic-Fast-SAM (SFS), a semantic segmentation framework that combines the Fast Segment Anything model with a semantic labeling pipeline to achieve real-time performance without sacrificing accuracy. FastSAM is an efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Byunghyun Kim

The Segment Anything Model (SAM) has set a new standard in interactive image segmentation, offering robust performance across various tasks. However, its significant computational requirements limit its deployment in real-time or…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Kunal Dasharath Patil , Gowthamaan Palani , Ganapathy Krishnamurthi

Deep learning-based semi-supervised learning (SSL) algorithms have led to promising results in medical images segmentation and can alleviate doctors' expensive annotations by leveraging unlabeled data. However, most of the existing SSL…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Xiangde Luo , Jieneng Chen , Tao Song , Yinan Chen , Guotai Wang , Shaoting Zhang

Self-training via pseudo labeling is a conventional, simple, and popular pipeline to leverage unlabeled data. In this work, we first construct a strong baseline of self-training (namely ST) for semi-supervised semantic segmentation via…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

Foundation models such as Segment Anything Model 2 (SAM 2) exhibit strong generalization on natural images and videos but perform poorly on medical data due to differences in appearance statistics, imaging physics, and three-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Satrajit Chakrabarty , Sourya Sengupta , Gopal Avinash , Ravi Soni

Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Nhat-Tan Bui , Dinh-Hieu Hoang , Minh-Triet Tran , Gianfranco Doretto , Donald Adjeroh , Brijesh Patel , Arabinda Choudhary , Ngan Le

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Trevor J. Chan , Aarush Sahni , Yijin Fang , Jie Li , Alisha Luthra , Alison Pouch , Chamith S. Rajapakse

Scribble-supervised methods have emerged to mitigate the prohibitive annotation burden in medical image segmentation. However, the inherent sparsity of these annotations introduces significant ambiguity, which results in noisy pseudo-label…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Thanh-Huy Nguyen , Hoang-Loc Cao , Dat T. Chung , Mai-Anh Vu , Thanh-Minh Nguyen , Minh Le , Phat K. Huynh , Ulas Bagci

The current variants of the Segment Anything Model (SAM), which include the original SAM and Medical SAM, still lack the capability to produce sufficiently accurate segmentation for medical images. In medical imaging contexts, it is not…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tianyu Huang , Tao Zhou , Weidi Xie , Shuo Wang , Qi Dou , Yizhe Zhang

Image registration is a fundamental medical image analysis task. Ideally, registration should focus on aligning semantically corresponding voxels, i.e., the same anatomical locations. However, existing methods often optimize similarity…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Lin Tian , Zi Li , Fengze Liu , Xiaoyu Bai , Jia Ge , Le Lu , Marc Niethammer , Xianghua Ye , Ke Yan , Daikai Jin

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu

Recent trends in semi-supervised learning have significantly boosted the performance of 3D semi-supervised medical image segmentation. Compared with 2D images, 3D medical volumes involve information from different directions, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Heng Cai , Shumeng Li , Lei Qi , Qian Yu , Yinghuan Shi , Yang Gao

The success of deep learning methods in medical image segmentation tasks usually requires a large amount of labeled data. However, obtaining reliable annotations is expensive and time-consuming. Semi-supervised learning has attracted much…

Image and Video Processing · Electrical Eng. & Systems 2021-07-13 Yichi Zhang , Jicong Zhang

The accurate reconstruction of surgical scenes from surgical videos is critical for various applications, including intraoperative navigation and image-guided robotic surgery automation. However, previous approaches, mainly relying on depth…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Ange Lou , Yamin Li , Xing Yao , Yike Zhang , Jack Noble

The emerging scale segmentation model, Segment Anything (SAM), exhibits impressive capabilities in zero-shot segmentation for natural images. However, when applied to medical images, SAM suffers from noticeable performance drop. To make SAM…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Xinrong Hu , Xiaowei Xu , Yiyu Shi