English
Related papers

Related papers: MedCLIP-SAMv2: Towards Universal Text-Driven Medic…

200 papers

Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Nhat-Tan Bui , Dinh-Hieu Hoang , Minh-Triet Tran , Gianfranco Doretto , Donald Adjeroh , Brijesh Patel , Arabinda Choudhary , Ngan Le

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Recently, foundational models such as CLIP and SAM have shown promising performance for the task of Zero-Shot Anomaly Segmentation (ZSAS). However, either CLIP-based or SAM-based ZSAS methods still suffer from non-negligible key drawbacks:…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Shengze Li , Jianjian Cao , Peng Ye , Yuhan Ding , Chongjun Tu , Tao Chen

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Trevor J. Chan , Aarush Sahni , Yijin Fang , Jie Li , Alisha Luthra , Alison Pouch , Chamith S. Rajapakse

Medical image analysis is critical yet challenged by the need of jointly segmenting organs or tissues, and numerous instances for anatomical structures and tumor microenvironment analysis. Existing studies typically formulated different…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Qing Xu , Yuxiang Luo , Wenting Duan , Zhen Chen

This work presents a tuning-free semantic segmentation framework based on classifying SAM masks by CLIP, which is universally applicable to various types of supervision. Initially, we utilize CLIP's zero-shot classification ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xiaobo Yang , Xiaojin Gong

Medical image segmentation is a fundamental and critical step in many image-guided clinical approaches. Recent success of deep learning-based segmentation methods usually relies on a large amount of labeled data, which is particularly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Rushi Jiao , Yichi Zhang , Le Ding , Rong Cai , Jicong Zhang

Surgical video segmentation is critical for AI to interpret spatial-temporal dynamics in surgery, yet model performance is constrained by limited annotated data. The SAM2 model, pretrained on natural videos, offers potential for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Cheng Yuan , Jian Jiang , Kunyi Yang , Lv Wu , Rui Wang , Zi Meng , Haonan Ping , Ziyu Xu , Yifan Zhou , Wanli Song , Hesheng Wang , Yueming Jin , Qi Dou , Yutong Ban

Medical image segmentation often faces the challenge of prohibitively expensive annotation costs. While few-shot learning offers a promising solution to alleviate this burden, conventional approaches still rely heavily on pre-training with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jie Xu , Xiaokang Li , Chengyu Yue , Yuanyuan Wang , Yi Guo

Segmenting objects with complex shapes, such as wires, bicycles, or structural grids, remains a significant challenge for current segmentation models, including the Segment Anything Model (SAM) and its high-quality variant SAM-HQ. These…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Luka Vetoshkin , Dmitry Yudin

The newly released Segment Anything Model (SAM) is a popular tool used in image processing due to its superior segmentation accuracy, variety of input prompts, training capabilities, and efficient model design. However, its current model is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Aimee Guo , Grace Fei , Hemanth Pasupuleti , Jing Wang

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Surgical image segmentation is highly challenging, primarily due to scarcity of annotated data. Generalist prompted segmentation models like the Segment-Anything Model (SAM) can help tackle this task, but because they require image-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Aditya Murali , Farahdiba Zarin , Adrien Meyer , Pietro Mascagni , Didier Mutter , Nicolas Padoy

Most publicly available medical segmentation datasets are only partially labeled, with annotations provided for a subset of anatomical structures. When multiple datasets are combined for training, this incomplete annotation poses…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Jiong Wu , Yang Xing , Boxiao Yu , Wei Shao , Kuang Gong

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

The Segment Anything Model 2 (SAM 2) is the latest generation foundation model for image and video segmentation. Trained on the expansive Segment Anything Video (SA-V) dataset, which comprises 35.5 million masks across 50.9K videos, SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Ange Lou , Yamin Li , Yike Zhang , Robert F. Labadie , Jack Noble

Although the Segment Anything Model (SAM) is highly effective in natural image segmentation, it requires dependencies on prompts, which limits its applicability to medical imaging where manual prompts are often unavailable. Existing efforts…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Mengmeng Zhang , Xingyuan Dai , Yicheng Sun , Jing Wang , Yueyang Yao , Xiaoyan Gong , Fuze Cong , Feiyue Wang , Yisheng Lv

The high cost of creating pixel-by-pixel gold-standard labels, limited expert availability, and presence of diverse tasks make it challenging to generate segmentation labels to train deep learning models for medical imaging tasks. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Tanvi Deshpande , Eva Prakash , Elsie Gyang Ross , Curtis Langlotz , Andrew Ng , Jeya Maria Jose Valanarasu

Semi-supervised learning (SSL) has achieved notable progress in medical image segmentation. To achieve effective SSL, a model needs to be able to efficiently learn from limited labeled data and effectively exploiting knowledge from abundant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Juzheng Miao , Cheng Chen , Keli Zhang , Jie Chuai , Quanzheng Li , Pheng-Ann Heng
‹ Prev 1 3 4 5 6 7 10 Next ›