English
Related papers

Related papers: CLAPS: A CLIP-Unified Auto-Prompt Segmentation for…

200 papers

Polyp segmentation is vital for early colorectal cancer detection, yet traditional fully supervised methods struggle with morphological variability and domain shifts, requiring frequent retraining. Additionally, reliance on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xinyu Mao , Xiaohan Xing , Fei Meng , Jianbang Liu , Fan Bai , Qiang Nie , Max Meng

Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiaxing Huang , Kai Jiang , Jingyi Zhang , Han Qiu , Lewei Lu , Shijian Lu , Eric Xing

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Medical imaging is crucial for diagnosing a patient's health condition, and accurate segmentation of these images is essential for isolating regions of interest to ensure precise diagnosis and treatment planning. Existing methods primarily…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Longchao Da , Rui Wang , Xiaojian Xu , Parminder Bhatia , Taha Kass-Hout , Hua Wei , Cao Xiao

Open-vocabulary semantic segmentation aims to segment an image into semantic regions according to text descriptions, which may not have been seen during training. Recent two-stage methods first generate class-agnostic mask proposals and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Feng Liang , Bichen Wu , Xiaoliang Dai , Kunpeng Li , Yinan Zhao , Hang Zhang , Peizhao Zhang , Peter Vajda , Diana Marculescu

In digital pathology, precise nuclei segmentation is pivotal yet challenged by the diversity of tissue types, staining protocols, and imaging conditions. Recently, the segment anything model (SAM) revealed overwhelming performance in…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhen Chen , Qing Xu , Xinyu Liu , Yixuan Yuan

Medical image segmentation is fundamental to clinical decision-making, yet existing models remain fragmented. They are usually trained on single knowledge sources and specific to individual tasks, modalities, or organs. This fragmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Bangwei Guo , Yunhe Gao , Meng Ye , Difei Gu , Yang Zhou , Leon Axel , Dimitris Metaxas

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Segmenting objects with complex shapes, such as wires, bicycles, or structural grids, remains a significant challenge for current segmentation models, including the Segment Anything Model (SAM) and its high-quality variant SAM-HQ. These…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Luka Vetoshkin , Dmitry Yudin

Segmentation is a fundamental task in computer vision, with prompt-driven methods gaining prominence due to their flexibility. The Segment Anything Model (SAM) excels at point-prompted segmentation, while text-based models, often leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Suzhe Xu , Jialin Peng , Chengyuan Zhang

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Recent advances in promptable segmentation, such as the Segment Anything Model (SAM), have enabled flexible, high-quality mask generation across a wide range of visual domains. However, SAM and similar models remain fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Tyler Ward , Abdullah Imran

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model (SAM), have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Chen Gong , Dong Liang

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

The CLIP and Segment Anything Model (SAM) are remarkable vision foundation models (VFMs). SAM excels in segmentation tasks across diverse domains, whereas CLIP is renowned for its zero-shot recognition capabilities. This paper presents an…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Haobo Yuan , Xiangtai Li , Chong Zhou , Yining Li , Kai Chen , Chen Change Loy

Automatic polyp segmentation is crucial for effective diagnosis and treatment in colonoscopy images. Traditional methods encounter significant challenges in accurately delineating polyps due to limitations in feature representation and the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Quang Vinh Nguyen , Thanh Hoang Son Vo , Sae-Ryung Kang , Soo-Hyung Kim

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

A pre-trained visual-language model, contrastive language-image pre-training (CLIP), successfully accomplishes various downstream tasks with text prompts, such as finding images or localizing regions within the image. Despite CLIP's strong…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 YeongHyeon Park , Myung Jin Kim , Hyeong Seok Kim

Automated nodule segmentation is essential for computer-assisted diagnosis in ultrasound images. Nevertheless, most existing methods depend on precise pixel-level annotations by medical professionals, a process that is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xingyue Zhao , Peiqi Li , Xiangde Luo , Meng Yang , Shi Chang , Zhongyu Li