中文
相关论文

相关论文: Char-SAM: Turning Segment Anything Model into Scen…

200 篇论文

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Shayan Jalilian , Abdul Bais

In the rapidly evolving field of AI research, foundational models like BERT and GPT have significantly advanced language and vision tasks. The advent of pretrain-prompting models such as ChatGPT and Segmentation Anything Model (SAM) has…

图像与视频处理 · 电气工程与系统科学 2024-01-25 Saiyang Na , Yuzhi Guo , Feng Jiang , Hehuan Ma , Junzhou Huang

In light of the diminishing returns of traditional methods for enhancing transmission rates, the domain of semantic communication presents promising new frontiers. Focusing on image transmission, this paper explores the application of…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Shehbaz Tariq , Brian Estadimas Arfeto , Chaoning Zhang , Hyundong Shin

The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Li Zhang , Youwei Liang , Ruiyi Zhang , Amirhosein Javadi , Pengtao Xie

Surgical image segmentation is highly challenging, primarily due to scarcity of annotated data. Generalist prompted segmentation models like the Segment-Anything Model (SAM) can help tackle this task, but because they require image-specific…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Aditya Murali , Farahdiba Zarin , Adrien Meyer , Pietro Mascagni , Didier Mutter , Nicolas Padoy

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

This study presents a novel multimodal medical image zero-shot segmentation algorithm named the text-visual-prompt segment anything model (TV-SAM) without any manual annotations. The TV-SAM incorporates and integrates the large language…

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

图像与视频处理 · 电气工程与系统科学 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

The Segment Anything Model (SAM), a profound vision foundation model pretrained on a large-scale dataset, breaks the boundaries of general segmentation and sparks various downstream applications. This paper introduces Hi-SAM, a unified…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Maoyuan Ye , Jing Zhang , Juhua Liu , Chenyu Liu , Baocai Yin , Cong Liu , Bo Du , Dacheng Tao

The Segment Anything Model (SAM) has demonstrated strong and versatile segmentation capabilities, along with intuitive prompt-based interactions. However, customizing SAM for medical image segmentation requires massive amounts of…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Zhonghao Yan , Zijin Yin , Tianyu Lin , Xiangzhu Zeng , Kongming Liang , Zhanyu Ma

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

The Segment Anything Model (SAM) achieves remarkable promptable segmentation given high-quality prompts which, however, often require good skills to specify. To make SAM robust to casual prompts, this paper presents the first comprehensive…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Qi Fan , Xin Tao , Lei Ke , Mingqiao Ye , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu-Wing Tai , Chi-Keung Tang

Purpose: The recent Segment Anything Model (SAM) has demonstrated impressive performance with point, text or bounding box prompts, in various applications. However, in safety-critical surgical tasks, prompting is not possible due to (i) the…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Yuyang Sheng , Sophia Bano , Matthew J. Clarkson , Mobarakol Islam

Pixel-wise annotations are notoriously labourious and costly to obtain in the medical domain. To mitigate this burden, weakly supervised approaches based on bounding box annotations-much easier to acquire-offer a practical alternative.…

计算机视觉与模式识别 · 计算机科学 2025-07-04 Mélanie Gaillochet , Mehrdad Noori , Sahar Dastani , Christian Desrosiers , Hervé Lombaert

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang

Curating annotations for medical image segmentation is a labor-intensive and time-consuming task that requires domain expertise, resulting in "narrowly" focused deep learning (DL) models with limited translational utility. Recently,…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Pranav Kulkarni , Adway Kanhere , Dharmam Savani , Andrew Chan , Devina Chatterjee , Paul H. Yi , Vishwa S. Parekh

The performance of image segmentation models has historically been constrained by the high cost of collecting large-scale annotated data. The Segment Anything Model (SAM) alleviates this original problem through a promptable,…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Miguel Espinosa , Chenhongyi Yang , Linus Ericsson , Steven McDonagh , Elliot J. Crowley

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…