English
Related papers

Related papers: Deep Instruction Tuning for Segment Anything Model

200 papers

The Segment Anything Model (SAM) was originally designed for label-agnostic mask generation. Does this model also possess inherent semantic understanding, of value to broader visual tasks? In this work we follow a multi-staged approach…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Miguel Espinosa , Chenhongyi Yang , Linus Ericsson , Steven McDonagh , Elliot J. Crowley

Segment Anything Model 2 (SAM 2), a prompt-driven foundation model extending SAM to both image and video domains, has shown superior zero-shot performance compared to its predecessor. Building on SAM's success in medical image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Bin Xie , Hao Tang , Yan Yan , Gady Agam

The Segment Anything Model (SAM), a profound vision foundation model pretrained on a large-scale dataset, breaks the boundaries of general segmentation and sparks various downstream applications. This paper introduces Hi-SAM, a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Maoyuan Ye , Jing Zhang , Juhua Liu , Chenyu Liu , Baocai Yin , Cong Liu , Bo Du , Dacheng Tao

Foundation models, such as OpenAI's GPT-3 and GPT-4, Meta's LLaMA, and Google's PaLM2, have revolutionized the field of artificial intelligence. A notable paradigm shift has been the advent of the Segment Anything Model (SAM), which has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruikai Cui , Siyuan He , Shi Qiu

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

Driven by large-data pre-training, Segment Anything Model (SAM) has been demonstrated as a powerful and promptable framework, revolutionizing the segmentation models. Despite the generality, customizing SAM for specific visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Renrui Zhang , Zhengkai Jiang , Ziyu Guo , Shilin Yan , Junting Pan , Xianzheng Ma , Hao Dong , Peng Gao , Hongsheng Li

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

The Segment Anything Model (SAM) is a foundation model for general image segmentation. Although it exhibits impressive performance predominantly on natural images, understanding its robustness against various image perturbations and domains…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yuqing Wang , Yun Zhao , Linda Petzold

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

The current variants of the Segment Anything Model (SAM), which include the original SAM and Medical SAM, still lack the capability to produce sufficiently accurate segmentation for medical images. In medical imaging contexts, it is not…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tianyu Huang , Tao Zhou , Weidi Xie , Shuo Wang , Qi Dou , Yizhe Zhang

Purpose: The recent Segment Anything Model (SAM) has demonstrated impressive performance with point, text or bounding box prompts, in various applications. However, in safety-critical surgical tasks, prompting is not possible due to (i) the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuyang Sheng , Sophia Bano , Matthew J. Clarkson , Mobarakol Islam

Amodal instance segmentation, which aims to detect and segment both visible and invisible parts of objects in images, plays a crucial role in various applications including autonomous driving, robotic manipulation, and scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wei-En Tai , Yu-Lin Shih , Cheng Sun , Yu-Chiang Frank Wang , Hwann-Tzong Chen

This paper tackles a novel yet challenging problem: how to transfer knowledge from the emerging Segment Anything Model (SAM) -- which reveals impressive zero-shot instance segmentation capacity -- to learn a compact panoramic semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Weiming Zhang , Yexin Liu , Xu Zheng , Lin Wang

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais

The recent Segment Anything Model (SAM) has emerged as a new paradigmatic vision foundation model, showcasing potent zero-shot generalization and flexible prompting. Despite SAM finding applications and adaptations in various domains, its…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Xumeng Han , Longhui Wei , Xuehui Yu , Zhiyang Dou , Xin He , Kuiran Wang , Yingfei Sun , Zhenjun Han , Qi Tian

Powered by massive curated training data, Segment Anything Model (SAM) has demonstrated its impressive generalization capabilities in open-world scenarios with the guidance of prompts. However, the vanilla SAM is class agnostic and heavily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Duojun Huang , Xinyu Xiong , Jie Ma , Jichang Li , Zequn Jie , Lin Ma , Guanbin Li

Segment anything model (SAM) has shown its spectacular performance in segmenting universal objects, especially when elaborate prompts are provided. However, the drawback of SAM is twofold. On the first hand, it fails to segment specific…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Leiping Jie , Hui Zhang

Semantic segmentation plays a critical role in enabling intelligent vehicles to comprehend their surrounding environments. However, deep learning-based methods usually perform poorly in domain shift scenarios due to the lack of labeled data…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Weihao Yan , Yeqiang Qian , Xingyuan Chen , Hanyang Zhuang , Chunxiang Wang , Ming Yang

Segment Anything Model (SAM) has attracted widespread attention for its superior interactive segmentation capabilities with visual prompts while lacking further exploration of text prompts. In this paper, we empirically investigate what…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuxuan Zhang , Tianheng Cheng , Lianghui Zhu , Rui Hu , Lei Liu , Heng Liu , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

We propose SAMed, a general solution for medical image segmentation. Different from the previous methods, SAMed is built upon the large-scale image segmentation model, Segment Anything Model (SAM), to explore the new research paradigm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Kaidong Zhang , Dong Liu