中文
相关论文

相关论文: Segment Anything with Multiple Modalities

200 篇论文

The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous generations-including…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Tianrun Chen , Runlong Cao , Xinda Yu , Lanyun Zhu , Chaotao Ding , Deyi Ji , Cheng Chen , Qi Zhu , Chunyan Xu , Papa Mao , Ying Zang

The recently introduced Segment Anything Model (SAM) combines a clever architecture and large quantities of training data to obtain remarkable image segmentation capabilities. However, it fails to reproduce such results for…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Tal Shaharabany , Aviad Dahan , Raja Giryes , Lior Wolf

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect the largest video…

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

图像与视频处理 · 电气工程与系统科学 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape

Segment Anything Models (SAMs), as vision foundation models, have demonstrated remarkable performance across various image analysis tasks. Despite their strong generalization capabilities, SAMs encounter challenges in fine-grained detail…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Haoran Shen , Peixian Zhuang , Jiahao Kou , Yuxin Zeng , Haoying Xu , Jiangyun Li

The universality of deep neural networks across different modalities and their generalization capabilities to unseen domains play an essential role in medical image segmentation. The recent segment anything model (SAM) has demonstrated…

图像与视频处理 · 电气工程与系统科学 2025-07-02 Qing Xu , Jiaxuan Li , Xiangjian He , Chenxin Li , Fiseha B. Tesem , Wenting Duan , Zhen Chen , Rong Qu , Jonathan M. Garibaldi , Chang Wen Chen

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

Meta AI Research has recently released SAM (Segment Anything Model) which is trained on a large segmentation dataset of over 1 billion masks. As a foundation model in the field of computer vision, SAM (Segment Anything Model) has gained…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Dongsheng Han , Chaoning Zhang , Yu Qiao , Maryam Qamar , Yuna Jung , SeungKyu Lee , Sung-Ho Bae , Choong Seon Hong

The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Li Zhang , Youwei Liang , Ruiyi Zhang , Amirhosein Javadi , Pengtao Xie

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Entity Segmentation (ES) aims at identifying and segmenting distinct entities within an image without the need for predefined class labels. This characteristic makes ES well-suited to open-world applications with adaptation to diverse and…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Weiming Zhang , Dingwen Xiao , Lei Chen , Lin Wang

The Segment-Anything Model (SAM) is a vision foundation model for segmentation with a prompt-driven framework. SAM generates class-agnostic masks based on user-specified instance-referring prompts. However, adapting SAM for automated…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Hussni Mohd Zakir , Eric Tatt Wei Ho

Medical imaging plays a critical role in the diagnosis and treatment planning of various medical conditions, with radiology and pathology heavily reliant on precise image segmentation. The Segment Anything Model (SAM) has emerged as a…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Amin Ranem , Niklas Babendererde , Moritz Fuchs , Anirban Mukhopadhyay

The introduction of saliency map algorithms as an approach for assessing the interoperability of images has allowed for a deeper understanding of current black-box models with Artificial Intelligence. Their rise in popularity has led to…

图像与视频处理 · 电气工程与系统科学 2023-06-29 Evan Kellener , Ihina Nath , An Ngo , Thomas Nguyen , Joshua Schuman , Coen Adler , Arnav Kartikeya

The Segment Anything Model (SAM) excels at generating precise object masks from input prompts but lacks semantic awareness, failing to associate its generated masks with specific object categories. To address this limitation, we propose…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Rohit Kundu , Sudipta Paul , Arindam Dutta , Amit K. Roy-Chowdhury

Industrial X-ray computed tomography (XCT) is a powerful tool for non-destructive characterization of materials and manufactured components. XCT commonly accompanied by advanced image analysis and computer vision algorithms to extract…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Anika Tabassum , Amirkoushyar Ziabari

Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on…

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

图像与视频处理 · 电气工程与系统科学 2025-11-04 Tyler Ward , Meredith K. Owen , O'Kira Coleman , Brian Noehren , Abdullah-Al-Zubaer Imran

The recent wave of foundation models has witnessed tremendous success in computer vision (CV) and beyond, with the segment anything model (SAM) having sparked a passion for exploring task-agnostic visual foundation models. Empowered by its…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Chunhui Zhang , Yawen Cui , Weilin Lin , Guanjie Huang , Yan Rong , Li Liu , Shiguang Shan

The Segment Anything Model (SAM) is a promptable segmentation model recently introduced by Meta AI that has demonstrated its prowess across various fields beyond just image segmentation. SAM can accurately segment images across diverse…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Junzhang Chen , Xiangzhi Bai