中文
相关论文

相关论文: Grounded SAM: Assembling Open-World Models for Div…

200 篇论文

We present SLIP (SAM+CLIP), an enhanced architecture for zero-shot object segmentation. SLIP combines the Segment Anything Model (SAM) \cite{kirillov2023segment} with the Contrastive Language-Image Pretraining (CLIP)…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Saaketh Koundinya Gundavarapu , Arushi Arora , Shreya Agarwal

Optical Flow Estimation aims to find the 2D dense motion field between two frames. Due to the limitation of model structures and training datasets, existing methods often rely too much on local clues and ignore the integrity of objects,…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Shili Zhou , Ruian He , Weimin Tan , Bo Yan

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Powered by large-scale pre-training, vision foundation models exhibit significant potential in open-world image understanding. However, unlike large language models that excel at directly tackling various language tasks, vision foundation…

计算机视觉与模式识别 · 计算机科学 2024-01-22 Yang Liu , Muzhi Zhu , Hengtao Li , Hao Chen , Xinlong Wang , Chunhua Shen

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-trained SAM and achieved…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Han Shu , Wenshuo Li , Yehui Tang , Yiman Zhang , Yihao Chen , Houqiang Li , Yunhe Wang , Xinghao Chen

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

In this paper, we introduce an open-vocabulary panoptic segmentation model that effectively unifies the strengths of the Segment Anything Model (SAM) with the vision-language CLIP model in an end-to-end framework. While SAM excels in…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Vibashan VS , Shubhankar Borse , Hyojin Park , Debasmit Das , Vishal Patel , Munawar Hayat , Fatih Porikli

Object detection has long been dominated by traditional coordinate regression-based models, such as YOLO, DETR, and Grounding DINO. Although recent efforts have attempted to leverage MLLMs to tackle this task, they face challenges like low…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Qing Jiang , Junan Huo , Xingyu Chen , Yuda Xiong , Zhaoyang Zeng , Yihao Chen , Tianhe Ren , Junzhi Yu , Lei Zhang

Change Detection (CD) is a fundamental task in remote sensing. It monitors the evolution of land cover over time. Based on this, Open-Vocabulary Change Detection (OVCD) introduces a new requirement. It aims to reduce the reliance on…

计算机视觉与模式识别 · 计算机科学 2026-04-27 Xu Zhang , Danyang Li , Yingjie Xia , Xiaohang Dong , Hualong Yu , Jianye Wang , Qicheng Li

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

图像与视频处理 · 电气工程与系统科学 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu

The Segment Anything Model 2 (SAM2) has emerged as a foundation model for universal segmentation. Owing to its generalizable visual representations, SAM2 has been successfully applied to various downstream tasks. However, extending SAM2 to…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Jiyuan Liu , Jia Lin , Xiaofei Zhou , Runmin Cong , Deyang Liu , Zhi Liu

Visual grounding, a crucial vision-language task involving the understanding of the visual context based on the query expression, necessitates the model to capture the interactions between objects, as well as various spatial and attribute…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Haozhan Shen , Tiancheng Zhao , Mingwei Zhu , Jianwei Yin

Current state-of-the-art methods for panoptic segmentation require an immense amount of annotated training data that is both arduous and expensive to obtain posing a significant challenge for their widespread adoption. Concurrently, recent…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Markus Käppeler , Kürsat Petek , Niclas Vödisch , Wolfram Burgard , Abhinav Valada

The Segment Anything Model (SAM) serves as a fundamental model for semantic segmentation and demonstrates remarkable generalization capabilities across a wide range of downstream scenarios. In this empirical study, we examine SAM's…

图像与视频处理 · 电气工程与系统科学 2023-08-15 An Wang , Mobarakol Islam , Mengya Xu , Yang Zhang , Hongliang Ren

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang

Updated building footprints with refugee camps from high-resolution satellite imagery can support related humanitarian operations. This study explores the utilization of the "Segment Anything Model" (SAM) and one of its branches,…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Yunya Gao

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

The Segment Anything Model (SAM) has gained significant attention in the field of image segmentation due to its impressive capabilities and prompt-based interface. While SAM has already been extensively evaluated in various domains, its…

图像与视频处理 · 电气工程与系统科学 2023-09-01 Botond Fazekas , José Morano , Dmitrii Lachinov , Guilherme Aresta , Hrvoje Bogunović