中文
相关论文

相关论文: Vision and Language Reference Prompt into SAM for …

200 篇论文

In this paper, we introduce an open-vocabulary panoptic segmentation model that effectively unifies the strengths of the Segment Anything Model (SAM) with the vision-language CLIP model in an end-to-end framework. While SAM excels in…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Vibashan VS , Shubhankar Borse , Hyojin Park , Debasmit Das , Vishal Patel , Munawar Hayat , Fatih Porikli

The Segment Anything Model (SAM) achieves remarkable promptable segmentation given high-quality prompts which, however, often require good skills to specify. To make SAM robust to casual prompts, this paper presents the first comprehensive…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Qi Fan , Xin Tao , Lei Ke , Mingqiao Ye , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu-Wing Tai , Chi-Keung Tang

Vision-Language Models (VLMs), particularly CLIP, have revolutionized anomaly detection by enabling zero-shot and few-shot defect identification without extensive labeled datasets. By learning aligned representations of images and text,…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Mohit Kakda , Mirudula Shri Muthukumaran , Uttapreksha Patel , Lawrence Swaminathan Xavier Prince

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Foundation vision-language models (VLMs) excel on natural images, but their utility for biomedical microscopy remains underexplored. In this paper, we investigate how in-context learning enables state-of-the-art VLMs to perform few-shot…

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

Extracting small objects from remote sensing imagery plays a vital role in various applications, including urban planning, environmental monitoring, and disaster management. While current research primarily focuses on small object…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu

Accurate tongue segmentation is crucial for reliable TCM analysis. Supervised models require large annotated datasets, while SAM-family models remain prompt-driven. We present Memory-SAM, a training-free, human-prompt-free pipeline that…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Joongwon Chae , Lihui Luo , Xi Yuan , Dongmei Yu , Zhenglin Chen , Lian Zhang , Peiwu Qin

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-trained SAM and achieved…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Han Shu , Wenshuo Li , Yehui Tang , Yiman Zhang , Yihao Chen , Houqiang Li , Yunhe Wang , Xinghao Chen

Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. Most previous methods rely on the pixel-level label of support images. In this paper, we focus on a more…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Haohan Wang , Liang Liu , Wuhao Zhang , Jiangning Zhang , Zhenye Gan , Yabiao Wang , Chengjie Wang , Haoqian Wang

In semi-supervised semantic segmentation, a model is trained with a limited number of labeled images along with a large corpus of unlabeled images to reduce the high annotation effort. While previous methods are able to learn good…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Lukas Hoyer , David Joseph Tan , Muhammad Ferjad Naeem , Luc Van Gool , Federico Tombari

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

Vision-language models (VLMs) pre-trained on large, heterogeneous data sources are becoming increasingly popular, providing rich multi-modal embeddings that enable efficient transfer to new tasks. A particularly relevant application is…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Julio Silva-Rodríguez , Ender Konukoglu

We present Segment Anything Model (SAM) 3, a unified model that detects, segments, and tracks objects in images and videos based on concept prompts, which we define as either short noun phrases (e.g., "yellow school bus"), image exemplars,…

Open-vocabulary semantic segmentation (OVSS) aims to segment and recognize objects universally. Trained on extensive high-quality segmentation data, the segment anything model (SAM) has demonstrated remarkable universal segmentation…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Lin Chen , Yingjian Zhu , Qi Yang , Xin Niu , Kun Ding , Shiming Xiang

Segment Anything (SAM) has recently pushed the boundaries of segmentation by demonstrating zero-shot generalization and flexible prompting after training on over one billion masks. Despite this, its mask prediction accuracy often falls…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Zezhong Fan , Xiaohan Li , Topojoy Biswas , Kaushiki Nag , Kannan Achan

Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block, and it plays a crucial role in environmental perception. Conventional…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Wenqi Ren , Yang Tang , Qiyu Sun , Chaoqiang Zhao , Qing-Long Han

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

计算机视觉与模式识别 · 计算机科学 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

In this paper, we address the challenge of few-shot classification in histopathology whole slide images (WSIs) by utilizing foundational vision-language models (VLMs) and slide-level prompt learning. Given the gigapixel scale of WSIs,…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Devavrat Tomar , Guillaume Vray , Dwarikanath Mahapatra , Sudipta Roy , Jean-Philippe Thiran , Behzad Bozorgtabar

The remarkable capabilities of the Segment Anything Model (SAM) for tackling image segmentation tasks in an intuitive and interactive manner has sparked interest in the design of effective visual prompts. Such interest has led to the…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jorge Quesada , Zoe Fowler , Mohammad Alotaibi , Mohit Prabhushankar , Ghassan AlRegib