中文
相关论文

相关论文: ClipSAM: CLIP and SAM Collaboration for Zero-Shot …

200 篇论文

In this paper, we introduce an open-vocabulary panoptic segmentation model that effectively unifies the strengths of the Segment Anything Model (SAM) with the vision-language CLIP model in an end-to-end framework. While SAM excels in…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Vibashan VS , Shubhankar Borse , Hyojin Park , Debasmit Das , Vishal Patel , Munawar Hayat , Fatih Porikli

Zero-shot anomaly detection (ZSAD) aims to identify anomalies in unseen categories by leveraging CLIP's zero-shot capabilities to match text prompts with visual features. A key challenge in ZSAD is learning general prompts stably and…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Donghyeong Kim , Chaewon Park , Suhwan Cho , Hyeonjeong Lim , Minseok Kang , Jungho Lee , Sangyoun Lee

The CLIP and Segment Anything Model (SAM) are remarkable vision foundation models (VFMs). SAM excels in segmentation tasks across diverse domains, whereas CLIP is renowned for its zero-shot recognition capabilities. This paper presents an…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Haobo Yuan , Xiangtai Li , Chong Zhou , Yining Li , Kai Chen , Chen Change Loy

Brain tumor segmentation is important for diagnosis of the tumor, and current deep-learning methods rely on a large set of annotated images for training, with high annotation costs. Unsupervised segmentation is promising to avoid human…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Xiaochuan Ma , Jia Fu , Wenjun Liao , Shichuan Zhang , Guotai Wang

This paper considers zero-shot Anomaly Detection (AD), performing AD without reference images of the test objects. We propose a framework called CLIP-AD to leverage the zero-shot capabilities of the large vision-language model CLIP.…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Xuhai Chen , Jiangning Zhang , Guanzhong Tian , Haoyang He , Wuhao Zhang , Yabiao Wang , Chengjie Wang , Yong Liu

Zero-shot anomaly detection (ZSAD) targets the identification of anomalies within images from arbitrary novel categories. This study introduces AdaCLIP for the ZSAD task, leveraging a pre-trained vision-language model (VLM), CLIP. AdaCLIP…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Yunkang Cao , Jiangning Zhang , Luca Frittoli , Yuqi Cheng , Weiming Shen , Giacomo Boracchi

Few-shot anomaly detection methods can effectively address data collecting difficulty in industrial scenarios. Compared to 2D few-shot anomaly detection (2D-FSAD), 3D few-shot anomaly detection (3D-FSAD) is still an unexplored but essential…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Zuo Zuo , Jiahao Dong , Yao Wu , Yanyun Qu , Zongze Wu

Zero-shot anomaly detection (ZSAD) requires detection models trained using auxiliary data to detect anomalies without any training sample in a target dataset. It is a crucial task when training data is not accessible due to various…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Qihang Zhou , Guansong Pang , Yu Tian , Shibo He , Jiming Chen

Open-world and anomaly segmentation methods seek to enable autonomous driving systems to detect and segment both known and unknown objects in real-world scenes. However, existing methods do not assign semantically meaningful labels to…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Klara Reichard , Nikolas Brasch , Nassir Navab , Federico Tombari

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Shayan Jalilian , Abdul Bais

Image Anomaly Detection has been a challenging task in Computer Vision field. The advent of Vision-Language models, particularly the rise of CLIP-based frameworks, has opened new avenues for zero-shot anomaly detection. Recent studies have…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Zhaoxiang Zhang , Hanqiu Deng , Jinan Bao , Xingyu Li

Segment Anything Model (SAM) has gained significant recognition in the field of semantic segmentation due to its versatile capabilities and impressive performance. Despite its success, SAM faces two primary limitations: (1) it relies…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Yuchen Li , Li Zhang , Youwei Liang , Pengtao Xie

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Pixel-level segmentation is essential in remote sensing, where foundational vision models like CLIP and Segment Anything Model(SAM) have demonstrated significant capabilities in zero-shot segmentation tasks. Despite their advances,…

多媒体 · 计算机科学 2025-03-12 Xing Zi , Kairui Jin , Xian Tao , Jun Li , Ali Braytee , Rajiv Ratn Shah , Mukesh Prasad

The recently released Segment Anything Model (SAM) has shown powerful zero-shot segmentation capabilities through a semi-automatic annotation setup in which the user can provide a prompt in the form of clicks or bounding boxes. There is…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Benjamin Towle , Xin Chen , Ke Zhou

Zero-shot Semantic Segmentation (ZSS) aims to segment both seen and unseen classes using supervision from only seen classes. Beyond adaptation-based methods, distillation-based approaches transfer vision-language alignment of…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Jialei Chen , Xu Zheng , Danda Pani Paudel , Luc Van Gool , Hiroshi Murase , Daisuke Deguchi

Few-shot segmentation (FSS) aims to segment new classes using few annotated images. While recent FSS methods have shown considerable improvements by leveraging Segment Anything Model (SAM), they face two critical limitations: insufficient…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Shuai Chen , Fanman Meng , Liming Lei , Haoran Wei , Chenhao Wu , Qingbo Wu , Linfeng Xu , Hongliang Li

An innovative few-shot anomaly detection approach is presented, leveraging the pre-trained CLIP model for medical data, and adapting it for both image-level anomaly classification (AC) and pixel-level anomaly segmentation (AS). A…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Mahshid Shiri , Cigdem Beyan , Vittorio Murino

Semantic segmentation is a fundamental task in medical image analysis and autonomous driving and has a problem with the high cost of annotating the labels required in training. To address this problem, semantic segmentation methods based on…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Nagito Saito , Shintaro Ito , Koichi Ito , Takafumi Aoki

This paper presents a novel method that leverages a visual-language model, CLIP, as a data source for zero-shot anomaly detection. Tremendous efforts have been put towards developing anomaly detectors due to their potential industrial…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Masato Tamura