中文
相关论文

相关论文: Visual Adaptive Prompting for Compositional Zero-S…

200 篇论文

Open-World Compositional Zero-shot Learning (OW-CZSL) aims to recognize novel compositions of state and object primitives in images with no priors on the compositional space, which induces a tremendously large output space containing all…

计算机视觉与模式识别 · 计算机科学 2023-12-18 Fushuo Huo , Wenchao Xu , Song Guo , Jingcai Guo , Haozhao Wang , Ziming Liu , Xiaocheng Lu

Large vision-language models (LVLMs) are markedly proficient in deriving visual representations guided by natural language. Recent explorations have utilized LVLMs to tackle zero-shot visual anomaly detection (VAD) challenges by pairing…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Jiaqi Zhu , Shaofeng Cai , Fang Deng , Beng Chin Ooi , Junran Wu

Creative generation is the synthesis of new, surprising, and valuable samples that reflect user intent yet cannot be envisioned in advance. This task aims to extend human imagination, enabling the discovery of visual concepts that exist in…

图形学 · 计算机科学 2025-10-14 Shelly Golan , Yotam Nitzan , Zongze Wu , Or Patashnik

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

计算与语言 · 计算机科学 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer

We propose Context-Adaptive Multi-Prompt Embedding, a novel approach to enrich semantic representations in vision-language contrastive learning. Unlike standard CLIP-style models that rely on a single text embedding, our method introduces…

机器学习 · 计算机科学 2025-08-07 Dahun Kim , Anelia Angelova

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li

Recent Vision-Language Pretrained (VLP) models have become the backbone for many downstream tasks, but they are utilized as frozen model without learning. Prompt learning is a method to improve the pre-trained VLP model by adding a…

计算与语言 · 计算机科学 2024-01-17 Youngjae Cho , HeeSun Bae , Seungjae Shin , Yeo Dong Youn , Weonyoung Joo , Il-Chul Moon

Prompt learning is an effective method to customize Vision-Language Models (VLMs) for various downstream tasks, involving tuning very few parameters of input prompt tokens. Recently, prompt pretraining in large-scale dataset (e.g.,…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Zhenyuan Chen , Lingfeng Yang , Shuo Chen , Zhaowei Chen , Jiajun Liang , Xiang Li

Vision Large Language Models (VLLMs) exhibit promising potential for multi-modal understanding, yet their application to video-based emotion recognition remains limited by insufficient spatial and contextual awareness. Traditional…

计算机视觉与模式识别 · 计算机科学 2025-07-14 Zhifeng Wang , Qixuan Zhang , Peter Zhang , Wenjia Niu , Kaihao Zhang , Ramesh Sankaranarayana , Sabrina Caldwell , Tom Gedeon

Compositional zero-shot learning (CZSL) refers to recognizing unseen compositions of known visual primitives, which is an essential ability for artificial intelligence systems to learn and understand the world. While considerable progress…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Siteng Huang , Qiyao Wei , Donglin Wang

Vision-language models (VLMs) offer flexible object detection through natural language prompts but suffer from performance variability depending on prompt phrasing. In this paper, we introduce a method for automated prompt refinement using…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Lucas Choi , Ross Greer

Prompt ensembling of Large Language Model (LLM) generated category-specific prompts has emerged as an effective method to enhance zero-shot recognition ability of Vision-Language Models (VLMs). To obtain these category-specific prompts, the…

计算机视觉与模式识别 · 计算机科学 2024-08-08 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Sivan Doveh , Jakub Micorek , Mateusz Kozinski , Hilde Kuehne , Horst Possegger

Zero-shot learning (ZSL) aims to recognize instances of unseen classes solely based on the semantic descriptions of the classes. Existing algorithms usually formulate it as a semantic-visual correspondence problem, by learning mappings from…

计算机视觉与模式识别 · 计算机科学 2019-11-28 Kai Li , Martin Renqiang Min , Yun Fu

Low-shot image classification, where training images are limited or inaccessible, has benefited from recent progress on pre-trained vision-language (VL) models with strong generalizability, e.g. CLIP. Prompt learning methods built with VL…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Zhaoheng Zheng , Jingmin Wei , Xuefeng Hu , Haidong Zhu , Ram Nevatia

Vision-language models (VLMs) have demonstrated impressive zero-shot transfer capabilities in image-level visual perception tasks. However, they fall short in 3D instance-level segmentation tasks that require accurate localization and…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Junyuan Fang , Zihan Wang , Yejun Zhang , Shuzhe Wang , Iaroslav Melekhov , Juho Kannala

Zero-Shot Anomaly Detection (ZSAD) aims to identify and localize anomalous regions in images of unseen object classes. While recent methods based on vision-language models like CLIP show promise, their performance is constrained by existing…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yuheng Shao , Lizhang Wang , Changhao Li , Peixian Chen , Qinyuan Liu

Effective cross-modal retrieval is essential for applications like information retrieval and recommendation systems, particularly in specialized domains such as manufacturing, where product information often consists of visual samples…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Francesco Giuliari , Asif Khan Pattan , Mohamed Lamine Mekhalfi , Fabio Poiesi

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on…

计算机视觉与模式识别 · 计算机科学 2018-07-25 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Recently, large-scale vision-language models such as CLIP have demonstrated immense potential in zero-shot anomaly segmentation (ZSAS) task, utilizing a unified model to directly detect anomalies on any unseen product with painstakingly…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Zhen Qu , Xian Tao , Mukesh Prasad , Fei Shen , Zhengtao Zhang , Xinyi Gong , Guiguang Ding