English
Related papers

Related papers: Boosting Audio-visual Zero-shot Learning with Larg…

200 papers

Zero-shot learning (ZSL) aims at understanding unseen categories with no training examples from class-level descriptions. To improve the discriminative power of ZSL, we model the visual learning process of unseen categories with inspiration…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Mohamed Elhoseiny , Kai Yi , Mohamed Elfeki

Supervised learning methods can solve the given problem in the presence of a large set of labeled data. However, the acquisition of a dataset covering all the target classes typically requires manual labeling which is expensive and…

Sound · Computer Science 2022-06-13 Duygu Dogan , Huang Xie , Toni Heittola , Tuomas Virtanen

Existing approaches on zero-shot event detection usually train models on datasets annotated with known event types, and prompt them with unseen event definitions. These approaches yield sporadic successes, yet generally fall short of…

Computation and Language · Computer Science 2024-03-06 Zefan Cai , Po-Nien Kung , Ashima Suvarna , Mingyu Derek Ma , Hritik Bansal , Baobao Chang , P. Jeffrey Brantingham , Wei Wang , Nanyun Peng

Zero-shot Learning(ZSL) attains knowledge transfer from seen classes to unseen classes by exploring auxiliary category information, which is a promising yet difficult research topic. In this field, Audio-Visual Generalized Zero-Shot…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Yang Liu , Xun Zhang , Jiale Du , Xinbo Gao , Jungong Han

The fusion of vision and language has brought about a transformative shift in computer vision through the emergence of Vision-Language Models (VLMs). However, the resource-intensive nature of existing VLMs poses a significant challenge. We…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Jordan Shipard , Arnold Wiliem , Kien Nguyen Thanh , Wei Xiang , Clinton Fookes

Large-scale vision-language models (VLMs) have shown a strong zero-shot generalization capability on unseen-domain data. However, adapting pre-trained VLMs to a sequence of downstream tasks often leads to the forgetting of previously…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yu-Chu Yu , Chi-Pin Huang , Jr-Jen Chen , Kai-Po Chang , Yung-Hsuan Lai , Fu-En Yang , Yu-Chiang Frank Wang

Out-of-distribution (OOD) detection has seen significant advancements with zero-shot approaches by leveraging the powerful Vision-Language Models (VLMs) such as CLIP. However, prior research works have predominantly focused on enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Pei-Kang Lee , Jun-Cheng Chen , Ja-Ling Wu

Domain-specific knowledge can significantly contribute to addressing a wide variety of vision tasks. However, the generation of such knowledge entails considerable human labor and time costs. This study investigates the potential of Large…

The remarkable success of Large Language Models (LLMs) and instruction tuning drives the evolution of Vision Language Models (VLMs) towards a versatile general-purpose model. Yet, it remains unexplored whether current VLMs genuinely possess…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Byung-Kwan Lee , Beomchan Park , Chae Won Kim , Yong Man Ro

We present a deep generative model for learning to predict classes not seen at training time. Unlike most existing methods for this problem, that represent each class as a point (via a semantic embedding), we represent each seen/unseen…

Machine Learning · Computer Science 2017-11-21 Wenlin Wang , Yunchen Pu , Vinay Kumar Verma , Kai Fan , Yizhe Zhang , Changyou Chen , Piyush Rai , Lawrence Carin

Zero-shot learning (ZSL) aims to transfer knowledge from seen classes to semantically related unseen classes, which are absent during training. The promising strategies for ZSL are to synthesize visual features of unseen classes conditioned…

Artificial Intelligence · Computer Science 2021-12-30 Yun Li , Zhe Liu , Lina Yao , Xiaojun Chang

Pre-trained vision-language models, e.g., CLIP, working with manually designed prompts have demonstrated great capacity of transfer learning. Recently, learnable prompts achieve state-of-the-art performance, which however are prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Baoshuo Kan , Teng Wang , Wenpeng Lu , Xiantong Zhen , Weili Guan , Feng Zheng

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu

Unsupervised domain adaptation (UDA) enables models trained on a labeled source domain to handle new unlabeled domains. Recently, pre-trained vision-language models (VLMs) have demonstrated promising zero-shot performance by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Xinyao Li , Jingjing Li , Zhekai Du , Lei Zhu , Heng Tao Shen

Open-vocabulary object detection (OVOD) aims to detect the objects beyond the set of classes observed during training. This work introduces a straightforward and efficient strategy that utilizes pre-trained vision-language models (VLM),…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shilin Xu , Xiangtai Li , Size Wu , Wenwei Zhang , Yunhai Tong , Chen Change Loy

Zero-shot anomaly detection (ZSAD) requires detecting and localizing anomalies without access to target-class anomaly samples. Mainstream methods rely on vision-language models (VLMs) such as CLIP: they build hand-crafted or learned prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanning Hou , Peiyuan Li , Zirui Liu , Yitong Wang , Yanran Ruan , Jianfeng Qiu , Ke Xu

Zero-shot learning (ZSL) for image classification focuses on recognizing novel categories that have no labeled data available for training. The learning is generally carried out with the help of mid-level semantic descriptors associated…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Debasmit Das , C. S. George Lee

Learning to classify unseen class samples at test time is popularly referred to as zero-shot learning (ZSL). If test samples can be from training (seen) as well as unseen classes, it is a more challenging problem due to the existence of…

Machine Learning · Statistics 2019-09-11 Vinay Kumar Verma , Dhanajit Brahma , Piyush Rai

Retrained large language models (LLMs) have become extensively used across various sub-disciplines of natural language processing (NLP). In NLP, text classification problems have garnered considerable focus, but still faced with some…

Computation and Language · Computer Science 2023-12-05 Zhiqiang Wang , Yiran Pang , Yanbin Lin

Recent advances in using language models to obtain cross-modal audio-text representations have overcome the limitations of conventional training approaches that use predefined labels. This has allowed the community to make progress in tasks…