English
Related papers

Related papers: Zero-Shot Audio Classification using Image Embeddi…

200 papers

Semantic Embeddings are a popular way to represent knowledge in the field of zero-shot learning. We observe their interpretability and discuss their potential utility in a safety-critical context. Concretely, we propose to use them to add…

Machine Learning · Statistics 2019-05-21 Thomas Brunner , Frederik Diehl , Michael Truong Le , Alois Knoll

Relation classification aims to extract semantic relations between entity pairs from the sentences. However, most existing methods can only identify seen relation classes that occurred during training. To recognize unseen relations at test…

Computation and Language · Computer Science 2020-11-02 Juan Li , Ruoxu Wang , Ningyu Zhang , Wen Zhang , Fan Yang , Huajun Chen

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Zero-shot learning (ZSL) aims to recognize unseen classes by generalizing the relation between visual features and semantic attributes learned from the seen classes. A recent paradigm called transductive zero-shot learning further leverages…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Zhengbo Wang , Jian Liang , Zilei Wang , Tieniu Tan

Generalised zero-shot learning (GZSL) methods aim to classify previously seen and unseen visual classes by leveraging the semantic information of those classes. In the context of GZSL, semantic information is non-visual data such as a text…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rafael Felix , Ben Harwood , Michele Sasdelli , Gustavo Carneiro

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu

Recent advances in audio-text cross-modal contrastive learning have shown its potential towards zero-shot learning. One possibility for this is by projecting item embeddings from pre-trained backbone neural networks into a cross-modal space…

Sound · Computer Science 2025-09-29 Tiago Tavares , Fabio Ayres , Zhepei Wang , Paris Smaragdis

Zero-shot learning, which aims to recognize new categories that are not included in the training set, has gained popularity owing to its potential ability in the real-word applications. Zero-shot learning models rely on learning an…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Xinsheng Wang , Shanmin Pang , Jihua Zhu , Zhongyu Li , Zhiqiang Tian , Yaochen Li

Federated learning is an effective way of extracting insights from different user devices while preserving the privacy of users. However, new classes with completely unseen data distributions can stream across any device in a federated…

Machine Learning · Computer Science 2021-06-21 Gautham Krishna Gudur , Satheesh K. Perepu

Recent advances in using language models to obtain cross-modal audio-text representations have overcome the limitations of conventional training approaches that use predefined labels. This has allowed the community to make progress in tasks…

Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. Zero-shot learning…

Machine Learning · Computer Science 2019-04-09 Meng Ye , Yuhong Guo

The number of categories for action recognition is growing rapidly. It is thus becoming increasingly hard to collect sufficient training data to learn conventional models for each category. This issue may be ameliorated by the increasingly…

Computer Vision and Pattern Recognition · Computer Science 2015-11-17 Xun Xu , Timothy Hospedales , Shaogang Gong

Generalized zero-shot learning recognizes inputs from both seen and unseen classes. Yet, existing methods tend to be biased towards the classes seen during training. In this paper, we strive to mitigate this bias. We propose a bias-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 William Thong , Cees G. M. Snoek

In this paper we propose a non-metric ranking-based representation of semantic similarity that allows natural aggregation of semantic information from multiple heterogeneous sources. We apply the ranking-based representation to zero-shot…

Machine Learning · Computer Science 2015-03-02 Jihun Hamm , Mikhail Belkin

This paper presents a method of zero-shot learning (ZSL) which poses ZSL as the missing data problem, rather than the missing label problem. Specifically, most existing ZSL methods focus on learning mapping functions from the image feature…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Botong Wu , Tianfu Wu , Yizhou Wang

Zero-shot learning (ZSL) aims to recognize unseen classes by leveraging semantic information from seen classes, but most existing methods assume accurate class labels for training instances. However, in real-world scenarios, noise and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Jinfu Fan , Jiangnan Li , Xiaowen Yan , Xiaohui Zhong , Wenpeng Lu , Linqing Huang

We present LSeg, a novel model for language-driven semantic image segmentation. LSeg uses a text encoder to compute embeddings of descriptive input labels (e.g., "grass" or "building") together with a transformer-based image encoder that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Boyi Li , Kilian Q. Weinberger , Serge Belongie , Vladlen Koltun , René Ranftl

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Pretrained language models have improved zero-shot text classification by allowing the transfer of semantic knowledge from the training data in order to classify among specific label sets in downstream tasks. We propose a simple way to…

Computation and Language · Computer Science 2023-10-24 Lingyu Gao , Debanjan Ghosh , Kevin Gimpel

From the beginning of zero-shot learning research, visual attributes have been shown to play an important role. In order to better transfer attribute-based knowledge from known to unknown classes, we argue that an image representation with…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Wenjia Xu , Yongqin Xian , Jiuniu Wang , Bernt Schiele , Zeynep Akata