English
Related papers

Related papers: Zero-shot Learning and Knowledge Transfer in Music…

200 papers

We propose a knowledge-driven, model-based approach to segmenting audio into single-category and mixed-category chunks with applications to source separation. "Knowledge" here denotes information associated with the data, such as music…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-26 Chun-wei Ho , Sabato Marco Siniscalchi , Kai Li , Chin-Hui Lee

Zero-shot cross-domain slot filling alleviates the data dependence in the case of data scarcity in the target domain, which has aroused extensive research. However, as most of the existing methods do not achieve effective knowledge transfer…

Computation and Language · Computer Science 2021-10-08 Liwen Wang , Xuefeng Li , Jiachi Liu , Keqing He , Yuanmeng Yan , Weiran Xu

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

One of the hallmarks of human intelligence is the ability to compose learned knowledge into novel concepts which can be recognized without a single training example. In contrast, current state-of-the-art methods require hundreds of training…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Senthil Purushwalkam , Maximilian Nickel , Abhinav Gupta , Marc'Aurelio Ranzato

Music tagging is a task to predict the tags of music recordings. However, previous music tagging research primarily focuses on close-set music tagging tasks which can not be generalized to new tags. In this work, we propose a zero-shot…

Sound · Computer Science 2023-10-17 Xingjian Du , Zhesong Yu , Jiaju Lin , Bilei Zhu , Qiuqiang Kong

Despite significant progress in object categorization, in recent years, a number of important challenges remain; mainly, the ability to learn from limited labeled data and to recognize object classes within large, potentially open, set of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Yanwei Fu , Xiaomei Wang , Hanze Dong , Yu-Gang Jiang , Meng Wang , Xiangyang Xue , Leonid Sigal

Parts represent a basic unit of geometric and semantic similarity across different objects. We argue that part knowledge should be composable beyond the observed object classes. Towards this, we present 3D Compositional Zero-shot Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Muhammad Ferjad Naeem , Evin Pınar Örnek , Yongqin Xian , Luc Van Gool , Federico Tombari

Standard supervised learning setting assumes that training data and test data come from the same distribution (domain). Domain generalization (DG) methods try to learn a model that when trained on data from multiple domains, would…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Udit Maniyar , Joseph K J , Aniket Anand Deshmukh , Urun Dogan , Vineeth N Balasubramanian

The purpose of generative Zero-shot learning (ZSL) is to learning from seen classes, transfer the learned knowledge, and create samples of unseen classes from the description of these unseen categories. To achieve better ZSL accuracies,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Shayan Kousha , Marcus A. Brubaker

Zero-shot learning (ZSL) is concerned with the recognition of previously unseen classes. It relies on additional semantic knowledge for which a mapping can be learned with training examples of seen classes. While classical ZSL considers the…

Machine Learning · Computer Science 2019-01-16 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Zero-shot point cloud segmentation aims to make deep models capable of recognizing novel objects in point cloud that are unseen in the training phase. Recent trends favor the pipeline which transfers knowledge from seen classes with labels…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhang Lu , Qi Jiang , Runnan Chen , Yuenan Hou , Xinge Zhu , Yuexin Ma

Semantic Image Interpretation is the task of extracting a structured semantic description from images. This requires the detection of visual relationships: triples (subject,relation,object) describing a semantic relation between a subject…

Machine Learning · Computer Science 2019-10-02 Ivan Donadello , Luciano Serafini

State-of-the-art audio classification often employs a zero-shot approach, which involves comparing audio embeddings with embeddings from text describing the respective audio class. These embeddings are usually generated by neural networks…

Sound · Computer Science 2025-07-29 James Taylor , Wolfgang Mack

Zero-shot learning (ZSL) aims at understanding unseen categories with no training examples from class-level descriptions. To improve the discriminative power of zero-shot learning, we model the visual learning process of unseen categories…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Mohamed Elhoseiny , Mohamed Elfeki

In this work, we present a novel method for music emotion recognition that leverages Large Language Model (LLM) embeddings for label alignment across multiple datasets and zero-shot prediction on novel categories. First, we compute LLM…

Sound · Computer Science 2024-10-18 Renhang Liu , Abhinaba Roy , Dorien Herremans

Generalized zero-shot learning recognizes inputs from both seen and unseen classes. Yet, existing methods tend to be biased towards the classes seen during training. In this paper, we strive to mitigate this bias. We propose a bias-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 William Thong , Cees G. M. Snoek

Generalized zero-shot learning (GZSL) aims to train a model for classifying data samples under the condition that some output classes are unknown during supervised learning. To address this challenging task, GZSL leverages semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Farhad Pourpanah , Moloud Abdar , Yuxuan Luo , Xinlei Zhou , Ran Wang , Chee Peng Lim , Xi-Zhao Wang , Q. M. Jonathan Wu

Zero-shot learning (ZSL) aims to recognize objects from novel unseen classes without any training data. Recently, structure-transfer based methods are proposed to implement ZSL by transferring structural knowledge from the semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Bo Zhao , Xinwei Sun , Yuan Yao , Yizhou Wang

Deep representation learning offers a powerful paradigm for mapping input data onto an organized embedding space and is useful for many music information retrieval tasks. Two central methods for representation learning include deep metric…

Sound · Computer Science 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

Vision-Language Models (VLMs) have demonstrated impressive performance on zero-shot classification, i.e. classification when provided merely with a list of class names. In this paper, we tackle the case of zero-shot classification in the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Vladan Stojnić , Yannis Kalantidis , Giorgos Tolias