English
Related papers

Related papers: Multi-label Zero-Shot Audio Classification with Te…

200 papers

This paper introduces a zero-shot sound event classification (ZS-SEC) method to identify sound events that have never occurred in training data. In our previous work, we proposed a ZS-SEC method using sound attribute vectors (SAVs), where a…

Sound · Computer Science 2023-03-21 Yi-Han Lin , Xunquan Chen , Ryoichi Takashima , Tetsuya Takiguchi

Currently available benchmarks for few-shot learning (machine learning with few training examples) are limited in the domains they cover, primarily focusing on image classification. This work aims to alleviate this reliance on image-based…

Sound · Computer Science 2022-04-12 Calum Heggan , Sam Budgett , Timothy Hospedales , Mehrdad Yaghoobi

Acoustic event detection is essential for content analysis and description of multimedia recordings. The majority of current literature on the topic learns the detectors through fully-supervised techniques employing strongly labeled data.…

Sound · Computer Science 2016-07-07 Anurag Kumar , Bhiksha Raj

Zero-Shot Learning (ZSL) aims at classifying unlabeled objects by leveraging auxiliary knowledge, such as semantic representations. A limitation of previous approaches is that only intrinsic properties of objects, e.g. their visual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Eloi Zablocki , Patrick Bordes , Benjamin Piwowarski , Laure Soulier , Patrick Gallinari

Conventional approaches to text classification typically assume the existence of a fixed set of predefined labels to which a given text can be classified. However, in real-world applications, there exists an infinite label space for…

Computation and Language · Computer Science 2023-05-29 Christopher Clarke , Yuzhao Heng , Yiping Kang , Krisztian Flautner , Lingjia Tang , Jason Mars

Zero-shot Learners are models capable of predicting unseen classes. In this work, we propose a Zero-shot Learning approach for text categorization. Our method involves training model on a large corpus of sentences to learn the relationship…

Computation and Language · Computer Science 2017-12-27 Pushpankar Kumar Pushp , Muktabh Mayank Srivastava

In this paper, we propose a novel deep learning architecture for multi-label zero-shot learning (ML-ZSL), which is able to predict multiple unseen class labels for each input instance. Inspired by the way humans utilize semantic knowledge…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Chung-Wei Lee , Wei Fang , Chih-Kuan Yeh , Yu-Chiang Frank Wang

Acoustic word embedding models map variable duration speech segments to fixed dimensional vectors, enabling efficient speech search and discovery. Previous work explored how embeddings can be obtained in zero-resource settings where no…

Computation and Language · Computer Science 2021-06-25 Christiaan Jacobs , Herman Kamper

In the field of music information retrieval, the task of simultaneously identifying the presence or absence of multiple musical instruments in a polyphonic recording remains a hard problem. Previous works have seen some success in improving…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-23 Karn Watcharasupat , Siddharth Gururani , Alexander Lerch

While deep learning has been incredibly successful in modeling tasks with large, carefully curated labeled datasets, its application to problems with limited labeled data remains a challenge. The aim of the present work is to improve the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-29 Tyler Lee , Ting Gong , Suchismita Padhy , Andrew Rouditchenko , Anthony Ndirango

Zero-Shot Learning (ZSL) promises to scale visual recognition by bypassing the conventional model training requirement of annotated examples for every category. This is achieved by establishing a mapping connecting low-level features and a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xun Xu , Timothy M. Hospedales , Shaogang Gong

Few/Zero-shot learning is a big challenge of many classifications tasks, where a classifier is required to recognise instances of classes that have very few or even no training samples. It becomes more difficult in multi-label…

Machine Learning · Computer Science 2020-10-16 Jueqing Lu , Lan Du , Ming Liu , Joanna Dipnall

Recognizing sounds is a key aspect of computational audio scene analysis and machine perception. In this paper, we advocate that sound recognition is inherently a multi-modal audiovisual task in that it is easier to differentiate sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-03 Haytham M. Fayek , Anurag Kumar

While the automatic recognition of musical instruments has seen significant progress, the task is still considered hard for music featuring multiple instruments as opposed to single instrument recordings. Datasets for polyphonic instrument…

Information Retrieval · Computer Science 2019-07-10 Siddharth Gururani , Mohit Sharma , Alexander Lerch

To reveal the importance of temporal precision in ground truth audio event labels, we collected precise (~0.1 sec resolution) "strong" labels for a portion of the AudioSet dataset. We devised a temporally strong evaluation set (including…

Zero-shot learning (ZSL) aims to train a model on seen classes and recognize unseen classes by knowledge transfer through shared auxiliary information. Recent studies reveal that documents from encyclopedias provide helpful auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiangyan Qu , Jing Yu , Jiamin Zhuang , Gaopeng Gou , Gang Xiong , Qi Wu

Audio-visual generalized zero-shot learning is a rapidly advancing domain that seeks to understand the intricate relations between audio and visual cues within videos. The overarching goal is to leverage insights from seen classes to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Shentong Mo , Pedro Morgado

We consider the problem of zero-shot one-class visual classification, extending traditional one-class classification to scenarios where only the label of the target class is available. This method aims to discriminate between positive and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yassir Bendou , Giulia Lioi , Bastien Pasdeloup , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux , Vincent Gripon

Training a neural network model for recognizing multiple labels associated with an image, including identifying unseen labels, is challenging, especially for images that portray numerous semantically diverse labels. As challenging as this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Avi Ben-Cohen , Nadav Zamir , Emanuel Ben Baruch , Itamar Friedman , Lihi Zelnik-Manor

While deep learning, including Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), has significantly advanced classification performance, its typical reliance on extensive annotated datasets presents a major obstacle in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Matheus Vinícius Todescato , Joel Luís Carbonera