English
Related papers

Related papers: Multi-label Zero-Shot Audio Classification with Te…

200 papers

Labelled data are limited and self-supervised learning is one of the most important approaches for reducing labelling requirements. While it has been extensively explored in the image domain, it has so far not received the same amount of…

Sound · Computer Science 2025-05-16 Jingyong Liang , Bernd Meyer , Isaac Ning Lee , Thanh-Toan Do

We tackle the task of environmental event classification by drawing inspiration from the transformer neural network architecture used in machine translation. We modify this attention-based feedforward structure in such a way that allows the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-06 Wim Boes , Hugo Van hamme

In this work, we propose a method for domain-incremental learning for audio classification from a sequence of datasets recorded in different acoustic conditions. Fine-tuning a model on a sequence of evolving domains or datasets leads to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-24 Manjunath Mulimani , Annamaria Mesaros

Zero-shot learning (ZSL) aims to recognize unseen classes without visual instances. However, existing methods usually assume clean labels, overlooking real-world label noise and ambiguity, which degrades performance. To bridge this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiangnan Li , Linqing Huang , Xiaowen Yan , Min Gan , Wenpeng Lu , Jinfu Fan

Human action recognition refers to automatic recognizing human actions from a video clip. In reality, there often exist multiple human actions in a video stream. Such a video stream is often weakly-annotated with a set of relevant human…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Qian Wang , Ke Chen

We propose a novel Generalized Zero-Shot learning (GZSL) method that is agnostic to both unseen images and unseen semantic vectors during training. Prior works in this context propose to map high-dimensional visual features to the semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

Supervised learning requires a sufficient training dataset which includes all label. However, there are cases that some class is not in the training data. Zero-Shot Learning (ZSL) is the task of predicting class that is not in the training…

Machine Learning · Computer Science 2020-07-02 Toshitaka Hayashi , Hamido Fujita

Aspect category detection (ACD) in sentiment analysis aims to identify the aspect categories mentioned in a sentence. In this paper, we formulate ACD in the few-shot learning scenario. However, existing few-shot learning approaches mainly…

Computation and Language · Computer Science 2021-06-01 Mengting Hu , Shiwan Zhao , Honglei Guo , Chao Xue , Hang Gao , Tiegang Gao , Renhong Cheng , Zhong Su

Multi-instrument recognition is the task of predicting the presence or absence of different instruments within an audio clip. A considerable challenge in applying deep learning to multi-instrument recognition is the scarcity of labeled…

Sound · Computer Science 2020-01-27 Amir Kenarsari Anhari

Although music is typically multi-label, many works have studied hierarchical music tagging with simplified settings such as single-label data. Moreover, there lacks a framework to describe various joint training methods under the…

Multilingual speech emotion recognition aims to estimate a speaker's emotional state using a contactless method across different languages. However, variability in voice characteristics and linguistic diversity poses significant challenges…

Computation and Language · Computer Science 2025-03-31 Heqing Zou , Fengmao Lv , Desheng Zheng , Eng Siong Chng , Deepu Rajan

Audio-language models have recently demonstrated strong zero-shot capabilities by leveraging natural-language supervision to classify audio events without labeled training data. Yet, their performance is highly sensitive to the wording of…

In the realm of digital music, using tags to efficiently organize and retrieve music from extensive databases is crucial for music catalog owners. Human tagging by experts is labor-intensive but mostly accurate, whereas automatic tagging…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 T. Aleksandra Ma , Alexander Lerch

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

Heart sound diagnosis and classification play an essential role in detecting cardiovascular disorders, especially when the remote diagnosis becomes standard clinical practice. Most of the current work is designed for single category based…

Sound · Computer Science 2022-04-25 Li Guo , Steven Davenport , Yonghong Peng

How can we reuse existing knowledge, in the form of available datasets, when solving a new and apparently unrelated target task from a set of unlabeled data? In this work we make a first contribution to answer this question in the context…

Computer Vision and Pattern Recognition · Computer Science 2015-10-07 Efstratios Gavves , Thomas Mensink , Tatiana Tommasi , Cees G. M. Snoek , Tinne Tuytelaars

In realistic speech enhancement settings for end-user devices, we often encounter only a few speakers and noise types that tend to reoccur in the specific acoustic environment. We propose a novel personalized speech enhancement method to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-11 Sunwoo Kim , Minje Kim

Few-shot text classification aims to recognize unseen classes with limited labeled text samples. Existing approaches focus on boosting meta-learners by developing complex algorithms in the training stage. However, the labeled samples are…

Machine Learning · Computer Science 2026-03-04 Yunlong Gao , Xinyue Liu , Yingbo Wang , Linlin Zong , Bo Xu

Video understanding has long suffered from reliance on large labeled datasets, motivating research into zero-shot learning. Recent progress in language modeling presents opportunities to advance zero-shot video analysis, but constructing an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Shreyank N Gowda , Laura Sevilla-Lara

Music two-tower multimodal systems integrate audio and text modalities into a joint audio-text space, enabling direct comparison between songs and their corresponding labels. These systems enable new approaches for classification and…

Sound · Computer Science 2024-07-26 Yannis Vasilakis , Rachel Bittner , Johan Pauwels