English
Related papers

Related papers: Improved Zero-Shot Audio Tagging & Classification …

200 papers

Recent advances in audio-text cross-modal contrastive learning have shown its potential towards zero-shot learning. One possibility for this is by projecting item embeddings from pre-trained backbone neural networks into a cross-modal space…

Sound · Computer Science 2025-09-29 Tiago Tavares , Fabio Ayres , Zhepei Wang , Paris Smaragdis

In this paper, we show that a simple self-supervised pre-trained audio model can achieve comparable inference efficiency to more complicated pre-trained models with speech transformer encoders. These speech transformers rely on mixing…

Sound · Computer Science 2024-02-09 Sungho Jeon , Ching-Feng Yeh , Hakan Inan , Wei-Ning Hsu , Rashi Rungta , Yashar Mehdad , Daniel Bikel

Given the semantic descriptions of classes, Zero-Shot Learning (ZSL) aims to recognize unseen classes without labeled training data by exploiting semantic information, which contains knowledge between seen and unseen classes. Existing ZSL…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Vivek Chalumuri , Bac Nguyen

Zero-shot learning (ZSL) aims to classify objects that are not observed or seen during training. It relies on class semantic description to transfer knowledge from the seen classes to the unseen classes. Existing methods of obtaining class…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Fahimul Hoque Shubho , Townim Faisal Chowdhury , Ali Cheraghian , Morteza Saberi , Nabeel Mohammed , Shafin Rahman

Recent research on speech enhancement (SE) has seen the emergence of deep-learning-based methods. It is still a challenging task to determine the effective ways to increase the generalizability of SE under diverse test conditions. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-01 Ryandhimas E. Zezario , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

Zero-Shot Learning (ZSL) promises to scale visual recognition by bypassing the conventional model training requirement of annotated examples for every category. This is achieved by establishing a mapping connecting low-level features and a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xun Xu , Timothy M. Hospedales , Shaogang Gong

In the context of environmental sound classification, the adaptability of systems is key: which sound classes are interesting depends on the context and the user's needs. Recent advances in text-to-audio retrieval allow for zero-shot audio…

Sound · Computer Science 2023-08-21 Saksham Singh Kushwaha , Magdalena Fuentes

Zero-Shot Learning (ZSL) aims to recognise unseen object classes, which are not observed during the training phase. The existing body of works on ZSL mostly relies on pretrained visual features and lacks the explicit attribute localisation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Faisal Alamri , Anjan Dutta

Zero-shot learning (ZSL) has been shown to be a promising approach to generalizing a model to categories unseen during training by leveraging class attributes, but challenges still remain. Recently, methods using generative models to combat…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Vinay Kumar Verma , Kevin Liang , Nikhil Mehta , Lawrence Carin

This paper presents a novel zero-shot learning approach towards personalized speech enhancement through the use of a sparsely active ensemble model. Optimizing speech denoising systems towards a particular test-time speaker can improve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-11 Aswin Sivaraman , Minje Kim

The deployment of machine listening algorithms in real-life applications is often impeded by a domain shift caused for instance by different microphone characteristics. In this paper, we propose a novel domain adaptation strategy based on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-27 Jakob Abeßer , Meinard Müller

Recent advances in large pretrained language models have increased attention to zero-shot text classification. In particular, models finetuned on natural language inference datasets have been widely adopted as zero-shot classifiers due to…

Computation and Language · Computer Science 2022-11-01 Ariel Gera , Alon Halfon , Eyal Shnarch , Yotam Perlitz , Liat Ein-Dor , Noam Slonim

Human listeners exhibit the remarkable ability to segregate a desired sound from complex acoustic scenes through selective auditory attention, motivating the study of Targeted Sound Detection (TSD). The task requires detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Shubham Gupta , Adarsh Arigala , B. R. Dilleswari , Sri Rama Murty Kodukula

Sound event detection is to infer the event by understanding the surrounding environmental sounds. Due to the scarcity of rare sound events, it becomes challenging for the well-trained detectors which have learned too much prior knowledge.…

Sound · Computer Science 2022-05-27 Chendong Zhao , Jianzong Wang , Leilai Li , Xiaoyang Qu , Jing Xiao

The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Pooyan Safari , Miquel India , Javier Hernando

Zero-shot learning (ZSL) tackles the novel class recognition problem by transferring semantic knowledge from seen classes to unseen ones. Existing attention-based models have struggled to learn inferior region features in a single image by…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Shiming Chen , Ziming Hong , Wenjin Hou , Guo-Sen Xie , Yibing Song , Jian Zhao , Xinge You , Shuicheng Yan , Ling Shao

Existing zero-shot learning (ZSL) methods usually learn a projection function between a feature space and a semantic embedding space(text or attribute space) in the training seen classes or testing unseen classes. However, the projection…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Guangfeng Lin , Caixia Fan , Wanjun Chen , Yajun Chen , Fan Zhao

Robust strategies for Alzheimer's disease (AD) detection are important, given the high prevalence of AD. In this paper, we study the performance and generalizability of three approaches for AD detection from speech on the recent ADReSSo…

Computation and Language · Computer Science 2022-09-16 Aparna Balagopalan , Jekaterina Novikova

Most of the existing algorithms for zero-shot classification problems typically rely on the attribute-based semantic relations among categories to realize the classification of novel categories without observing any of their instances.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yu-Hsuan Li , Tzu-Yin Chao , Ching-Chun Huang , Pin-Yu Chen , Wei-Chen Chiu

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu