English
Related papers

Related papers: Learning Representations for New Sound Classes Wit…

200 papers

Federated Learning is a distributed machine learning paradigm dealing with decentralized and personal datasets. Since data reside on devices like smartphones and virtual assistants, labeling is entrusted to the clients, or labels are…

Machine Learning · Computer Science 2022-02-28 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi

In this paper, we propose a method for class-incremental learning of potentially overlapping sounds for solving a sequence of multi-label audio classification tasks. We design an incremental learner that learns new classes independently of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Manjunath Mulimani , Annamaria Mesaros

Even in the absence of any explicit semantic annotation, vast collections of audio recordings provide valuable information for learning the categorical structure of sounds. We consider several class-agnostic semantic constraints that apply…

A continual learning agent should be able to build on top of existing knowledge to learn on new data quickly while minimizing forgetting. Current intelligent systems based on neural network function approximators arguably do the…

Machine Learning · Computer Science 2019-11-01 Khurram Javed , Martha White

Sound event detection systems are widely used in various applications such as surveillance and environmental monitoring where data is automatically collected, processed, and sent to a cloud for sound recognition. However, this process may…

Sound · Computer Science 2024-01-04 Shayan Gharib , Minh Tran , Diep Luong , Konstantinos Drossos , Tuomas Virtanen

Despite recent advances, Automatic Speech Recognition (ASR) systems are still far from perfect. Typical errors include acronyms, named entities, and domain-specific special words for which little or no labeled data is available. To address…

Computation and Language · Computer Science 2025-01-30 Christian Huber , Alexander Waibel

Existing privacy-preserving speech representation learning methods target a single application domain. In this paper, we present a novel framework to anonymize utterance-level speech embeddings generated by pre-trained encoders and show its…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-27 Minh Tran , Mohammad Soleymani

Learning representations of data, and in particular learning features for a subsequent prediction task, has been a fruitful area of research delivering impressive empirical results in recent years. However, relatively little is understood…

Machine Learning · Computer Science 2016-11-11 Daniel McNamara , Cheng Soon Ong , Robert C. Williamson

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Current contrastive learning frameworks focus on leveraging a single supervisory signal to learn representations, which limits the efficacy on unseen data and downstream tasks. In this paper, we present a hierarchical multi-label…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Shu Zhang , Ran Xu , Caiming Xiong , Chetan Ramaiah

The representation learning of speech, without textual resources, is an area of significant interest for many low resource speech applications. In this paper, we describe an approach to self-supervised representation learning from raw audio…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-17 Varun Krishna , Tarun Sai , Sriram Ganapathy

This paper proposes a novel framework for audio deepfake detection with two main objectives: i) attaining the highest possible accuracy on available fake data, and ii) effectively performing continuous learning on new fake data in a…

Sound · Computer Science 2024-09-11 Tuan Duy Nguyen Le , Kah Kuan Teh , Huy Dat Tran

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

Cross-lingual self-supervised learning has been a growing research topic in the last few years. However, current works only explored the use of audio signals to create representations. In this work, we study cross-lingual self-supervised…

Computation and Language · Computer Science 2023-03-17 Andreas Zinonos , Alexandros Haliassos , Pingchuan Ma , Stavros Petridis , Maja Pantic

We present an unsupervised representation learning approach using videos without semantic labels. We leverage the temporal coherence as a supervisory signal by formulating representation learning as a sequence sorting task. We take…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Hsin-Ying Lee , Jia-Bin Huang , Maneesh Singh , Ming-Hsuan Yang

Supervised Dictionary Learning has gained much interest in the recent decade and has shown significant performance improvements in image classification. However, in general, supervised learning needs a large number of labelled samples per…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Khanh-Hung Tran , Fred-Maurice Ngole-Mboula , Jean-Luc Starck , Vincent Prost

The lack of labeled data is a major obstacle in many music information retrieval tasks such as melody extraction, where labeling is extremely laborious or costly. Semi-supervised learning (SSL) provides a solution to alleviate the issue by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Sangeun Kum , Jing-Hua Lin , Li Su , Juhan Nam

In self-supervised learning for speaker recognition, pseudo labels are useful as the supervision signals. It is a known fact that a speaker recognition model doesn't always benefit from pseudo labels due to their unreliability. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-15 Ruijie Tao , Kong Aik Lee , Rohan Kumar Das , Ville Hautamäki , Haizhou Li

In the recent years, speech representation learning is constructed primarily as a self-supervised learning (SSL) task, using the raw audio signal alone, while ignoring the side-information that is often available for a given speech…

Sound · Computer Science 2023-09-26 Anjali Raj , Shikhar Bharadwaj , Sriram Ganapathy , Min Ma , Shikhar Vashishth

Word spotting is a popular tool for supporting the first exploration of historic, handwritten document collections. Today, the best performing methods rely on machine learning techniques, which require a high amount of annotated training…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Fabian Wolf , Gernot A. Fink