English
Related papers

Related papers: Low-Complexity Audio Embedding Extractors

200 papers

Accent classification or AC is a task to predict the accent type of an input utterance, and it can be used as a preliminary step toward accented speech recognition and accent conversion. Existing studies have often achieved such…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-02 Chihiro Watanabe , Hirokazu Kameoka

As a practical alternative of speech separation, target speaker extraction (TSE) aims to extract the speech from the desired speaker using additional speaker cue extracted from the speaker. Its main challenge lies in how to properly extract…

Sound · Computer Science 2023-01-18 Kai Liu , Xucheng Wan , Ziqing Du , Huan Zhou

Many recent works on deep speaker embeddings train their feature extraction networks on large classification tasks, distinguishing between all speakers in a training set. Empirically, this has been shown to produce speaker-discriminative…

Sound · Computer Science 2020-02-04 Chau Luu , Peter Bell , Steve Renals

Music tag words that describe music audio by text have different levels of abstraction. Taking this issue into account, we propose a music classification approach that aggregates multi-level and multi-scale features using pre-trained…

Sound · Computer Science 2017-06-22 Jongpil Lee , Juhan Nam

Being able to control the acoustic events (AEs) to which we want to listen would allow the development of more controllable hearable devices. This paper addresses the AE sound selection (or removal) problems, that we define as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 Tsubasa Ochiai , Marc Delcroix , Yuma Koizumi , Hiroaki Ito , Keisuke Kinoshita , Shoko Araki

This paper proposes a guided speaker embedding extraction system, which extracts speaker embeddings of the target speaker using speech activities of target and interference speakers as clues. Several methods for long-form overlapped…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Shota Horiguchi , Takafumi Moriya , Atsushi Ando , Takanori Ashihara , Hiroshi Sato , Naohiro Tawara , Marc Delcroix

Speaker clustering is the task of identifying the unique speakers in a set of audio recordings (each belonging to exactly one speaker) without knowing who and how many speakers are present in the entire data, which is essential for speaker…

Sound · Computer Science 2025-09-30 Chaohao Lin , Xu Zheng , Kaida Wu , Peihao Xiang , Ou Bai

This paper proposes a network architecture mainly designed for audio tagging, which can also be used for weakly supervised acoustic event detection (AED). The proposed network consists of a modified DenseNet as the feature extractor, and a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Chieh-Chi Kao , Bowen Shi , Ming Sun , Chao Wang

Deep neural networks have been the driving force behind the success in classification tasks, e.g., object and audio recognition. Impressive results and generalization have been achieved by a variety of recently proposed architectures, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Grigorios G Chrysos , Markos Georgopoulos , Jiankang Deng , Jean Kossaifi , Yannis Panagakis , Anima Anandkumar

Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature…

Sound · Computer Science 2021-06-23 Anurag Kumar , Yun Wang , Vamsi Krishna Ithapu , Christian Fuegen

Biomedical Event Extraction (BEE) is a challenging task that involves modeling complex relationships between fine-grained entities in biomedical text. BEE has traditionally been formulated as a classification problem. With recent…

Computation and Language · Computer Science 2025-02-24 Haohan Yuan , Siu Cheung Hui , Haopeng Zhang

We propose an explainable probabilistic framework for characterizing spoofed speech by decomposing it into probabilistic attribute embeddings. Unlike raw high-dimensional countermeasure embeddings, which lack interpretability, the proposed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Jagabandhu Mishra , Manasi Chhibber , Hye-jin Shim , Tomi H. Kinnunen

Recent advancements in pattern recognition and signal processing concern the automatic learning of data representations from labeled training samples. Typical approaches are based on deep learning and convolutional neural networks, which…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Nicola Strisciuglio

The goal of Event Argument Extraction (EAE) is to find the role of each entity mention for a given event trigger word. It has been shown in the previous works that the syntactic structures of the sentences are helpful for the deep learning…

Computation and Language · Computer Science 2020-10-27 Amir Pouran Ben Veyseh , Tuan Ngo Nguyen , Thien Huu Nguyen

We present a novel method for extracting neural embeddings that model the background acoustics of a speech signal. The extracted embeddings are used to estimate specific parameters related to the background acoustic properties of the signal…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Sri Harsha Dumpala , Dushyant Sharma , Chandramouli Shama Sastri , Stanislav Kruchinin , James Fosburgh , Patrick A. Naylor

Adapters are light-weight modules that allow parameter-efficient fine-tuning of pretrained models. Specialized language and task adapters have recently been proposed to facilitate cross-lingual transfer of multilingual pretrained models…

Computation and Language · Computer Science 2021-09-13 Xinyi Wang , Yulia Tsvetkov , Sebastian Ruder , Graham Neubig

Analyzing large-scale text corpora is a core challenge in machine learning, crucial for tasks like identifying undesirable model behaviors or biases in training data. Current methods often rely on costly LLM-based techniques (e.g.…

Artificial Intelligence · Computer Science 2025-12-12 Nick Jiang , Xiaoqing Sun , Lisa Dunlap , Lewis Smith , Neel Nanda

Recent advancements in deep generative modeling make it possible to learn prior distributions from complex data that subsequently can be used for Bayesian inference. However, we find that distributions learned by deep generative models for…

Machine Learning · Computer Science 2020-11-04 Maurice Frank , Maximilian Ilse

Subsampling of received wireless signals is important for relaxing hardware requirements as well as the computational cost of signal processing algorithms that rely on the output samples. We propose a subsampling technique to facilitate the…

Signal Processing · Electrical Eng. & Systems 2020-05-12 Sharan Ramjee , Shengtai Ju , Diyu Yang , Xiaoyu Liu , Aly El Gamal , Yonina C. Eldar

We propose the use of Non-Negative Autoencoders (NAEs) for sound deconstruction and user-guided manipulation of sounds for creative purposes. NAEs offer a versatile and scalable extension of traditional Non-Negative Matrix Factorization…

Sound · Computer Science 2025-10-13 Juan José Burred , Carmine-Emanuele Cella