English
Related papers

Related papers: CAARMA: Class Augmentation with Adversarial Mixup …

200 papers

Advances in neural speech synthesis have brought us technology that is not only close to human naturalness, but is also capable of instant voice cloning with little data, and is highly accessible with pre-trained models available.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-03 Lauri Juvela , Xin Wang

Obtaining high-quality speaker embeddings in multi-speaker conditions is crucial for many applications. A recently proposed guided speaker embedding framework, which utilizes speech activities of target and non-target speakers as clues,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Shota Horiguchi , Takanori Ashihara , Marc Delcroix , Atsushi Ando , Naohiro Tawara

We address the problem of speech enhancement generalisation to unseen environments by performing two manipulations. First, we embed an additional recording from the environment alone, and use this embedding to alter activations in the main…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Gil Keren , Jing Han , Björn Schuller

In realistic environments, speech is usually interfered by various noise and reverberation, which dramatically degrades the performance of automatic speech recognition (ASR) systems. To alleviate this issue, the commonest way is to use a…

Sound · Computer Science 2018-05-04 Bin Liu , Shuai Nie , Yaping Zhang , Dengfeng Ke , Shan Liang , Wenju Liu1

The task of making speaker verification systems robust to adverse scenarios remain a challenging and an active area of research. We developed an unsupervised feature enhancement approach in log-filter bank domain with the end goal of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Phani Sankar Nidadavolu , Saurabh Kataria , Jesús Villalba , Paola García-Perera , Najim Dehak

Deep learning has brought impressive progress in the study of both automatic speaker verification (ASV) and spoofing countermeasures (CM). Although solutions are mutually dependent, they have typically evolved as standalone sub-systems…

Speaker verification, as a biometric authentication mechanism, has been widely used due to the pervasiveness of voice control on smart devices. However, the task of "in-the-wild" speaker verification is still challenging, considering the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Jianwei Tai , Xiaoqi Jia , Qingjia Huang , Weijuan Zhang , Haichao Du , Shengzhi Zhang

Training speaker-discriminative and robust speaker verification systems without speaker labels is still challenging and worthwhile to explore. In this study, we propose an effective self-supervised learning framework and a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-03 Mufan Sang , Haoqi Li , Fang Liu , Andrew O. Arnold , Li Wan

In the field of speaker verification, session or channel variability poses a significant challenge. While many contemporary methods aim to disentangle session information from speaker embeddings, we introduce a novel approach using an…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-27 Hee-Soo Heo , KiHyun Nam , Bong-Jin Lee , Youngki Kwon , Minjae Lee , You Jin Kim , Joon Son Chung

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings. By…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-16 Weiqing Wang , Ming Li

The rapid spread of media content synthesis technology and the potentially damaging impact of audio and video deepfakes on people's lives have raised the need to implement systems able to detect these forgeries automatically. In this work…

Sound · Computer Science 2022-11-01 Luigi Attorresi , Davide Salvi , Clara Borrelli , Paolo Bestagini , Stefano Tubaro

Most state-of-the-art self-supervised speaker verification systems rely on a contrastive-based objective function to learn speaker representations from unlabeled speech data. We explore different ways to improve the performance of these…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Theo Lepage , Reda Dehak

Feature-mapping with deep neural networks is commonly used for single-channel speech enhancement, in which a feature-mapping network directly transforms the noisy features to the corresponding enhanced ones and is trained to minimize the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-01 Zhong Meng , Jinyu Li , Yifan Gong , Biing-Hwang , Juang

The goal of this paper is to adapt speaker embeddings for solving the problem of speaker diarisation. The quality of speaker embeddings is paramount to the performance of speaker diarisation systems. Despite this, prior works in the field…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-08 Youngki Kwon , Jee-weon Jung , Hee-Soo Heo , You Jin Kim , Bong-Jin Lee , Joon Son Chung

Synthetic data augmentation helps language models learn new knowledge in data-constrained domains. However, naively scaling existing synthetic data methods by training on more synthetic tokens or using stronger generators yields diminishing…

Machine Learning · Computer Science 2026-03-31 Seungju Han , Konwoo Kim , Chanwoo Park , Benjamin Newman , Suhas Kotha , Jaehun Jung , James Zou , Yejin Choi

Modern speaker recognition system relies on abundant and balanced datasets for classification training. However, diverse defective datasets, such as partially-labelled, small-scale, and imbalanced datasets, are common in real-world…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Ruijie Tao , Zhan Shi , Yidi Jiang , Tianchi Liu , Haizhou Li

The goal of this contribution is to use a parametric speech synthesis system for reducing background noise and other interferences from recorded speech signals. In a first step, Hidden Markov Models of the synthesis system are trained. Two…

Sound · Computer Science 2017-07-06 Daniel Dzibela , Armin Sehr

This paper presents a novel study of parameter-free attentive scoring for speaker verification. Parameter-free scoring provides the flexibility of comparing speaker representations without the need of an accompanying parametric scoring…

Sound · Computer Science 2023-03-07 Jason Pelecanos , Quan Wang , Yiling Huang , Ignacio Lopez Moreno

Most speaker verification tasks are studied as an open-set evaluation scenario considering the real-world condition. Thus, the generalization power to unseen speakers is of paramount important to the performance of the speaker verification…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-15 Ju-ho Kim , Hye-jin Shim , Jee-weon Jung , Ha-Jin Yu

We introduce a monaural neural speaker embeddings extractor that computes an embedding for each speaker present in a speech mixture. To allow for supervised training, a teacher-student approach is employed: the teacher computes the target…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Tobias Cord-Landwehr , Christoph Boeddeker , Cătălin Zorilă , Rama Doddipatla , Reinhold Haeb-Umbach