English
Related papers

Related papers: Speaker Characterization by means of Attention Poo…

200 papers

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-14 Weiqing Wang , Qingjian Lin , Ming Li

Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-01 Jingyu Li , Yusheng Tian , Tan Lee

In this paper, we address the problem of speaker recognition in challenging acoustic conditions using a novel method to extract robust speaker-discriminative speech representations. We adopt a recently proposed unsupervised adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Raghuveer Peri , Monisankha Pal , Arindam Jati , Krishna Somandepalli , Shrikanth Narayanan

When recognizing emotions from speech, we encounter two common problems: how to optimally capture emotion-relevant information from the speech signal and how to best quantify or categorize the noisy subjective emotion labels.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-04 Sofoklis Kakouros , Themos Stafylakis , Ladislav Mosner , Lukas Burget

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

Due to the successful application of deep learning, audio spoofing detection has made significant progress. Spoofed audio with speech synthesis or voice conversion can be well detected by many countermeasures. However, an automatic speaker…

Sound · Computer Science 2024-01-12 Lian Huang , Chi-Man Pun

This paper explores two techniques to improve the performance of text-dependent speaker verification systems based on deep neural networks. Firstly, we propose a general alignment mechanism to keep the temporal structure of each phrase and…

Sound · Computer Science 2019-05-01 Victoria Mingote , Antonio Miguel , Alfonso Ortega , Eduardo Lleida

In this work, we study the hypothesis that speaker identity embeddings extracted from speech samples may be used for detection and classification of emotion. In particular, we show that emotions can be effectively identified by learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-16 Morgan Sandler , Arun Ross

Neuro-steered speaker extraction aims to extract the listener's brain-attended speech signal from a multi-talker speech signal, in which the attention is derived from the cortical activity. This activity is usually recorded using…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-13 Zexu Pan , Gordon Wichern , Francois G. Germain , Sameer Khurana , Jonathan Le Roux

Informed speaker extraction aims to extract a target speech signal from a mixture of sources given prior knowledge about the desired speaker. Recent deep learning-based methods leverage a speaker discriminative model that maps a reference…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-17 Mohamed Elminshawi , Wolfgang Mack , Emanuël A. P. Habets

Probabilistic linear discriminant analysis (PLDA) or cosine similarity have been widely used in traditional speaker verification systems as back-end techniques to measure pairwise similarities. To make better use of multiple enrollment…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Chang Zeng , Xin Wang , Erica Cooper , Xiaoxiao Miao , Junichi Yamagishi

Speaker recognition deals with recognizing speakers by their speech. Most speaker recognition systems are built upon two stages, the first stage extracts low dimensional correlation embeddings from speech, and the second performs the…

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. This paper proposes a hierarchical network with transformer encoders and memory mechanism to address this problem. The proposed…

Sound · Computer Science 2020-11-02 Yanpei Shi , Mingjie Chen , Qiang Huang , Thomas Hain

In this paper, we propose a Convolutional Neural Network (CNN) based speaker recognition model for extracting robust speaker embeddings. The embedding can be extracted efficiently with linear activation in the embedding layer. To understand…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-13 Suwon Shon , Hao Tang , James Glass

In speech technologies, speaker's voice representation is used in many applications such as speech recognition, voice conversion, speech synthesis and, obviously, user authentication. Modern vocal representations of the speaker are based on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Paul-Gauthier Noé , Mohammad Mohammadamini , Driss Matrouf , Titouan Parcollet , Andreas Nautsch , Jean-François Bonastre

Target speaker extraction is to extract the target speaker, specified by enrollment utterance, in an environment with other competing speakers. Therefore, the task needs to solve two problems, speaker identification and separation, at the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Pengjie Shen , Shulin He , Xueliang Zhang

End-to-end speaker diarization for an unknown number of speakers is addressed in this paper. Recently proposed end-to-end speaker diarization outperformed conventional clustering-based speaker diarization, but it has one drawback: it is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-06 Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Yawen Xue , Kenji Nagamatsu

State-of-the-art speaker verification systems are inherently dependent on some kind of human supervision as they are trained on massive amounts of labeled data. However, manually annotating utterances is slow, expensive and not scalable to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Théo Lepage , Réda Dehak

Enhancing explainability in speech self-supervised learning (SSL) is important for developing reliable SSL-based speech processing systems. This study probes how speech SSL models encode speaker-specific information via a large-scale…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-06 Aemon Yat Fei Chiu , Kei Ching Fung , Roger Tsz Yeung Li , Jingyu Li , Tan Lee

The objective of this work is effective speaker diarisation using multi-scale speaker embeddings. Typically, there is a trade-off between the ability to recognise short speaker segments and the discriminative power of the embedding,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-11 Youngki Kwon , Hee-Soo Heo , Jee-weon Jung , You Jin Kim , Bong-Jin Lee , Joon Son Chung