English
Related papers

Related papers: Improving on-device speaker verification using fed…

200 papers

Smart devices serviced by large-scale AI models necessitates user data transfer to the cloud for inference. For speech applications, this means transferring private user information, e.g., speaker identity. Our paper proposes a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-26 Md Asif Jalal , Pablo Peso Parada , Jisi Zhang , Karthikeyan Saravanan , Mete Ozay , Myoungji Han , Jung In Lee , Seokyeong Jung

In speech technologies, speaker's voice representation is used in many applications such as speech recognition, voice conversion, speech synthesis and, obviously, user authentication. Modern vocal representations of the speaker are based on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Paul-Gauthier Noé , Mohammad Mohammadamini , Driss Matrouf , Titouan Parcollet , Andreas Nautsch , Jean-François Bonastre

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

This study investigates the explainability of embedding representations, specifically those used in modern audio spoofing detection systems based on deep neural networks, known as spoof embeddings. Building on established work in speaker…

Sound · Computer Science 2024-12-25 Xuechen Liu , Junichi Yamagishi , Md Sahidullah , Tomi kinnunen

Speaker recognition is a task of identifying persons from their voices. Recently, deep learning has dramatically revolutionized speaker recognition. However, there is lack of comprehensive reviews on the exciting progress. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Zhongxin Bai , Xiao-Lei Zhang

Current speaker anonymization methods, especially with self-supervised learning (SSL) models, require massive computational resources when hiding speaker identity. This paper proposes an effective and parameter-efficient speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-20 Xiaojiao Chen , Sheng Li , Jiyi Li , Hao Huang , Yang Cao , Liang He

Real-world data is usually segmented by attributes and distributed across different parties. Federated learning empowers collaborative training without exposing local data or models. As we demonstrate through designed attacks, even with a…

Machine Learning · Computer Science 2021-04-30 Shuang Zhang , Liyao Xiang , Xi Yu , Pengzhi Chu , Yingqi Chen , Chen Cen , Li Wang

With the popularity of virtual assistants (e.g., Siri, Alexa), the use of speech recognition is now becoming more and more widespread.However, speech signals contain a lot of sensitive information, such as the speaker's identity, which…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-21 Pierre Champion , Denis Jouvet , Anthony Larcher

Over the last few years, deep learning has grown in popularity for speaker verification, identification, and diarization. Inarguably, a significant part of this success is due to the demonstrated effectiveness of their speaker…

Sound · Computer Science 2022-10-07 Yehoshua Dissen , Felix Kreuk , Joseph Keshet

Automatic Speech Understanding (ASU) leverages the power of deep learning models for accurate interpretation of human speech, leading to a wide range of speech applications that enrich the human experience. However, training a robust ASU…

Sound · Computer Science 2023-06-14 Tiantian Feng , Digbalay Bose , Xuan Shi , Shrikanth Narayanan

Faced with the threat of identity leakage during voice data publishing, users are engaged in a privacy-utility dilemma when enjoying convenient voice services. Existing studies employ direct modification or text-based re-synthesis to…

Sound · Computer Science 2022-11-11 Meng Chen , Li Lu , Jiadi Yu , Yingying Chen , Zhongjie Ba , Feng Lin , Kui Ren

Speaker embeddings are ubiquitous, with applications ranging from speaker recognition and diarization to speech synthesis and voice anonymisation. The amount of information held by these embeddings lends them versatility, but also raises…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-12 Francisco Teixeira , Alberto Abad , Bhiksha Raj , Isabel Trancoso

In self-supervised learning for speaker recognition, pseudo labels are useful as the supervision signals. It is a known fact that a speaker recognition model doesn't always benefit from pseudo labels due to their unreliability. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-15 Ruijie Tao , Kong Aik Lee , Rohan Kumar Das , Ville Hautamäki , Haizhou Li

Speaker identification systems in a real-world scenario are tasked to identify a speaker amongst a set of enrolled speakers given just a few samples for each enrolled speaker. This paper demonstrates the effectiveness of meta-learning and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Ashutosh Chaubey , Sparsh Sinha , Susmita Ghose

Speech Emotion Recognition (SER) application is frequently associated with privacy concerns as it often acquires and transmits speech data at the client-side to remote cloud platforms for further processing. These speech data can reveal not…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-18 Tiantian Feng , Shrikanth Narayanan

Speech signals contain a lot of sensitive information, such as the speaker's identity, which raises privacy concerns when speech data get collected. Speaker anonymization aims to transform a speech signal to remove the source speaker's…

Sound · Computer Science 2023-01-16 Pierre Champion , Denis Jouvet , Anthony Larcher

Speaker diarization(SD) is a classic task in speech processing and is crucial in multi-party scenarios such as meetings and conversations. Current mainstream speaker diarization approaches consider acoustic information only, which result in…

Computation and Language · Computer Science 2023-05-23 Luyao Cheng , Siqi Zheng , Zhang Qinglin , Hui Wang , Yafeng Chen , Qian Chen

Voice conversion for speaker anonymization is an emerging concept for privacy protection. In a deep learning setting, this is achieved by extracting multiple features from speech, altering the speaker identity, and waveform synthesis.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-30 Ünal Ege Gaznepoglu , Nils Peters

Speaker identification typically involves three stages. First, a front-end speaker embedding model is trained to embed utterance and speaker profiles. Second, a scoring function is applied between a runtime utterance and each speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Zhenning Tan , Yuguang Yang , Eunjung Han , Andreas Stolcke

In this paper, we present a novel training method for speaker change detection models. Speaker change detection is often viewed as a binary sequence labelling problem. The main challenges with this approach are the vagueness of annotated…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-17 Joonas Kalda , Tanel Alumäe