English
Related papers

Related papers: Towards End-to-End Private Automatic Speaker Recog…

200 papers

The speaker extraction technique seeks to single out the voice of a target speaker from the interfering voices in a speech mixture. Typically an auxiliary reference of the target speaker is used to form voluntary attention. Either a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-10 Zexu Pan , Wupeng Wang , Marvin Borsdorf , Haizhou Li

End-to-end models are fast replacing the conventional hybrid models in automatic speech recognition. Transformer, a sequence-to-sequence model, based on self-attention popularly used in machine translation tasks, has given promising results…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-19 Vishwas M. Shetty , Metilda Sagaya Mary N J , S. Umesh

Voice anonymisation aims to conceal the voice identity of speakers in speech recordings. Privacy protection is usually estimated from the difficulty of using a speaker verification system to re-identify the speaker post-anonymisation.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Michele Panariello , Sarina Meyer , Pierre Champion , Xiaoxiao Miao , Massimiliano Todisco , Ngoc Thang Vu , Nicholas Evans

It is perhaps no longer surprising that machine learning models, especially deep neural networks, are particularly vulnerable to attacks. One such vulnerability that has been well studied is model extraction: a phenomenon in which the…

Cryptography and Security · Computer Science 2022-07-27 Tejumade Afonja , Lucas Bourtoule , Varun Chandrasekaran , Sageev Oore , Nicolas Papernot

This work presents a novel back-end framework for speaker verification using graph attention networks. Segment-wise speaker embeddings extracted from multiple crops within an utterance are interpreted as node representations of a graph. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Jee-weon Jung , Hee-Soo Heo , Ha-Jin Yu , Joon Son Chung

Model inversion (MI) attacks allow to reconstruct average per-class representations of a machine learning (ML) model's training data. It has been shown that in scenarios where each class corresponds to a different individual, such as face…

Sound · Computer Science 2023-01-10 Karla Pizzi , Franziska Boenisch , Ugur Sahin , Konstantin Böttinger

Speaker anonymization is an effective privacy protection solution that conceals the speaker's identity while preserving the linguistic content and paralinguistic information of the original speech. To establish a fair benchmark and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-05 Jixun Yao , Nikita Kuzmin , Qing Wang , Pengcheng Guo , Ziqian Ning , Dake Guo , Kong Aik Lee , Eng-Siong Chng , Lei Xie

Previously, Target Speaker Extraction (TSE) has yielded outstanding performance in certain application scenarios for speech enhancement and source separation. However, obtaining auxiliary speaker-related information is still challenging in…

Deep learning in audio signal processing, such as human voice audio signal classification, is a rich application area of machine learning. Legitimate use cases include voice authentication, gunfire detection, and emotion recognition. While…

Cryptography and Security · Computer Science 2021-02-01 Kyle Bittner , Martine De Cock , Rafael Dowsley

Audiovisual active speaker detection (ASD) addresses the task of determining the speech activity of a candidate speaker given acoustic and visual data. Typically, systems model the temporal correspondence of audiovisual cues, such as the…

Multimedia · Computer Science 2025-02-11 Jason Clarke , Yoshihiko Gotoh , Stefan Goetze

An automatic speaker verification system aims to verify the speaker identity of a speech signal. However, a voice conversion system could manipulate a person's speech signal to make it sound like another speaker's voice and deceive the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Danwei Cai , Zexin Cai , Ming Li

This paper presents an experimental study on deep speaker embedding with an attention mechanism that has been found to be a powerful representation learning technique in speaker recognition. In this framework, an attention model works as a…

Sound · Computer Science 2018-09-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Hitoshi Yamamoto , Takafumi Koshinaka

Speaker verification has been studied mostly under the single-talker condition. It is adversely affected in the presence of interference speakers. Inspired by the study on target speaker extraction, e.g., SpEx, we propose a unified speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-05 Chenglin Xu , Wei Rao , Jibin Wu , Haizhou Li

This study aims to develop a single integrated spoofing-aware speaker verification (SASV) embeddings that satisfy two aspects. First, rejecting non-target speakers' input as well as target speakers' spoofed inputs should be addressed.…

Speaker-aware source separation methods are promising workarounds for major difficulties such as arbitrary source permutation and unknown number of sources. However, it remains challenging to achieve satisfying performance provided a very…

Sound · Computer Science 2018-07-25 Jun Wang , Jie Chen , Dan Su , Lianwu Chen , Meng Yu , Yanmin Qian , Dong Yu

This paper investigates methods to effectively retrieve speaker information from the personalized speaker adapted neural network acoustic models (AMs) in automatic speech recognition (ASR). This problem is especially important in the…

Computation and Language · Computer Science 2022-05-02 Natalia Tomashenko , Salima Mdhaffar , Marc Tommasi , Yannick Estève , Jean-François Bonastre

The widespread of powerful personal devices capable of collecting voice of their users has opened the opportunity to build speaker adapted speech recognition system (ASR) or to participate to collaborative learning of ASR. In both cases,…

Computation and Language · Computer Science 2021-11-09 Salima Mdhaffar , Jean-François Bonastre , Marc Tommasi , Natalia Tomashenko , Yannick Estève

Speaker recognition is a task of identifying persons from their voices. Recently, deep learning has dramatically revolutionized speaker recognition. However, there is lack of comprehensive reviews on the exciting progress. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Zhongxin Bai , Xiao-Lei Zhang

Novel text-to-speech systems can generate entirely new voices that were not seen during training. However, it remains a difficult task to efficiently create personalized voices from a high-dimensional speaker space. In this work, we use…

This paper presents the machine learning architecture of the Snips Voice Platform, a software solution to perform Spoken Language Understanding on microprocessors typical of IoT devices. The embedded inference is fast and accurate while…