English
Related papers

Related papers: A Study of F0 Modification for X-Vector Based Spee…

200 papers

The widespread of powerful personal devices capable of collecting voice of their users has opened the opportunity to build speaker adapted speech recognition system (ASR) or to participate to collaborative learning of ASR. In both cases,…

Computation and Language · Computer Science 2021-11-09 Salima Mdhaffar , Jean-François Bonastre , Marc Tommasi , Natalia Tomashenko , Yannick Estève

Speech anonymisation aims to protect speaker identity by changing personal identifiers in speech while retaining linguistic content. Current methods fail to retain prosody and unique speech patterns found in elderly and pathological speech…

Artificial Intelligence · Computer Science 2024-10-22 Suhita Ghosh , Melanie Jouaiti , Arnab Das , Yamini Sinha , Tim Polzehl , Ingo Siegert , Sebastian Stober

The widespread adoption of speech-based online services raises security and privacy concerns regarding the data that they use and share. If the data were compromised, attackers could exploit user speech to bypass speaker verification…

Sound · Computer Science 2022-09-13 Ruibin Yuan , Yuxuan Wu , Jacob Li , Jaxter Kim

We propose DarkStream, a streaming speech synthesis model for real-time speaker anonymization. To improve content encoding under strict latency constraints, DarkStream combines a causal waveform encoder, a short lookahead buffer, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-08 Waris Quamer , Ricardo Gutierrez-Osuna

Applying changes to an input speech signal to change the perceived speaker of speech to a target while maintaining the content of the input is a challenging but interesting task known as Voice conversion (VC). Over the last few years, this…

Sound · Computer Science 2022-12-29 Olga Slizovskaia , Jordi Janer , Pritish Chandna , Oscar Mayor

The success of large language models in text processing has inspired their adaptation to speech modeling. However, since speech is continuous and complex, it is often discretized for autoregressive modeling. Speech tokens derived from…

Computation and Language · Computer Science 2025-06-18 Li-Wei Chen , Takuya Higuchi , Zakaria Aldeneh , Ahmed Hussen Abdelaziz , Alexander Rudnicky

Voice conversion is a challenging task which transforms the voice characteristics of a source speaker to a target speaker without changing linguistic content. Recently, there have been many works on many-to-many Voice Conversion (VC) based…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Manh Luong , Viet Anh Tran

Preference tuning aligns pretrained language models to human judgments of quality, helpfulness, or safety by optimizing over explicit preference signals rather than likelihood alone. Prior work has shown that preference-tuning degrades…

Computation and Language · Computer Science 2026-01-12 Constantinos Karouzos , Xingwei Tan , Nikolaos Aletras

Automatic speaker verification (ASV) systems use a playback detector to filter out playback attacks and ensure verification reliability. Since current playback detection models are almost always trained using genuine and played-back speech,…

Sound · Computer Science 2018-09-14 Fuming Fang , Junichi Yamagishi , Isao Echizen , Md Sahidullah , Tomi Kinnunen

The temporal dynamics of speech, encompassing variations in rhythm, intonation, and speaking rate, contain important and unique information about speaker identity. This paper proposes a new method for representing speaker characteristics by…

Sound · Computer Science 2025-07-22 Natalia Tomashenko , Emmanuel Vincent , Marc Tommasi

This study addresses the problem of unsupervised subword unit discovery from untranscribed speech. It forms the basis of the ultimate goal of ZeroSpeech 2019, building text-to-speech systems without text labels. In this work, unit discovery…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Siyuan Feng , Tan Lee , Zhiyuan Peng

We present VoiceShop, a novel speech-to-speech framework that can modify multiple attributes of speech, such as age, gender, accent, and speech style, in a single forward pass while preserving the input speaker's timbre. Previous works have…

Contemporary speech enhancement predominantly relies on audio transforms that are trained to reconstruct a clean speech waveform. The development of high-performing neural network sound recognition systems has raised the possibility of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-18 Mark R. Saddler , Andrew Francl , Jenelle Feather , Kaizhi Qian , Yang Zhang , Josh H. McDermott

The goal of voice conversion is to transform the speech of a source speaker to sound like that of a reference speaker while preserving the original content. A key challenge is to extract disentangled linguistic content from the source and…

Sound · Computer Science 2025-01-15 Jaehun Kim , Ji-Hoon Kim , Yeunju Choi , Tan Dat Nguyen , Seongkyu Mun , Joon Son Chung

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

Sound · Computer Science 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung

In recent years, the impact of self-supervised speech Transformers has extended to speaker-related applications. However, little research has explored how these models encode speaker information. In this work, we address this gap by…

Computation and Language · Computer Science 2025-06-30 Tzu-Quan Lin , Hsi-Chun Cheng , Hung-yi Lee , Hao Tang

Person Re-Identification (re-ID) aims at retrieving images of the same person taken by different cameras. A challenge for re-ID is the performance preservation when a model is used on data of interest (target data) which belong to a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Fabian Dubourvieux , Romaric Audigier , Angelique Loesch , Samia Ainouz , Stephane Canu

Large, pre-trained representation models trained using self-supervised learning have gained popularity in various fields of machine learning because they are able to extract high-quality salient features from input data. As such, they have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-16 Hejung Yang , Hong-Goo Kang

Voice conversion (VC) is a task that transforms the source speaker's timbre, accent, and tones in audio into another one's while preserving the linguistic content. It is still a challenging work, especially in a one-shot setting.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-09 Da-Yi Wu , Yen-Hao Chen , Hung-Yi Lee

The trend of scaling up speech generation models poses a threat of biometric information leakage of the identities of the voices in the training data, raising privacy and security concerns. In this paper, we investigate training…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Wen-Chin Huang , Yi-Chiao Wu , Tomoki Toda