English
Related papers

Related papers: PHONOS: PHOnetic Neutralization for Online Streami…

200 papers

Speech data conveys sensitive speaker attributes like identity or accent. With a small amount of found data, such attributes can be inferred and exploited for malicious purposes: voice cloning, spoofing, etc. Anonymization aims to make the…

Computation and Language · Computer Science 2020-02-14 Brij Mohan Lal Srivastava , Nathalie Vauquier , Md Sahidullah , Aurélien Bellet , Marc Tommasi , Emmanuel Vincent

Advances in automatic speaker verification (ASV) promote research into the formulation of spoofing detection systems for real-world applications. The performance of ASV systems can be degraded severely by multiple types of spoofing attacks,…

Sound · Computer Science 2024-08-27 Zhenyu Wang , John H. L. Hansen

Online stereo adaptation tackles the domain shift problem, caused by different environments between synthetic (training) and real (test) datasets, to promptly adapt stereo models in dynamic real-world applications such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kwonyoung Kim , Jungin Park , Jiyoung Lee , Dongbo Min , Kwanghoon Sohn

In this work, we propose a novel method for modeling numerous speakers, which enables expressing the overall characteristics of speakers in detail like a trained multi-speaker model without additional training on the target speaker's…

Sound · Computer Science 2024-06-03 Jungil Kong , Junmo Lee , Jeongmin Kim , Beomjeong Kim , Jihoon Park , Dohee Kong , Changheon Lee , Sangjin Kim

Speech synthesis models convert written text into natural-sounding audio. While earlier models were limited to a single speaker, recent advancements have led to the development of zero-shot systems that generate realistic speech from a wide…

Sound · Computer Science 2025-02-12 Łukasz Bondaruk , Jakub Kubiak

Deep noise suppression (DNS) models enjoy widespread use throughout a variety of high-stakes speech applications. However, we show that four recent DNS models can each be reduced to outputting unintelligible gibberish through the addition…

Sound · Computer Science 2026-03-12 Will Schwarzer , Neel Chaudhari , Philip S. Thomas , Andrea Fanelli , Xiaoyu Liu

Recent advances in artificial intelligence (AI) speech generation and voice cloning technologies have produced naturalistic speech and accurate voice replication, yet their influence on sociotechnical systems across diverse accents and…

Human-Computer Interaction · Computer Science 2025-06-16 Shira Michel , Sufi Kaur , Sarah Elizabeth Gillespie , Jeffrey Gleason , Christo Wilson , Avijit Ghosh

Nowadays, recognition-synthesis-based methods have been quite popular with voice conversion (VC). By introducing linguistics features with good disentangling characters extracted from an automatic speech recognition (ASR) model, the VC…

Sound · Computer Science 2023-05-17 Xintao Zhao , Shuai Wang , Yang Chao , Zhiyong Wu , Helen Meng

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

In this paper, we propose a model to perform style transfer of speech to singing voice. Contrary to the previous signal processing-based methods, which require high-quality singing templates or phoneme synchronization, we explore a…

Sound · Computer Science 2022-08-29 Shrutina Agarwal , Sriram Ganapathy , Naoya Takahashi

Modern text-to-speech (TTS) and voice conversion (VC) systems produce natural sounding speech that questions the security of automatic speaker verification (ASV). This makes detection of such synthetic speech very important to safeguard ASV…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Zhenzong Wu , Rohan Kumar Das , Jichen Yang , Haizhou Li

Real-world speech recordings suffer from degradations such as background noise and reverberation. Speech enhancement aims to mitigate these issues by generating clean high-fidelity signals. While recent generative approaches for speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-22 Heitor R. Guimarães , Jiaqi Su , Rithesh Kumar , Tiago H. Falk , Zeyu Jin

This paper proposes a dual-stage, low complexity, and reconfigurable technique to enhance the speech contaminated by various types of noise sources. Driven by input data and audio contents, the proposed dual-stage speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Jun Yang , Nico Brailovsky

We present an end-to-end deep learning approach to denoising speech signals by processing the raw waveform directly. Given input audio containing speech corrupted by an additive background signal, the system aims to produce a processed…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-18 Francois G. Germain , Qifeng Chen , Vladlen Koltun

Voice Conversion (VC) aims to modify a speaker's timbre while preserving linguistic content. While recent VC models achieve strong performance, most struggle in real-time streaming scenarios due to high latency, dependence on ASR modules,…

Sound · Computer Science 2025-10-13 Zhao Guo , Ziqian Ning , Guobin Ma , Lei Xie

Voice anti-spoofing systems are crucial auxiliaries for automatic speaker verification (ASV) systems. A major challenge is caused by unseen attacks empowered by advanced speech synthesis technologies. Our previous research on one-class…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Siwen Ding , You Zhang , Zhiyao Duan

Nowadays, as more and more systems achieve good performance in traditional voice conversion (VC) tasks, people's attention gradually turns to VC tasks under extreme conditions. In this paper, we propose a novel method for zero-shot voice…

Sound · Computer Science 2023-04-04 Haozhe Zhang , Zexin Cai , Xiaoyi Qin , Ming Li

While neural-based text to speech (TTS) models can synthesize natural and intelligible voice, they usually require high-quality speech data, which is costly to collect. In many scenarios, only noisy speech of a target speaker is available,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Chen Zhang , Yi Ren , Xu Tan , Jinglin Liu , Kejun Zhang , Tao Qin , Sheng Zhao , Tie-Yan Liu

The increasing capabilities of deep neural networks for re-identification, combined with the rise in public surveillance in recent years, pose a substantial threat to individual privacy. Event cameras were initially considered as a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Katharina Bendig , René Schuster , Nicole Thiemer , Karen Joisten , Didier Stricker

In this paper, we introduce a streaming keyphrase detection system that can be easily customized to accurately detect any phrase composed of words from a large vocabulary. The system is implemented with an end-to-end trained automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Rajeev Rikhye , Quan Wang , Qiao Liang , Yanzhang He , Ding Zhao , Yiteng , Huang , Arun Narayanan , Ian McGraw