中文
相关论文

相关论文: Privacy-Preserving End-to-End Full-Duplex Speech D…

200 篇论文

Anonymisation has the goal of manipulating speech signals in order to degrade the reliability of automatic approaches to speaker recognition, while preserving other aspects of speech, such as those relating to intelligibility and…

音频与语音处理 · 电气工程与系统科学 2021-09-02 Jose Patino , Natalia Tomashenko , Massimiliano Todisco , Andreas Nautsch , Nicholas Evans

The use of modern vocoders in an analysis/synthesis pipeline allows us to investigate high-quality voice conversion that can be used for privacy purposes. Here, we propose to transform the speaker embedding and the pitch in order to hide…

音频与语音处理 · 电气工程与系统科学 2023-03-27 Paul-Gauthier Noé , Xiaoxiao Miao , Xin Wang , Junichi Yamagishi , Jean-François Bonastre , Driss Matrouf

Full-duplex spoken dialogue systems significantly surpass traditional turn-based dialogue systems, as they allow simultaneous bidirectional communication, closely mirroring human-human interactions. However, achieving low latency and…

计算与语言 · 计算机科学 2025-01-06 Qinglin Zhang , Luyao Cheng , Chong Deng , Qian Chen , Wen Wang , Siqi Zheng , Jiaqing Liu , Hai Yu , Chaohong Tan , Zhihao Du , Shiliang Zhang

Recently, fully recurrent neural network (RNN) based end-to-end models have been proven to be effective for multi-speaker speech recognition in both the single-channel and multi-channel scenarios. In this work, we explore the use of…

音频与语音处理 · 电气工程与系统科学 2020-02-14 Xuankai Chang , Wangyou Zhang , Yanmin Qian , Jonathan Le Roux , Shinji Watanabe

Speaker attribute perturbation offers a feasible approach to asynchronous voice anonymization by employing adversarially perturbed speech as anonymized output. In order to enhance the identity unlinkability among anonymized utterances from…

声音 · 计算机科学 2025-08-22 Liping Chen , Chenyang Guo , Rui Wang , Kong Aik Lee , Zhenhua Ling

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, but their tendency to memorize training data poses significant privacy risks, particularly during fine-tuning…

计算与语言 · 计算机科学 2025-08-21 Badrinath Ramakrishnan , Akshaya Balaji

The transformer architecture has become a cornerstone of modern AI, fueling remarkable progress across applications in natural language processing, computer vision, and multimodal learning. As these models continue to scale explosively for…

密码学与安全 · 计算机科学 2025-08-22 Ruyi Ding , Tianhong Xu , Xinyi Shen , Aidong Adam Ding , Yunsi Fei

As the paradigm of AI shifts from text-based LLMs to Speech Language Models (SLMs), there is a growing demand for full-duplex systems capable of real-time, natural human-computer interaction. However, the development of such models is…

声音 · 计算机科学 2026-03-31 Kyudan Jung , Jihwan Kim , Soyoon Kim , Jeonghoon Kim , Jaegul Choo , Cheonbok Park

In order to protect the privacy of speech data, speaker anonymization aims for hiding the identity of a speaker by changing the voice in speech recordings. This typically comes with a privacy-utility trade-off between protection of…

声音 · 计算机科学 2022-10-21 Sarina Meyer , Pascal Tilli , Pavel Denisov , Florian Lux , Julia Koch , Ngoc Thang Vu

Recent advances in GPT-4o like multi-modality models have demonstrated remarkable progress for direct speech-to-speech conversation, with real-time speech interaction experience and strong speech understanding ability. However, current…

声音 · 计算机科学 2024-12-09 Ze Yuan , Yanqing Liu , Shujie Liu , Sheng Zhao

The goal of voice anonymization is to modify an audio such that the true identity of its speaker is hidden. Research on this task is typically limited to the same English read speech datasets, thus the efficacy of current methods for other…

音频与语音处理 · 电气工程与系统科学 2025-07-03 Sarina Meyer , Ekaterina Kolos , Ngoc Thang Vu

This paper investigates the downlink (DL) physical layer security (PLS) in a near-field (NF) extra-large multiple-input multiple-output MIMO (XL-MIMO) system. To enhance the secrecy rate (SR), null-space artificial noise (AN) is transmitted…

信息论 · 计算机科学 2025-03-19 Xiangjun Ma , Ali Arshad Nasir , Daniel Benevides da Costa

In an age of voice-enabled technology, voice anonymization offers a solution to protect people's privacy, provided these systems work equally well across subgroups. This study investigates bias in voice anonymization systems within the…

音频与语音处理 · 电气工程与系统科学 2023-11-28 Anna Leschanowsky , Ünal Ege Gaznepoglu , Nils Peters

We study physical-layer security in wireless ad hoc networks and investigate two types of multi-antenna transmission schemes for providing secrecy enhancements. To establish secure transmission against malicious eavesdroppers, we consider…

信息论 · 计算机科学 2016-11-15 Xi Zhang , Xiangyun Zhou , Matthew R. McKay

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

计算与语言 · 计算机科学 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, severe performance degradation is still observed in the…

Recent advances in machine learning techniques are enabling Automated Speech Recognition (ASR) more accurate and practical. The evidence of this can be seen in the rising number of smart devices with voice processing capabilities. More and…

密码学与安全 · 计算机科学 2022-03-15 Yogachandran Rahulamathavan

The widespread of powerful personal devices capable of collecting voice of their users has opened the opportunity to build speaker adapted speech recognition system (ASR) or to participate to collaborative learning of ASR. In both cases,…

计算与语言 · 计算机科学 2021-11-09 Salima Mdhaffar , Jean-François Bonastre , Marc Tommasi , Natalia Tomashenko , Yannick Estève

The trend of scaling up speech generation models poses a threat of biometric information leakage of the identities of the voices in the training data, raising privacy and security concerns. In this paper, we investigate training…

音频与语音处理 · 电气工程与系统科学 2024-05-21 Wen-Chin Huang , Yi-Chiao Wu , Tomoki Toda

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to…

声音 · 计算机科学 2024-07-02 Juan Ignacio Alvarez-Trejos , Beltrán Labrador , Alicia Lozano-Diez