中文
相关论文

相关论文: Boosting Unknown-number Speaker Separation with Tr…

200 篇论文

Deep attractor networks (DANs) perform speech separation with discriminative embeddings and speaker attractors. Compared with methods based on the permutation invariant training (PIT), DANs define a deep embedding space and deliver a more…

音频与语音处理 · 电气工程与系统科学 2021-05-07 Hangting Chen , Pengyuan Zhang

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

We present a novel source separation model to decompose asingle-channel speech signal into two speech segments belonging to two different speakers. The proposed model is a neural network based on residual blocks, and uses learnt speaker…

声音 · 计算机科学 2019-06-25 Shuo Liu , Gil Keren , Björn Schuller

Recently, end-to-end multi-speaker text-to-speech (TTS) systems gain success in the situation where a lot of high-quality speech plus their corresponding transcriptions are available. However, laborious paired data collection processes…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Tao Tu , Yuan-Jui Chen , Alexander H. Liu , Hung-yi Lee

Transformer has shown advanced performance in speech separation, benefiting from its ability to capture global features. However, capturing local features and channel information of audio sequences in speech separation is equally important.…

声音 · 计算机科学 2023-03-08 Zhaoxi Mu , Xinyu Yang , Wenjing Zhu

In this paper, we present a novel multi-channel speech extraction system to simultaneously extract multiple clean individual sources from a mixture in noisy and reverberant environments. The proposed method is built on an improved…

音频与语音处理 · 电气工程与系统科学 2021-06-17 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

We present a transformer-based architecture for voice separation of a target speaker from multiple other speakers and ambient noise. We achieve this by using two separate neural networks: (A) An enrolment network designed to craft…

音频与语音处理 · 电气工程与系统科学 2025-01-03 Akam Rahimi , Triantafyllos Afouras , Andrew Zisserman

Speech separation aims to separate individual voice from an audio mixture of multiple simultaneous talkers. Although audio-only approaches achieve satisfactory performance, they build on a strategy to handle the predefined conditions,…

声音 · 计算机科学 2020-12-01 Peng Zhang , Jiaming Xu , Jing shi , Yunzhe Hao , Bo Xu

Speaker embeddings are promising identity-related features that can enhance the identity assignment performance of a tracking system by leveraging its spatial predictions, i.e, by performing identity reassignment. Common speaker embedding…

音频与语音处理 · 电气工程与系统科学 2025-08-21 Taous Iatariene , Alexandre Guérin , Romain Serizel

Speaker diarization is a task concerned with partitioning an audio recording by speaker identity. End-to-end neural diarization with encoder-decoder based attractor calculation (EEND-EDA) aims to solve this problem by directly outputting…

声音 · 计算机科学 2023-06-27 Samuel J. Broughton , Lahiru Samarakoon

Most speech separation methods, trying to separate all channel sources simultaneously, are still far from having enough general- ization capabilities for real scenarios where the number of input sounds is usually uncertain and even dynamic.…

声音 · 计算机科学 2021-02-09 Chenxing Li , Jiaming Xu , Nima Mesgarani , Bo Xu

We introduce a monaural neural speaker embeddings extractor that computes an embedding for each speaker present in a speech mixture. To allow for supervised training, a teacher-student approach is employed: the teacher computes the target…

音频与语音处理 · 电气工程与系统科学 2023-09-20 Tobias Cord-Landwehr , Christoph Boeddeker , Cătălin Zorilă , Rama Doddipatla , Reinhold Haeb-Umbach

This paper presents a novel open-domain dialogue generation model emphasizing the differentiation of speakers in multi-turn conversations. Differing from prior work that solely relies on the content of conversation history to generate a…

计算与语言 · 计算机科学 2021-10-18 Zihao Wang , Ming Jiang , Junli Wang

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. This paper proposes a hierarchical network with transformer encoders and memory mechanism to address this problem. The proposed…

声音 · 计算机科学 2020-11-02 Yanpei Shi , Mingjie Chen , Qiang Huang , Thomas Hain

Target-speaker speech recognition aims to recognize target-speaker speech from noisy environments with background noise and interfering speakers. This work presents a joint framework that combines time-domain target-speaker speech…

声音 · 计算机科学 2021-03-01 Jiatong Shi , Chunlei Zhang , Chao Weng , Shinji Watanabe , Meng Yu , Dong Yu

Speaker embeddings represent a means to extract representative vectorial representations from a speech signal such that the representation pertains to the speaker identity alone. The embeddings are commonly used to classify and discriminate…

音频与语音处理 · 电气工程与系统科学 2023-02-07 Adriana Stan

Disentangling uncorrelated information in speech utterances is a crucial research topic within speech community. Different speech-related tasks focus on extracting distinct speech representations while minimizing the affects of other…

计算与语言 · 计算机科学 2023-09-26 Siqi Zheng , Luyao Cheng , Yafeng Chen , Hui Wang , Qian Chen

We present a new method for separating a mixed audio sequence, in which multiple voices speak simultaneously. The new method employs gated neural networks that are trained to separate the voices at multiple processing steps, while…

音频与语音处理 · 电气工程与系统科学 2020-09-02 Eliya Nachmani , Yossi Adi , Lior Wolf

This paper proposes a novel Attention-based Encoder-Decoder network for End-to-End Neural speaker Diarization (AED-EEND). In AED-EEND system, we incorporate the target speaker enrollment information used in target speaker voice activity…

声音 · 计算机科学 2023-08-16 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

We propose an end-to-end trainable approach to single-channel speech separation with unknown number of speakers. Our approach extends the MulCat source separation backbone with additional output heads: a count-head to infer the number of…

声音 · 计算机科学 2020-12-01 Junzhe Zhu , Raymond Yeh , Mark Hasegawa-Johnson