中文
相关论文

相关论文: Speaker Diarization with Region Proposal Network

200 篇论文

We propose a modified teacher-student training for the extraction of frame-wise speaker embeddings that allows for an effective diarization of meeting scenarios containing partially overlapping speech. To this end, a geodesic distance loss…

音频与语音处理 · 电气工程与系统科学 2024-01-09 Tobias Cord-Landwehr , Christoph Boeddeker , Cătălin Zorilă , Rama Doddipatla , Reinhold Haeb-Umbach

Speaker diarization, or the task of finding "who spoke and when", is now used in almost every speech processing application. Nevertheless, its fairness has not yet been evaluated because there was no protocol to study its biases one by one.…

声音 · 计算机科学 2023-02-21 Yannis Tevissen , Jérôme Boudy , Gérard Chollet , Frédéric Petitpont

Speaker embedding extractors (EEs), which map input audio to a speaker discriminant latent space, are of paramount importance in speaker diarisation. However, there are several challenges when adopting EEs for diarisation, from which we…

Speaker diarisation systems nowadays use embeddings generated from speech segments in a bottleneck layer, which are needed to be discriminative for unseen speakers. It is well-known that large-margin training can improve the generalisation…

音频与语音处理 · 电气工程与系统科学 2020-07-07 Yassir Fathullah , Chao Zhang , Philip C. Woodland

Target speech separation is the process of filtering a certain speaker's voice out of speech mixtures according to the additional speaker identity information provided. Recent works have made considerable improvement by processing signals…

声音 · 计算机科学 2021-09-28 Qingjian Lin , Lin Yang , Xuyang Wang , Luyuan Xie , Chen Jia , Junjie Wang

Speaker diarization systems are challenged by a trade-off between the temporal resolution and the fidelity of the speaker representation. By obtaining a superior temporal resolution with an enhanced accuracy, a multi-scale approach is a way…

音频与语音处理 · 电气工程与系统科学 2022-03-31 Tae Jin Park , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

Speaker diarization(SD) is a classic task in speech processing and is crucial in multi-party scenarios such as meetings and conversations. Current mainstream speaker diarization approaches consider acoustic information only, which result in…

计算与语言 · 计算机科学 2023-05-23 Luyao Cheng , Siqi Zheng , Zhang Qinglin , Hui Wang , Yafeng Chen , Qian Chen

In this paper, we address the problem of speaker recognition in challenging acoustic conditions using a novel method to extract robust speaker-discriminative speech representations. We adopt a recently proposed unsupervised adversarial…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Raghuveer Peri , Monisankha Pal , Arindam Jati , Krishna Somandepalli , Shrikanth Narayanan

Recently, the source separation performance was greatly improved by time-domain audio source separation based on dual-path recurrent neural network (DPRNN). DPRNN is a simple but effective model for a long sequential data. While DPRNN is…

音频与语音处理 · 电气工程与系统科学 2020-06-25 Keisuke Kinoshita , Thilo von Neumann , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

In the task of speaker diarization, the number of small-scale meetings accounts for a large proportion. When microphone arrays are employed as a recording device, its spatial information is usually ignored by most researchers. In this…

声音 · 计算机科学 2022-10-27 Yuxuan Du , Ruohua Zhou

Speaker diarization is the task of partitioning audio into segments according to speaker identity, answering the question of "who spoke when" in multi-speaker conversation recordings. While diarization is an essential task for many…

声音 · 计算机科学 2025-10-01 Luca A. Lanzendörfer , Florian Grötschla , Cesare Blaser , Roger Wattenhofer

This paper proposes a neural network based speech separation method using spatially distributed microphones. Unlike with traditional microphone array settings, neither the number of microphones nor their spatial arrangement is known in…

音频与语音处理 · 电气工程与系统科学 2020-05-01 Dongmei Wang , Zhuo Chen , Takuya Yoshioka

Multi-talker overlapped speech recognition remains a significant challenge, requiring not only speech recognition but also speaker diarization tasks to be addressed. In this paper, to better address these tasks, we first introduce speaker…

声音 · 计算机科学 2023-12-19 Peng Shen , Xugang Lu , Hisashi Kawai

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

声音 · 计算机科学 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung

Speaker recognition is a task of identifying persons from their voices. Recently, deep learning has dramatically revolutionized speaker recognition. However, there is lack of comprehensive reviews on the exciting progress. In this paper, we…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Zhongxin Bai , Xiao-Lei Zhang

Speaker diarization (SD) is typically used with an automatic speech recognition (ASR) system to ascribe speaker labels to recognized words. The conventional approach reconciles outputs from independently optimized ASR and SD systems, where…

音频与语音处理 · 电气工程与系统科学 2023-06-20 Rohit Paturi , Sundararajan Srinivasan , Xiang Li

Conventional methods for speaker diarization involve windowing an audio file into short segments to extract speaker embeddings, followed by an unsupervised clustering of the embeddings. This multi-step approach generates speaker assignments…

声音 · 计算机科学 2023-02-27 Prachi Singh , Amrit Kaul , Sriram Ganapathy

Speech applications dealing with conversations require not only recognizing the spoken words but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate systems,…

计算与语言 · 计算机科学 2024-09-04 Grigor Kirakosyan , Davit Karamyan

Speech Segmentation is the process change point detection for partitioning an input audio stream into regions each of which corresponds to only one audio source or one speaker. One application of this system is in Speaker Diarization…

人工智能 · 计算机科学 2012-05-09 Behrouz Abdolali , Hossein Sameti

Speaker-independent speech separation has achieved remarkable performance in recent years with the development of deep neural network (DNN). Various network architectures, from traditional convolutional neural network (CNN) and recurrent…

音频与语音处理 · 电气工程与系统科学 2022-06-17 Xue Yang , Changchun Bao