中文
相关论文

相关论文: Speaker Diarization Based on Multi-channel Microph…

200 篇论文

This paper describes the Royalflush speaker diarization system submitted to the Multi-channel Multi-party Meeting Transcription Challenge(M2MeT). Our system comprises speech enhancement, overlapped speech detection, speaker embedding…

声音 · 计算机科学 2022-02-21 Jingguang Tian , Xinhui Hu , Xinkang Xu

We propose to address online speaker diarization as a combination of incremental clustering and local diarization applied to a rolling buffer updated every 500ms. Every single step of the proposed pipeline is designed to take full advantage…

音频与语音处理 · 电气工程与系统科学 2021-09-15 Juan M. Coria , Hervé Bredin , Sahar Ghannay , Sophie Rosset

Speaker diarization based on bottom-up clustering of speech segments by acoustic similarity is often highly sensitive to the choice of hyperparameters, such as the initial number of clusters and feature weighting. Optimizing these…

计算与语言 · 计算机科学 2022-02-22 Andreas Stolcke

This paper describes the system developed by the XMUSPEECH team for the Multi-channel Multi-party Meeting Transcription Challenge (M2MeT). For the speaker diarization task, we propose a multi-channel speaker diarization system that obtains…

音频与语音处理 · 电气工程与系统科学 2022-02-14 Jie Wang , Yuji Liu , Binling Wang , Yiming Zhi , Song Li1 , Shipeng Xia , Jiayang Zhang , Lin Li1 , Qingyang Hong , Feng Tong

This paper describes a system that generates speaker-annotated transcripts of meetings by using a microphone array and a 360-degree camera. The hallmark of the system is its ability to handle overlapped speech, which has been an unsolved…

In this paper we propose a new method of speaker diarization that employs a deep learning architecture to learn speaker embeddings. In contrast to the traditional approaches that build their speaker embeddings using manually hand-crafted…

声音 · 计算机科学 2017-09-18 Pawel Cyrta , Tomasz Trzciński , Wojciech Stokowiec

Speaker diarization has gained considerable attention within speech processing research community. Mainstream speaker diarization rely primarily on speakers' voice characteristics extracted from acoustic signals and often overlook the…

声音 · 计算机科学 2024-02-06 Luyao Cheng , Siqi Zheng , Qinglin Zhang , Hui Wang , Yafeng Chen , Qian Chen , Shiliang Zhang

We propose a modular pipeline for the single-channel separation, recognition, and diarization of meeting-style recordings and evaluate it on the Libri-CSS dataset. Using a Continuous Speech Separation (CSS) system with a TF-GridNet…

音频与语音处理 · 电气工程与系统科学 2024-05-07 Thilo von Neumann , Christoph Boeddeker , Tobias Cord-Landwehr , Marc Delcroix , Reinhold Haeb-Umbach

Speaker diarization(SD) is a classic task in speech processing and is crucial in multi-party scenarios such as meetings and conversations. Current mainstream speaker diarization approaches consider acoustic information only, which result in…

计算与语言 · 计算机科学 2023-05-23 Luyao Cheng , Siqi Zheng , Zhang Qinglin , Hui Wang , Yafeng Chen , Qian Chen

Speaker diarization consists of assigning speech signals to people engaged in a dialogue. An audio-visual spatiotemporal diarization model is proposed. The model is well suited for challenging scenarios that consist of several participants…

计算机视觉与模式识别 · 计算机科学 2018-10-15 Israel D. Gebru , Silèye Ba , Xiaofei Li , Radu Horaud

In this paper, we propose Discriminative Neural Clustering (DNC) that formulates data clustering with a maximum number of clusters as a supervised sequence-to-sequence learning problem. Compared to traditional unsupervised clustering…

音频与语音处理 · 电气工程与系统科学 2020-11-24 Qiujia Li , Florian L. Kreyssig , Chao Zhang , Philip C. Woodland

When dealing with overlapped speech, the performance of automatic speech recognition (ASR) systems substantially degrades as they are designed for single-talker speech. To enhance ASR performance in conversational or meeting environments,…

音频与语音处理 · 电气工程与系统科学 2023-11-16 Hassan Taherian , DeLiang Wang

This paper introduces a novel approach to speaker-attributed ASR transcription using a neural clustering method. With a parallel processing mechanism, diarisation and ASR can be applied simultaneously, helping to prevent the accumulation of…

音频与语音处理 · 电气工程与系统科学 2024-09-04 Xianrui Zheng , Guangzhi Sun , Chao Zhang , Philip C. Woodland

Multi-speaker speech recognition of unsegmented recordings has diverse applications such as meeting transcription and automatic subtitle generation. With technical advances in systems dealing with speech separation, speaker diarization, and…

音频与语音处理 · 电气工程与系统科学 2020-11-05 Desh Raj , Pavel Denisov , Zhuo Chen , Hakan Erdogan , Zili Huang , Maokui He , Shinji Watanabe , Jun Du , Takuya Yoshioka , Yi Luo , Naoyuki Kanda , Jinyu Li , Scott Wisdom , John R. Hershey

Multi-speaker automatic speech recognition (MS-ASR) faces significant challenges in transcribing overlapped speech, a task critical for applications like meeting transcription and conversational analysis. While serialized output training…

音频与语音处理 · 电气工程与系统科学 2025-06-09 Yuke Lin , Ming Cheng , Ze Li , Beilong Tang , Ming Li

In this paper, we propose a novel algorithm for speaker diarization using metric learning for graph based clustering. The graph clustering algorithms use an adjacency matrix consisting of similarity scores. These scores are computed between…

音频与语音处理 · 电气工程与系统科学 2021-09-15 Prachi Singh , Sriram Ganapathy

Speech recognition and other natural language tasks have long benefited from voting-based algorithms as a method to aggregate outputs from several systems to achieve a higher accuracy than any of the individual systems. Diarization, the…

计算与语言 · 计算机科学 2020-02-06 Andreas Stolcke , Takuya Yoshioka

Overlapping speech diarization is always treated as a multi-label classification problem. In this paper, we reformulate this task as a single-label prediction problem by encoding the multi-speaker labels with power set. Specifically, we…

声音 · 计算机科学 2021-11-30 Zhihao Du , Shiliang Zhang , Siqi Zheng , Weilong Huang , Ming Lei

Since the first speech recognition systems were built more than 30 years ago, improvement in voice technology has enabled applications such as smart assistants and automated customer support. However, conversation intelligence of the future…

音频与语音处理 · 电气工程与系统科学 2024-02-15 Desh Raj

Speaker diarization is the process of labeling different speakers in a speech signal. Deep speaker embeddings are generally extracted from short speech segments and clustered to determine the segments belong to same speaker identity. The…

音频与语音处理 · 电气工程与系统科学 2021-05-18 Myungjong Kim , Vijendra Raj Apsingekar , Divya Neelagiri