中文
相关论文

相关论文: Overlap-aware diarization: resegmentation using ne…

200 篇论文

This paper proposes a novel online speaker diarization algorithm based on a fully supervised self-attention mechanism (SA-EEND). Online diarization inherently presents a speaker's permutation problem due to the possibility to assign speaker…

音频与语音处理 · 电气工程与系统科学 2021-03-09 Yawen Xue , Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

In this paper, we propose a novel algorithm for speaker diarization using metric learning for graph based clustering. The graph clustering algorithms use an adjacency matrix consisting of similarity scores. These scores are computed between…

音频与语音处理 · 电气工程与系统科学 2021-09-15 Prachi Singh , Sriram Ganapathy

In this paper, we introduce an unsupervised approach for Speech Segmentation, which builds on previously researched approaches, e.g., Speaker Diarization, while being applicable to an inclusive set of acoustic-semantic distinctions, paving…

计算与语言 · 计算机科学 2025-01-08 Avishai Elmakies , Omri Abend , Yossi Adi

This paper describes a system that generates speaker-annotated transcripts of meetings by using a microphone array and a 360-degree camera. The hallmark of the system is its ability to handle overlapped speech, which has been an unsolved…

Speech enhancement techniques based on deep learning have brought significant improvement on speech quality and intelligibility. Nevertheless, a large gain in speech quality measured by objective metrics, such as perceptual evaluation of…

音频与语音处理 · 电气工程与系统科学 2020-07-06 Bo Wu , Meng Yu , Lianwu Chen , Yong Xu , Chao Weng , Dan Su , Dong Yu

Although recent advances in deep learning technology improved automatic speech recognition (ASR), it remains difficult to recognize speech when it overlaps other people's voices. Speech separation or extraction is often used as a front-end…

音频与语音处理 · 电气工程与系统科学 2022-06-17 Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Keisuke Kinoshita , Takafumi Moriya , Naoyuki Kamo

Recently, end-to-end neural diarization (EEND) is introduced and achieves promising results in speaker-overlapped scenarios. In EEND, speaker diarization is formulated as a multi-label prediction problem, where speaker activities are…

声音 · 计算机科学 2023-12-14 Jiaming Wang , Zhihao Du , Shiliang Zhang

Speaker extraction and diarization are two enabling techniques for real-world speech applications. Speaker extraction aims to extract a target speaker's voice from a speech mixture, while speaker diarization demarcates speech segments by…

声音 · 计算机科学 2025-01-17 Junyi Ao , Mehmet Sinan Yıldırım , Ruijie Tao , Meng Ge , Shuai Wang , Yanmin Qian , Haizhou Li

Automatic speaker diarization techniques typically involve a two-stage processing approach where audio segments of fixed duration are converted to vector representations in the first stage. This is followed by an unsupervised clustering of…

音频与语音处理 · 电气工程与系统科学 2021-06-15 Prachi Singh , Sriram Ganapathy

This paper presents a computationally efficient and distributed speaker diarization framework for networked IoT-style audio devices. The work proposes a Federated Learning model which can identify the participants in a conversation without…

声音 · 计算机科学 2024-12-02 Amit Kumar Bhuyan , Hrishikesh Dutta , Subir Biswas

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

音频与语音处理 · 电气工程与系统科学 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy

Target speech separation is the process of filtering a certain speaker's voice out of speech mixtures according to the additional speaker identity information provided. Recent works have made considerable improvement by processing signals…

声音 · 计算机科学 2021-09-28 Qingjian Lin , Lin Yang , Xuyang Wang , Luyuan Xie , Chen Jia , Junjie Wang

Speaker diarization is a task to label audio or video recordings with classes that correspond to speaker identity, or in short, a task to identify "who spoke when". In the early years, speaker diarization algorithms were developed for…

音频与语音处理 · 电气工程与系统科学 2021-11-29 Tae Jin Park , Naoyuki Kanda , Dimitrios Dimitriadis , Kyu J. Han , Shinji Watanabe , Shrikanth Narayanan

We propose an end-to-end speaker-attributed automatic speech recognition model that unifies speaker counting, speech recognition, and speaker identification on monaural overlapped speech. Our model is built on serialized output training…

音频与语音处理 · 电气工程与系统科学 2020-08-11 Naoyuki Kanda , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Tianyan Zhou , Takuya Yoshioka

End-to-End Neural Diarization (EEND) systems produce frame-level probabilistic speaker activity estimates, yet since evaluation focuses primarily on Diarization Error Rate (DER), the reliability and calibration of these confidence scores…

We propose a novel neural speaker diarization system using memory-aware multi-speaker embedding with sequence-to-sequence architecture (NSD-MS2S), which integrates the strengths of memory-aware multi-speaker embedding (MA-MSE) and…

音频与语音处理 · 电气工程与系统科学 2023-12-27 Gaobin Yang , Maokui He , Shutong Niu , Ruoyu Wang , Yanyan Yue , Shuangqing Qian , Shilong Wu , Jun Du , Chin-Hui Lee

Research on overlapped and discontinuous named entity recognition (NER) has received increasing attention. The majority of previous work focuses on either overlapped or discontinuous entities. In this paper, we propose a novel span-based…

计算与语言 · 计算机科学 2021-06-29 Fei Li , Zhichao Lin , Meishan Zhang , Donghong Ji

This report presents the system developed by the ABSP Laboratory team for the third DIHARD speech diarization challenge. Our main contribution in this work is to develop a simple and efficient solution for acoustic domain dependent speech…

声音 · 计算机科学 2021-01-26 A Kishore Kumar , Shefali Waldekar , Goutam Saha , Md Sahidullah

Full-duplex spoken dialogue systems promise to transform human-machine interaction from a rigid, turn-based protocol into a fluid, natural conversation. However, the central challenge to realizing this vision, managing overlapping speech,…

音频与语音处理 · 电气工程与系统科学 2026-04-28 Guan-Ting Lin , Shih-Yun Shan Kuan , Qirui Wang , Jiachen Lian , Tingle Li , Shinji Watanabe , Hung-yi Lee

Speaker diarization has been mainly developed based on the clustering of speaker embeddings. However, the clustering-based approach has two major problems; i.e., (i) it is not optimized to minimize diarization errors directly, and (ii) it…

音频与语音处理 · 电气工程与系统科学 2019-09-16 Yusuke Fujita , Naoyuki Kanda , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu , Shinji Watanabe