中文
相关论文

相关论文: Reformulating Speaker Diarization as Community Det…

200 篇论文

Many modern systems for speaker diarization, such as the recently-developed VBx approach, rely on clustering of DNN speaker embeddings followed by resegmentation. Two problems with this approach are that the DNN is not directly optimized…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Kiran Karra , Alan McCree

The aim of this paper is to investigate the benefit of combining both language and acoustic modelling for speaker diarization. Although conventional systems only use acoustic features, in some scenarios linguistic data contain high…

音频与语音处理 · 电气工程与系统科学 2025-01-31 Miquel India , Javier Hernando , José A. R. Fonollosa

Speaker clustering is the task of differentiating speakers in a recording. In a way, the aim is to answer "who spoke when" in audio recordings. A common method used in industry is feature extraction directly from the recording thanks to…

声音 · 计算机科学 2018-03-23 Maxime Jumelle , Taqiyeddine Sakmeche

Speaker diarization, usually denoted as the ''who spoke when'' task, turns out to be particularly challenging when applied to fictional films, where many characters talk in various acoustic conditions (background music, sound effects...).…

多媒体 · 计算机科学 2019-04-22 Xavier Bost , Georges Linares

In spite of the popularity of end-to-end diarization systems nowadays, modular systems comprised of voice activity detection (VAD), speaker embedding extraction plus clustering, and overlapped speech detection (OSD) plus handling still…

音频与语音处理 · 电气工程与系统科学 2024-11-05 Petr Pálka , Federico Landini , Dominik Klement , Mireia Diez , Anna Silnova , Marc Delcroix , Lukáš Burget

We address the problem of acoustic source separation in a deep learning framework we call "deep clustering." Rather than directly estimating signals or masking functions, we train a deep network to produce spectrogram embeddings that are…

神经与进化计算 · 计算机科学 2015-08-19 John R. Hershey , Zhuo Chen , Jonathan Le Roux , Shinji Watanabe

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

声音 · 计算机科学 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

Recently, the speaker clustering model based on aggregation hierarchy cluster (AHC) is a common method to solve two main problems: no preset category number clustering and fix category number clustering. In general, model takes features…

音频与语音处理 · 电气工程与系统科学 2020-03-05 Chen Feng , Jianzong Wang , Tongxu Li , Junqing Peng , Jing Xiao

In speaker diarisation, speaker embedding extraction models often suffer from the mismatch between their training loss functions and the speaker clustering method. In this paper, we propose the method of spectral clustering-aware learning…

声音 · 计算机科学 2023-03-16 Evonne P. C. Lee , Guangzhi Sun , Chao Zhang , Philip C. Woodland

We discuss topological aspects of cluster analysis and show that inferring the topological structure of a dataset before clustering it can considerably enhance cluster detection: theoretical arguments and empirical evidence show that…

机器学习 · 计算机科学 2022-07-04 Moritz Herrmann , Daniyal Kazempour , Fabian Scheipl , Peer Kröger

In automatic speech processing systems, speaker diarization is a crucial front-end component to separate segments from different speakers. Inspired by the recent success of deep neural networks (DNNs) in semantic inferencing, triplet…

音频与语音处理 · 电气工程与系统科学 2018-08-07 Huan Song , Megan Willi , Jayaraman J. Thiagarajan , Visar Berisha , Andreas Spanias

We performed an experimental review of current diarization systems for the conversational telephone speech (CTS) domain. In detail, we considered a total of eight different algorithms belonging to clustering-based, end-to-end neural…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Luca Serafini , Samuele Cornell , Giovanni Morrone , Enrico Zovato , Alessio Brutti , Stefano Squartini

Speaker diarization, the process of segmenting an audio stream or transcribed speech content into homogenous partitions based on speaker identity, plays a crucial role in the interpretation and analysis of human speech. Most existing…

机器学习 · 计算机科学 2024-08-23 Luyao Cheng , Hui Wang , Siqi Zheng , Yafeng Chen , Rongjie Huang , Qinglin Zhang , Qian Chen , Xihao Li

In multi-speaker applications is common to have pre-computed models from enrolled speakers. Using these models to identify the instances in which these speakers intervene in a recording is the task of speaker tracking. In this paper, we…

Deep clustering is the first method to handle general audio separation scenarios with multiple sources of the same type and an arbitrary number of sources, performing impressively in speaker-independent speech separation tasks. However,…

机器学习 · 统计学 2017-11-30 Yi Luo , Zhuo Chen , John R. Hershey , Jonathan Le Roux , Nima Mesgarani

Since the first speech recognition systems were built more than 30 years ago, improvement in voice technology has enabled applications such as smart assistants and automated customer support. However, conversation intelligence of the future…

音频与语音处理 · 电气工程与系统科学 2024-02-15 Desh Raj

One of the most widely studied problem in mining and analysis of complex networks is the detection of community structures. The problem has been extensively studied by researchers due to its high utility and numerous applications in various…

社会与信息网络 · 计算机科学 2016-07-29 Muhammad Qasim Pasta , Faraz Zaidi , Guy Melançon

Graph clustering, or community detection, is the task of identifying groups of closely related objects in a large network. In this paper we introduce a new community-detection framework called LambdaCC that is based on a specially weighted…

数据结构与算法 · 计算机科学 2018-07-17 Nate Veldt , David Gleich , Anthony Wirth

Speaker diarization has been investigated extensively as an important central task for meeting analysis. Recent trend shows that integration of end-to-end neural (EEND)-and clustering-based diarization is a promising approach to handle…

音频与语音处理 · 电气工程与系统科学 2022-02-15 Keisuke Kinoshita , Marc Delcroix , Tomoharu Iwata

We propose a modular pipeline for the single-channel separation, recognition, and diarization of meeting-style recordings and evaluate it on the Libri-CSS dataset. Using a Continuous Speech Separation (CSS) system with a TF-GridNet…

音频与语音处理 · 电气工程与系统科学 2024-05-07 Thilo von Neumann , Christoph Boeddeker , Tobias Cord-Landwehr , Marc Delcroix , Reinhold Haeb-Umbach