中文
相关论文

相关论文: Auto-Tuning Spectral Clustering for Speaker Diariz…

200 篇论文

Finite mixture modelling is a popular method in the field of clustering and is beneficial largely due to its soft cluster membership probabilities. A common method for fitting finite mixture models is to employ spectral clustering, which…

机器学习 · 统计学 2024-03-22 Liam Welsh , Phillip Shreeves

End-to-end neural diarization has evolved considerably over the past few years, but data scarcity is still a major obstacle for further improvements. Self-supervised learning methods such as WavLM have shown promising performance on several…

音频与语音处理 · 电气工程与系统科学 2024-10-22 Jiangyu Han , Federico Landini , Johan Rohdin , Anna Silnova , Mireia Diez , Lukas Burget

Diarization partitions an audio stream into segments based on the voices of the speakers. Real-time diarization systems that include an enrollment step should limit enrollment training samples to reduce user interaction time. Although…

声音 · 计算机科学 2022-08-09 Dirk Padfield , Daniel J. Liebling

Many of the kinds of language model used in speech understanding suffer from imperfect modeling of intra-sentential contextual influences. I argue that this problem can be addressed by clustering the sentences in a training corpus…

cmp-lg · 计算机科学 2008-02-03 David Carter

Robust speaker verification under noisy conditions remains an open challenge. Conventional deep learning methods learn a robust unified speaker representation space against diverse background noise and achieve significant improvement. In…

声音 · 计算机科学 2026-03-11 Bin Gu , Haitao Zhao , Jibo Wei

This paper presents the system developed to address the MISP 2025 Challenge. For the diarization system, we proposed a hybrid approach combining a WavLM end-to-end segmentation method with a traditional multi-module clustering technique to…

声音 · 计算机科学 2025-05-29 Shangkun Huang , Yuxuan Du , Jingwen Yang , Dejun Zhang , Xupeng Jia , Jing Deng , Jintao Kang , Rong Zheng

Self-supervised learning (SSL) models such as WavLM have substantially advanced speaker diarization by providing rich contextual speech representations. However, the high computational and memory costs of these models hinder deployment in…

音频与语音处理 · 电气工程与系统科学 2025-11-20 Jiangyu Han , Petr Pálka , Marc Delcroix , Federico Landini , Johan Rohdin , Jan Cernocký , Lukáš Burget

Although fully end-to-end speaker diarization systems have made significant progress in recent years, modular systems often achieve superior results in real-world scenarios due to their greater adaptability and robustness. Historically,…

音频与语音处理 · 电气工程与系统科学 2024-09-26 Ruoyu Wang , Shutong Niu , Gaobin Yang , Jun Du , Shuangqing Qian , Tian Gao , Jia Pan

Given a large data matrix, sparsifying, quantizing, and/or performing other entry-wise nonlinear operations can have numerous benefits, ranging from speeding up iterative algorithms for core numerical linear algebra problems to providing…

机器学习 · 统计学 2021-03-18 Zhenyu Liao , Romain Couillet , Michael W. Mahoney

This paper describes system setup of our submission to speaker diarisation track (Track 4) of VoxCeleb Speaker Recognition Challenge 2020. Our diarisation system consists of a well-trained neural network based speech enhancement model as…

声音 · 计算机科学 2020-10-26 Renyu Wang , Ruilin Tong , Yu Ting Yeung , Xiao Chen

Spectral clustering is one of the most popular unsupervised machine learning methods. Constructing similarity matrix is crucial to this type of method. In most existing works, the similarity matrix is computed once for all or is updated…

机器学习 · 计算机科学 2023-06-30 Yongyan Guo , Gang Wu

This paper presents a physically-informed fuzzy clustering of vertical sounding ionograms for automatically separating the ionogram into tracks suitable for further interpretation and determining their optimal number. The model is designed…

大气与海洋物理 · 物理学 2026-05-01 Oleg I. Berngardt , Sergey N. Ponomarchuk

This paper introduces an online speaker diarization system that can handle long-time audio with low latency. We enable Agglomerative Hierarchy Clustering (AHC) to work in an online fashion by introducing a label matching algorithm. This…

音频与语音处理 · 电气工程与系统科学 2022-06-27 Yucong Zhang , Qinjian Lin , Weiqing Wang , Lin Yang , Xuyang Wang , Junjie Wang , Ming Li

We look at the long-standing problem of segmenting unlabeled speech into word-like segments and clustering these into a lexicon. Several previous methods use a scoring model coupled with dynamic programming to find an optimal segmentation.…

音频与语音处理 · 电气工程与系统科学 2025-01-14 Simon Malan , Benjamin van Niekerk , Herman Kamper

In this study we present a Deep Mixture of Experts (DMoE) neural-network architecture for single microphone speech enhancement. By contrast to most speech enhancement algorithms that overlook the speech variability mainly caused by phoneme…

声音 · 计算机科学 2017-03-29 Shlomo E. Chazan , Jacob Goldberger , Sharon Gannot

Large Audio-Language Models (LALMs) have demonstrated remarkable performance in end-to-end speaker diarization and recognition. However, their speaker discriminability remains limited due to the scarcity of large-scale conversational data…

In this paper, we propose an iterative framework for self-supervised speaker representation learning based on a deep neural network (DNN). The framework starts with training a self-supervision speaker embedding network by maximizing…

音频与语音处理 · 电气工程与系统科学 2020-10-29 Danwei Cai , Weiqing Wang , Ming Li

End-to-end speaker diarization for an unknown number of speakers is addressed in this paper. Recently proposed end-to-end speaker diarization outperformed conventional clustering-based speaker diarization, but it has one drawback: it is…

音频与语音处理 · 电气工程与系统科学 2020-10-06 Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Yawen Xue , Kenji Nagamatsu

We present TagSpeech, a unified LLM-based framework that utilizes Temporal Anchor Grounding for joint multi-speaker ASR and diarization. The framework is built on two key designs: (1) decoupled semantic and speaker streams fine-tuned via…

音频与语音处理 · 电气工程与系统科学 2026-01-13 Mingyue Huo , Yiwen Shao , Yuheng Zhang

Speaker diarization is a task to label audio or video recordings with classes that correspond to speaker identity, or in short, a task to identify "who spoke when". In the early years, speaker diarization algorithms were developed for…

音频与语音处理 · 电气工程与系统科学 2021-11-29 Tae Jin Park , Naoyuki Kanda , Dimitrios Dimitriadis , Kyu J. Han , Shinji Watanabe , Shrikanth Narayanan