English
Related papers

Related papers: Deep Self-Supervised Hierarchical Clustering for S…

200 papers

State-of-the-art Deep Learning systems for speaker verification are commonly based on speaker embedding extractors. These architectures are usually composed of a feature extractor front-end together with a pooling layer to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-08 Federico Costa , Miquel India , Javier Hernando

We consider the problem of speaker diarization, the problem of segmenting an audio recording of a meeting into temporal segments corresponding to individual speakers. The problem is rendered particularly difficult by the fact that we are…

Methodology · Statistics 2015-03-13 Emily B. Fox , Erik B. Sudderth , Michael I. Jordan , Alan S. Willsky

In this paper, we formulate acoustic howling suppression (AHS) as a supervised learning problem and propose a deep learning approach, called Deep AHS, to address it. Deep AHS is trained in a teacher forcing way which converts the recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Hao Zhang , Meng Yu , Dong Yu

Self-supervised speech representation models have succeeded in various tasks, but improving them for content-related problems using unlabeled data is challenging. We propose speaker-invariant clustering (Spin), a novel self-supervised…

Computation and Language · Computer Science 2023-05-19 Heng-Jui Chang , Alexander H. Liu , James Glass

Contrastive learning has demonstrated strong performance in attributed hypergraph clustering. Typically, existing methods based on contrastive learning first learn node embeddings and then apply clustering algorithms, such as k-means, to…

Machine Learning · Computer Science 2026-03-11 Li Ni , Shuaikang Zeng , Lin Mu , Longlong Lin

Most neural speaker diarization systems rely on sufficient manual training data labels, which are hard to collect under real-world scenarios. This paper proposes a semi-supervised speaker diarization system to utilize large-scale…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-18 Shilong Wu , Jun Du , Maokui He , Shutong Niu , Hang Chen , Haitao Tang , Chin-Hui Lee

One of the main challenges for hierarchical clustering is how to appropriately identify the representative points in the lower level of the cluster tree, which are going to be utilized as the roots in the higher level of the cluster tree…

Machine Learning · Statistics 2021-11-16 Wen-Bo Xie , Zhen Liu , Jaideep Srivastava

Since the first speech recognition systems were built more than 30 years ago, improvement in voice technology has enabled applications such as smart assistants and automated customer support. However, conversation intelligence of the future…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-15 Desh Raj

Speaker embedding extractors significantly influence the performance of clustering-based speaker diarisation systems. Conventionally, only one embedding is extracted from each speech segment. However, because of the sliding window approach,…

Sound · Computer Science 2022-11-09 Hee-Soo Heo , Youngki Kwon , Bong-Jin Lee , You Jin Kim , Jee-weon Jung

This report describes the submission of the DKU-DukeECE team to the self-supervision speaker verification task of the 2021 VoxCeleb Speaker Recognition Challenge (VoxSRC). Our method employs an iterative labeling framework to learn…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-08 Danwei Cai , Ming Li

Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC estimates activities and speaker embeddings for all speakers…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Marc Delcroix , Naohiro Tawara , Mireia Diez , Federico Landini , Anna Silnova , Atsunori Ogawa , Tomohiro Nakatani , Lukas Burget , Shoko Araki

Significant performance degradation of automatic speech recognition (ASR) systems is observed when the audio signal contains cross-talk. One of the recently proposed approaches to solve the problem of multi-speaker ASR is the deep…

Sound · Computer Science 2019-09-26 Tobias Menne , Ilya Sklyar , Ralf Schlüter , Hermann Ney

Unsupervised learning of time series data, also known as temporal clustering, is a challenging problem in machine learning. Here we propose a novel algorithm, Deep Temporal Clustering (DTC), to naturally integrate dimensionality reduction…

Machine Learning · Computer Science 2018-02-06 Naveen Sai Madiraju , Seid M. Sadat , Dimitry Fisher , Homa Karimabadi

This paper investigates the use of target-speaker automatic speech recognition (TS-ASR) for simultaneous speech recognition and speaker diarization of single-channel dialogue recordings. TS-ASR is a technique to automatically extract and…

Computation and Language · Computer Science 2019-09-19 Naoyuki Kanda , Shota Horiguchi , Yusuke Fujita , Yawen Xue , Kenji Nagamatsu , Shinji Watanabe

The field of deep clustering combines deep learning and clustering to learn representations that improve both the learned representation and the performance of the considered clustering method. Most existing deep clustering methods are…

Machine Learning · Computer Science 2023-02-22 Lukas Miklautz , Martin Teuffenbach , Pascal Weber , Rona Perjuci , Walid Durani , Christian Böhm , Claudia Plant

This paper studies the hierarchical clustering problem, where the goal is to produce a dendrogram that represents clusters at varying scales of a data set. We propose the ParChain framework for designing parallel hierarchical agglomerative…

Data Structures and Algorithms · Computer Science 2022-02-15 Shangdi Yu , Yiqiu Wang , Yan Gu , Laxman Dhulipala , Julian Shun

Hierarchical clustering is a stronger extension of one of today's most influential unsupervised learning methods: clustering. The goal of this method is to create a hierarchy of clusters, thus constructing cluster evolutionary history and…

Data Structures and Algorithms · Computer Science 2021-01-14 MohammadTaghi Hajiaghayi , Marina Knittel

This paper proposes a novel technique to obtain better downstream ASR performance from a joint encoder-decoder self-supervised model when trained with speech pooled from two different channels (narrow and wide band). The joint…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Vrunda N. Sukhadia , A. Arunkumar , S. Umesh

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. In this paper, a hierarchical attention network is proposed to solve a weakly labelled speaker identification problem. The use of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to…

Sound · Computer Science 2024-07-02 Juan Ignacio Alvarez-Trejos , Beltrán Labrador , Alicia Lozano-Diez