English
Related papers

Related papers: Compositional embedding models for speaker identif…

200 papers

In this paper, we propose a novel end-to-end neural-network-based speaker diarization method. Unlike most existing methods, our proposed method does not have separate modules for extraction and clustering of speaker representations.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-16 Yusuke Fujita , Naoyuki Kanda , Shota Horiguchi , Kenji Nagamatsu , Shinji Watanabe

The aim of this paper is to investigate the benefit of combining both language and acoustic modelling for speaker diarization. Although conventional systems only use acoustic features, in some scenarios linguistic data contain high…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-31 Miquel India , Javier Hernando , José A. R. Fonollosa

Speaker diarisation systems often cluster audio segments using speaker embeddings such as i-vectors and d-vectors. Since different types of embeddings are often complementary, this paper proposes a generic framework to improve performance…

Computation and Language · Computer Science 2019-02-11 Guangzhi Sun , Chao Zhang , Phil Woodland

Verifying the identity of a speaker is crucial in modern human-machine interfaces, e.g., to ensure privacy protection or to enable biometric authentication. Classical speaker verification (SV) approaches estimate a fixed-dimensional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 Ahmad Aloradi , Wolfgang Mack , Mohamed Elminshawi , Emanuël A. P. Habets

Speaker diarization systems are challenged by a trade-off between the temporal resolution and the fidelity of the speaker representation. By obtaining a superior temporal resolution with an enhanced accuracy, a multi-scale approach is a way…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Tae Jin Park , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

Speaker diarization is the process of labeling different speakers in a speech signal. Deep speaker embeddings are generally extracted from short speech segments and clustered to determine the segments belong to same speaker identity. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Myungjong Kim , Vijendra Raj Apsingekar , Divya Neelagiri

Significant progress has recently been made in speaker diarisation after the introduction of d-vectors as speaker embeddings extracted from neural network (NN) speaker classifiers for clustering speech segments. To extract better-performing…

Sound · Computer Science 2021-05-10 Guangzhi Sun , Chao Zhang , Phil Woodland

Speaker embeddings achieve promising results on many speaker verification tasks. Phonetic information, as an important component of speech, is rarely considered in the extraction of speaker embeddings. In this paper, we introduce phonetic…

Sound · Computer Science 2018-06-15 Yi Liu , Liang He , Jia Liu , Michael T. Johnson

The success of deep learning-based speaker verification systems is largely attributed to access to large-scale and diverse speaker identity data. However, collecting data from more identities is expensive, challenging, and often limited by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Tianchi Liu , Ruijie Tao , Qiongqiong Wang , Yidi Jiang , Hardik B. Sailor , Ke Zhang , Jingru Lin , Haizhou Li

The objective of this work is speaker diarisation of speech recordings 'in the wild'. The ability to determine speech segments is a crucial part of diarisation systems, accounting for a large proportion of errors. In this paper, we present…

Sound · Computer Science 2020-12-01 Youngki Kwon , Hee Soo Heo , Jaesung Huh , Bong-Jin Lee , Joon Son Chung

This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-27 Koji Okabe , Takafumi Koshinaka , Koichi Shinoda

We propose a modified teacher-student training for the extraction of frame-wise speaker embeddings that allows for an effective diarization of meeting scenarios containing partially overlapping speech. To this end, a geodesic distance loss…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Tobias Cord-Landwehr , Christoph Boeddeker , Cătălin Zorilă , Rama Doddipatla , Reinhold Haeb-Umbach

Speaker diarization is an essential step for processing multi-speaker audio. Although an end-to-end neural diarization (EEND) method achieved state-of-the-art performance, it is limited to a fixed number of speakers. In this paper, we solve…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-03 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Jing Shi , Kenji Nagamatsu

Recent diarization technologies can be categorized into two approaches, i.e., clustering and end-to-end neural approaches, which have different pros and cons. The clustering-based approaches assign speaker labels to speech regions by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-08 Keisuke Kinoshita , Marc Delcroix , Naohiro Tawara

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

Sound · Computer Science 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

This paper presents a computationally efficient and distributed speaker diarization framework for networked IoT-style audio devices. The work proposes a Federated Learning model which can identify the participants in a conversation without…

Sound · Computer Science 2024-12-02 Amit Kumar Bhuyan , Hrishikesh Dutta , Subir Biswas

Speaker diarization systems often struggle with high intrinsic intra-speaker variability, such as shifts in emotion, health, or content. This can cause segments from the same speaker to be misclassified as different individuals, for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-19 Miseul Kim , Soo Jin Park , Kyungguen Byun , Hyeon-Kyeong Shin , Sunkuk Moon , Shuhua Zhang , Erik Visser

End-to-end speaker diarization for an unknown number of speakers is addressed in this paper. Recently proposed end-to-end speaker diarization outperformed conventional clustering-based speaker diarization, but it has one drawback: it is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-06 Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Yawen Xue , Kenji Nagamatsu

Multi-speaker speech recognition of unsegmented recordings has diverse applications such as meeting transcription and automatic subtitle generation. With technical advances in systems dealing with speech separation, speaker diarization, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Desh Raj , Pavel Denisov , Zhuo Chen , Hakan Erdogan , Zili Huang , Maokui He , Shinji Watanabe , Jun Du , Takuya Yoshioka , Yi Luo , Naoyuki Kanda , Jinyu Li , Scott Wisdom , John R. Hershey

Speaker embeddings represent a means to extract representative vectorial representations from a speech signal such that the representation pertains to the speaker identity alone. The embeddings are commonly used to classify and discriminate…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-07 Adriana Stan