中文
相关论文

相关论文: Improving Neural Diarization through Speaker Attri…

200 篇论文

Speaker embedding extractors significantly influence the performance of clustering-based speaker diarisation systems. Conventionally, only one embedding is extracted from each speech segment. However, because of the sliding window approach,…

声音 · 计算机科学 2022-11-09 Hee-Soo Heo , Youngki Kwon , Bong-Jin Lee , You Jin Kim , Jee-weon Jung

The most common approach to speaker diarization is clustering of speaker embeddings. However, the clustering-based approach has a number of problems; i.e., (i) it is not optimized to minimize diarization errors directly, (ii) it cannot…

音频与语音处理 · 电气工程与系统科学 2020-03-09 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu

State-of-the-art Deep Learning systems for speaker verification are commonly based on speaker embedding extractors. These architectures are usually composed of a feature extractor front-end together with a pooling layer to encode…

音频与语音处理 · 电气工程与系统科学 2024-05-08 Federico Costa , Miquel India , Javier Hernando

We introduce and analyze a novel approach to the problem of speaker identification in multi-party recorded meetings. Given a speech segment and a set of available candidate profiles, we propose a novel data-driven way to model the distance…

音频与语音处理 · 电气工程与系统科学 2021-02-23 Nikolaos Flemotomos , Dimitrios Dimitriadis

Speech 'in-the-wild' is a handicap for speaker recognition systems due to the variability induced by real-life conditions, such as environmental noise and the emotional state of the speaker. Taking advantage of the principles of…

音频与语音处理 · 电气工程与系统科学 2022-05-17 Esther Rituerto-González , Carmen Peláez-Moreno

This paper investigates a self-adaptation method for speech enhancement using auxiliary speaker-aware features; we extract a speaker representation used for adaptation directly from the test utterance. Conventional studies of deep neural…

音频与语音处理 · 电气工程与系统科学 2020-02-17 Yuma Koizumi , Kohei Yatabe , Marc Delcroix , Yoshiki Masuyama , Daiki Takeuchi

In this paper two different approaches to enhance the performance of the most challenging component of a Speaker Diarization system are presented, i.e. the speaker clustering part. A processing step is proposed enhancing the input features…

音频与语音处理 · 电气工程与系统科学 2019-09-04 Dimitrios Dimitriadis

Speaker recognition is a task of identifying persons from their voices. Recently, deep learning has dramatically revolutionized speaker recognition. However, there is lack of comprehensive reviews on the exciting progress. In this paper, we…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Zhongxin Bai , Xiao-Lei Zhang

We introduce a self-supervised speech pre-training method called TERA, which stands for Transformer Encoder Representations from Alteration. Recent approaches often learn by using a single auxiliary task like contrastive prediction,…

音频与语音处理 · 电气工程与系统科学 2021-08-05 Andy T. Liu , Shang-Wen Li , Hung-yi Lee

An embedding-based speaker adaptive training (SAT) approach is proposed and investigated in this paper for deep neural network acoustic modeling. In this approach, speaker embedding vectors, which are a constant given a particular speaker,…

计算与语言 · 计算机科学 2017-10-20 Xiaodong Cui , Vaibhava Goel , George Saon

Despite speaker verification has achieved significant performance improvement with the development of deep neural networks, domain mismatch is still a challenging problem in this field. In this study, we propose a novel framework to…

音频与语音处理 · 电气工程与系统科学 2021-02-24 Mufan Sang , Wei Xia , John H. L. Hansen

The scarcity of labeled audio-visual datasets is a constraint for training superior audio-visual speaker diarization systems. To improve the performance of audio-visual speaker diarization, we leverage pre-trained supervised and…

音频与语音处理 · 电气工程与系统科学 2023-12-08 Huan Zhao , Li Zhang , Yue Li , Yannan Wang , Hongji Wang , Wei Rao , Qing Wang , Lei Xie

Speaker-role diarization (RD), such as doctor vs. patient or lawyer vs. client, is practically often more useful than conventional speaker diarization (SD), which assigns only generic labels (speaker-1, speaker-2). The state-of-the-art…

音频与语音处理 · 电气工程与系统科学 2025-12-23 Arindam Ghosh , Mark Fuhs , Bongjun Kim , Anurag Chowdhury , Monika Woszczyna

Speaker diarization, the process of segmenting an audio stream or transcribed speech content into homogenous partitions based on speaker identity, plays a crucial role in the interpretation and analysis of human speech. Most existing…

机器学习 · 计算机科学 2024-08-23 Luyao Cheng , Hui Wang , Siqi Zheng , Yafeng Chen , Rongjie Huang , Qinglin Zhang , Qian Chen , Xihao Li

Recent speaker diarisation systems often convert variable length speech segments into fixed-length vector representations for speaker clustering, which are known as speaker embeddings. In this paper, the content-aware speaker embeddings…

声音 · 计算机科学 2021-02-15 G. Sun , D. Liu , C. Zhang , P. C. Woodland

This paper presents a novel open-domain dialogue generation model emphasizing the differentiation of speakers in multi-turn conversations. Differing from prior work that solely relies on the content of conversation history to generate a…

计算与语言 · 计算机科学 2021-10-18 Zihao Wang , Ming Jiang , Junli Wang

In recent years, speaker diarization has attracted widespread attention. To achieve better performance, some studies propose to diarize speech in multiple stages. Although these methods might bring additional benefits, most of them are…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Jiangyu Han , Yuhang Cao , Heng Lu , Yanhua Long

In this paper, we present a conditional multitask learning method for end-to-end neural speaker diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in the case…

音频与语音处理 · 电气工程与系统科学 2021-06-09 Yuki Takashima , Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Paola García , Kenji Nagamatsu

For real-time speech enhancement (SE) including noise suppression, dereverberation and acoustic echo cancellation, the time-variance of the audio signals becomes a severe challenge. The causality and memory usage limit that only the…

音频与语音处理 · 电气工程与系统科学 2023-02-22 Chengyu Zheng , Yuan Zhou , Xiulian Peng , Yuan Zhang , Yan Lu

End-to-end transformer-based automatic speech recognition (ASR) systems often capture multiple speech traits in their learned representations that are highly entangled, leading to a lack of interpretability. In this study, we propose the…

音频与语音处理 · 电气工程与系统科学 2024-11-28 Pu Wang , Hugo Van hamme