中文
相关论文

相关论文: Combination of Deep Speaker Embeddings for Diarisa…

200 篇论文

The performance of speaker diarization is strongly affected by its clustering algorithm at the test stage. However, it is known that clustering algorithms are sensitive to random noises and small variations, particularly when the clustering…

音频与语音处理 · 电气工程与系统科学 2019-10-25 Meng-Zhen Li , Xiao-Lei Zhang

We propose an algorithm to denoise speakers from a single microphone in the presence of non-stationary and dynamic noise. Our approach is inspired by the recent success of neural network models separating speakers from other speakers and…

声音 · 计算机科学 2018-05-01 Jeff Hetherly , Paul Gamble , Maria Barrios , Cory Stephenson , Karl Ni

In speaker diarisation, speaker embedding extraction models often suffer from the mismatch between their training loss functions and the speaker clustering method. In this paper, we propose the method of spectral clustering-aware learning…

声音 · 计算机科学 2023-03-16 Evonne P. C. Lee , Guangzhi Sun , Chao Zhang , Philip C. Woodland

Though significant progress has been made for the voice conversion (VC) of typical speech, VC for atypical speech, e.g., dysarthric and second-language (L2) speech, remains a challenge, since it involves correcting for atypical prosody…

音频与语音处理 · 电气工程与系统科学 2021-07-26 Disong Wang , Songxiang Liu , Lifa Sun , Xixin Wu , Xunying Liu , Helen Meng

Even though deep speaker models have demonstrated impressive accuracy in speaker verification tasks, this often comes at the expense of increased model size and computation time, presenting challenges for deployment in resource-constrained…

声音 · 计算机科学 2023-12-21 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

In this paper, we propose an online speaker diarization system based on Relation Network, named RenoSD. Unlike conventional diariztion systems which consist of several independently-optimized modules, RenoSD implements…

音频与语音处理 · 电气工程与系统科学 2020-09-22 Xiang Li , Yucheng Zhao , Chong Luo , Wenjun Zeng

This paper describes the ByteDance speaker diarization system for the fourth track of the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). The VoxSRC-21 provides both the dev set and test set of VoxConverse for use in validation and…

声音 · 计算机科学 2021-09-07 Keke Wang , Xudong Mao , Hao Wu , Chen Ding , Chuxiang Shang , Rui Xia , Yuxuan Wang

The classical i-vectors and the latest end-to-end deep speaker embeddings are the two representative categories of utterance-level representations in automatic speaker verification systems. Traditionally, once i-vectors or deep speaker…

音频与语音处理 · 电气工程与系统科学 2018-06-12 Weicheng Cai , Jinkun Chen , Ming Li

Most studies on speaker verification systems focus on long-duration utterances, which are composed of sufficient phonetic information. However, the performances of these systems are known to degrade when short-duration utterances are…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Seung-bin Kim , Jee-weon Jung , Hye-jin Shim , Ju-ho Kim , Ha-Jin Yu

In this paper, we propose a novel algorithm for speaker diarization using metric learning for graph based clustering. The graph clustering algorithms use an adjacency matrix consisting of similarity scores. These scores are computed between…

音频与语音处理 · 电气工程与系统科学 2021-09-15 Prachi Singh , Sriram Ganapathy

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings.…

音频与语音处理 · 电气工程与系统科学 2022-07-14 Weiqing Wang , Qingjian Lin , Ming Li

This paper describes the system developed by the XMUSPEECH team for the Multi-channel Multi-party Meeting Transcription Challenge (M2MeT). For the speaker diarization task, we propose a multi-channel speaker diarization system that obtains…

音频与语音处理 · 电气工程与系统科学 2022-02-14 Jie Wang , Yuji Liu , Binling Wang , Yiming Zhi , Song Li1 , Shipeng Xia , Jiayang Zhang , Lin Li1 , Qingyang Hong , Feng Tong

This paper describes a spatial-aware speaker diarization system for the multi-channel multi-party meeting. The diarization system obtains direction information of speaker by microphone array. Speaker spatial embedding is generated by…

音频与语音处理 · 电气工程与系统科学 2022-09-27 Jie Wang , Yuji Liu , Binling Wang , Yiming Zhi , Song Li , Shipeng Xia , Jiayang Zhang , Feng Tong , Lin Li , Qingyang Hong

This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an…

音频与语音处理 · 电气工程与系统科学 2019-02-27 Koji Okabe , Takafumi Koshinaka , Koichi Shinoda

Deep clustering is a recently introduced deep learning architecture that uses discriminatively trained embeddings as the basis for clustering. It was recently applied to spectrogram segmentation, resulting in impressive results on…

机器学习 · 计算机科学 2016-07-11 Yusuf Isik , Jonathan Le Roux , Zhuo Chen , Shinji Watanabe , John R. Hershey

We address the problem of acoustic source separation in a deep learning framework we call "deep clustering." Rather than directly estimating signals or masking functions, we train a deep network to produce spectrogram embeddings that are…

神经与进化计算 · 计算机科学 2015-08-19 John R. Hershey , Zhuo Chen , Jonathan Le Roux , Shinji Watanabe

We propose a single-channel Deep Cascade Fusion of Diarization and Separation (DCF-DS) framework for back-end automatic speech recognition (ASR), combining neural speaker diarization (NSD) and speech separation (SS). First, we sequentially…

音频与语音处理 · 电气工程与系统科学 2024-12-31 Shu-Tong Niu , Jun Du , Ruo-Yu Wang , Gao-Bin Yang , Tian Gao , Jia Pan , Yu Hu

Many modern systems for speaker diarization, such as the recently-developed VBx approach, rely on clustering of DNN speaker embeddings followed by resegmentation. Two problems with this approach are that the DNN is not directly optimized…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Kiran Karra , Alan McCree

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

声音 · 计算机科学 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

This paper explores three novel approaches to improve the performance of speaker verification (SV) systems based on deep neural networks (DNN) using Multi-head Self-Attention (MSA) mechanisms and memory layers. Firstly, we propose the use…

音频与语音处理 · 电气工程与系统科学 2023-02-13 Victoria Mingote , Antonio Miguel , Alfonso Ortega , Eduardo Lleida