中文
相关论文

相关论文: Training Speaker Embedding Extractors Using Multi-…

200 篇论文

Recent research has delved into speech enhancement (SE) approaches that leverage audio embeddings from pre-trained models, diverging from time-frequency masking or signal prediction techniques. This paper introduces an efficient and…

音频与语音处理 · 电气工程与系统科学 2025-06-16 Xingwei Sun , Heinrich Dinkel , Yadong Niu , Linzhang Wang , Junbo Zhang , Jian Luan

Attractor-based end-to-end diarization is achieving comparable accuracy to the carefully tuned conventional clustering-based methods on challenging datasets. However, the main drawback is that it cannot deal with the case where the number…

音频与语音处理 · 电气工程与系统科学 2021-09-24 Shota Horiguchi , Shinji Watanabe , Paola Garcia , Yawen Xue , Yuki Takashima , Yohei Kawaguchi

We study the usability of pre-trained weakly supervised audio tagging (AT) models as feature extractors for general audio representations. We mainly analyze the feasibility of transferring those embeddings to other tasks within the speech…

声音 · 计算机科学 2022-10-03 Heinrich Dinkel , Zhiyong Yan , Yongqing Wang , Junbo Zhang , Yujun Wang

Distance Metric Learning (DML) has typically dominated the audio-visual speaker verification problem space, owing to strong performance in new and unseen classes. In our work, we explored multitask learning techniques to further enhance…

声音 · 计算机科学 2024-09-25 Anith Selvakumar , Homa Fashandi

This work presents a novel back-end framework for speaker verification using graph attention networks. Segment-wise speaker embeddings extracted from multiple crops within an utterance are interpreted as node representations of a graph. The…

音频与语音处理 · 电气工程与系统科学 2021-02-09 Jee-weon Jung , Hee-Soo Heo , Ha-Jin Yu , Joon Son Chung

Strong representations of target speakers can help extract important information about speakers and detect corresponding temporal regions in multi-speaker conversations. In this study, we propose a neural architecture that simultaneously…

声音 · 计算机科学 2023-06-07 Chin-Yi Cheng , Hung-Shin Lee , Yu Tsao , Hsin-Min Wang

We present a transformer-based architecture for voice separation of a target speaker from multiple other speakers and ambient noise. We achieve this by using two separate neural networks: (A) An enrolment network designed to craft…

音频与语音处理 · 电气工程与系统科学 2025-01-03 Akam Rahimi , Triantafyllos Afouras , Andrew Zisserman

Significant progress has recently been made in speaker diarisation after the introduction of d-vectors as speaker embeddings extracted from neural network (NN) speaker classifiers for clustering speech segments. To extract better-performing…

声音 · 计算机科学 2021-05-10 Guangzhi Sun , Chao Zhang , Phil Woodland

The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Pooyan Safari , Miquel India , Javier Hernando

We study a novel neural architecture and its training strategies of speaker encoder for speaker recognition without using any identity labels. The speaker encoder is trained to extract a fixed-size speaker embedding from a spoken utterance…

音频与语音处理 · 电气工程与系统科学 2022-10-28 Ruijie Tao , Kong Aik Lee , Rohan Kumar Das , Ville Hautamäki , Haizhou Li

In this study, we focus on nonlinear compression methods in spectral features for speaker verification based on deep neural network. We consider different kinds of channel-dependent (CD) nonlinear compression methods optimized in a…

声音 · 计算机科学 2022-02-11 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

This paper explores applying the wav2vec2 framework to speaker recognition instead of speech recognition. We study the effectiveness of the pre-trained weights on the speaker recognition task, and how to pool the wav2vec2 output sequence…

声音 · 计算机科学 2022-05-09 Nik Vaessen , David A. van Leeuwen

State-of-the-art text-independent speaker verification systems typically use cepstral features or filter bank energies as speech features. Recent studies attempted to extract speaker embeddings directly from raw waveforms and have shown…

音频与语音处理 · 电气工程与系统科学 2021-06-10 Ge Zhu , Fei Jiang , Zhiyao Duan

Neural models, in particular the d-vector and x-vector architectures, have produced state-of-the-art performance on many speaker verification tasks. However, two potential problems of these neural models deserve more investigation. Firstly,…

音频与语音处理 · 电气工程与系统科学 2019-02-19 Lantian Li , Zhiyuan Tang , Ying Shi , Dong Wang

In this paper, we address the problem of speaker recognition in challenging acoustic conditions using a novel method to extract robust speaker-discriminative speech representations. We adopt a recently proposed unsupervised adversarial…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Raghuveer Peri , Monisankha Pal , Arindam Jati , Krishna Somandepalli , Shrikanth Narayanan

Although deep neural networks are successful for many tasks in the speech domain, the high computational and memory costs of deep neural networks make it difficult to directly deploy highperformance Neural Network systems on low-resource…

声音 · 计算机科学 2021-04-07 Tinglong Zhu , Xiaoyi Qin , Ming Li

Speaker verification is an established yet challenging task in speech processing and a very vibrant research area. Recent speaker verification (SV) systems rely on deep neural networks to extract high-level embeddings which are able to…

音频与语音处理 · 电气工程与系统科学 2020-03-23 Fei Tao , Gokhan Tur

State-of-the-art Deep Learning systems for speaker verification are commonly based on speaker embedding extractors. These architectures are usually composed of a feature extractor front-end together with a pooling layer to encode…

音频与语音处理 · 电气工程与系统科学 2024-05-08 Federico Costa , Miquel India , Javier Hernando

We present a novel source separation model to decompose asingle-channel speech signal into two speech segments belonging to two different speakers. The proposed model is a neural network based on residual blocks, and uses learnt speaker…

声音 · 计算机科学 2019-06-25 Shuo Liu , Gil Keren , Björn Schuller

Speaker identification systems are deployed in diverse environments, often different from the lab conditions on which they are trained and tested. In this paper, first, we show the problem of generalization using fixed thresholds (computed…

音频与语音处理 · 电气工程与系统科学 2023-10-03 Ashutosh Chaubey , Sparsh Sinha , Susmita Ghose