中文
相关论文

相关论文: Leveraging ASR Pretrained Conformers for Speaker V…

200 篇论文

Many existing works on voice conversion (VC) tasks use automatic speech recognition (ASR) models for ensuring linguistic consistency between source and converted samples. However, for the low-data resource domains, training a high-quality…

声音 · 计算机科学 2023-05-25 Mayank Kumar Singh , Naoya Takahashi , Onoe Naoyuki

Conformer has achieved impressive results in Automatic Speech Recognition (ASR) by leveraging transformer's capturing of content-based global interactions and convolutional neural network's exploiting of local features. In Conformer, two…

计算与语言 · 计算机科学 2022-09-02 Xianchao Wu

An embedding-based speaker adaptive training (SAT) approach is proposed and investigated in this paper for deep neural network acoustic modeling. In this approach, speaker embedding vectors, which are a constant given a particular speaker,…

计算与语言 · 计算机科学 2017-10-20 Xiaodong Cui , Vaibhava Goel , George Saon

In this paper, Whisper, a large-scale pre-trained model for automatic speech recognition, is proposed to apply to speaker verification. A partial multi-scale feature aggregation (PMFA) approach is proposed based on a subset of Whisper…

声音 · 计算机科学 2024-08-29 Yiyang Zhao , Shuai Wang , Guangzhi Sun , Zehua Chen , Chao Zhang , Mingxing Xu , Thomas Fang Zheng

We propose a self-speaker adaptation method for streaming multi-talker automatic speech recognition (ASR) that eliminates the need for explicit speaker queries. Unlike conventional approaches requiring target speaker embeddings or…

音频与语音处理 · 电气工程与系统科学 2025-09-03 Weiqing Wang , Taejin Park , Ivan Medennikov , Jinhan Wang , Kunal Dhawan , He Huang , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

This paper contains a post-challenge performance analysis on cross-lingual speaker verification of the IDLab submission to the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). We show that current speaker embedding extractors…

音频与语音处理 · 电气工程与系统科学 2022-06-22 Jenthe Thienpondt , Brecht Desplanques , Kris Demuynck

In this paper we propose a new method of speaker diarization that employs a deep learning architecture to learn speaker embeddings. In contrast to the traditional approaches that build their speaker embeddings using manually hand-crafted…

声音 · 计算机科学 2017-09-18 Pawel Cyrta , Tomasz Trzciński , Wojciech Stokowiec

In the domain of air traffic control (ATC) systems, efforts to train a practical automatic speech recognition (ASR) model always faces the problem of small training samples since the collection and annotation of speech samples are expert-…

声音 · 计算机科学 2021-02-17 Yi Lin , Qin Li , Bo Yang , Zhen Yan , Huachun Tan , Zhengmao Chen

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

Speaker recognition technology is applied to various tasks, from personal virtual assistants to secure access systems. However, the robustness of these systems against adversarial attacks, particularly to additive perturbations, remains a…

声音 · 计算机科学 2024-12-19 Dmitrii Korzh , Elvir Karimov , Mikhail Pautov , Oleg Y. Rogov , Ivan Oseledets

Self-supervised pre-training is an effective approach to leveraging a large amount of unlabelled data to reduce word error rates (WERs) of automatic speech recognition (ASR) systems. Since it is impractical to use large pre-trained models…

音频与语音处理 · 电气工程与系统科学 2022-03-03 Xiaoyu Yang , Qiujia Li , Philip C. Woodland

We present a demo of DQLoRA, an Adapter-Guided Distillation framework for robust speech recognition under low-resource and noisy conditions. Our method employs a frozen Whisper model as the teacher to provide semantic supervision, and a…

声音 · 计算机科学 2025-07-15 Yiru Yang

Speaker identification systems in a real-world scenario are tasked to identify a speaker amongst a set of enrolled speakers given just a few samples for each enrolled speaker. This paper demonstrates the effectiveness of meta-learning and…

音频与语音处理 · 电气工程与系统科学 2022-07-25 Ashutosh Chaubey , Sparsh Sinha , Susmita Ghose

Adaptive S-norm (AS-norm) calibrates automatic speaker verification (ASV) scores by normalizing them utilize the scores of impostors which are similar to the input speaker. However, AS-norm does not involve any learning process, limiting…

音频与语音处理 · 电气工程与系统科学 2025-04-08 Jeong-Hwan Choi , Ju-Seok Seong , Ye-Rin Jeoung , Joon-Hyuk Chang

A targeted adversarial attack produces audio samples that can force an Automatic Speech Recognition (ASR) system to output attacker-chosen text. To exploit ASR models in real-world, black-box settings, an adversary can leverage the…

机器学习 · 计算机科学 2022-09-30 Raphael Olivier , Hadi Abdullah , Bhiksha Raj

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To…

音频与语音处理 · 电气工程与系统科学 2021-09-17 Li Fu , Xiaoxiao Li , Libo Zi , Zhengchen Zhang , Youzheng Wu , Xiaodong He , Bowen Zhou

Even though deep speaker models have demonstrated impressive accuracy in speaker verification tasks, this often comes at the expense of increased model size and computation time, presenting challenges for deployment in resource-constrained…

声音 · 计算机科学 2023-12-21 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

Automatic speech recognition (ASR) has progressed significantly in recent years due to the emergence of large-scale datasets and the self-supervised learning (SSL) paradigm. However, as its counterpart problem in the singing domain, the…

音频与语音处理 · 电气工程与系统科学 2022-10-18 Longshen Ou , Xiangming Gu , Ye Wang

Automatic speech recognition (ASR) systems developed in recent years have shown promising results with self-attention models (e.g., Transformer and Conformer), which are replacing conventional recurrent neural networks. Meanwhile, a…

声音 · 计算机科学 2022-11-01 Koichi Miyazaki , Masato Murata , Tomoki Koriyama