中文
相关论文

相关论文: Probing Deep Speaker Embeddings for Speaker-relate…

200 篇论文

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

音频与语音处理 · 电气工程与系统科学 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

声音 · 计算机科学 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

Speaker tracking methods often rely on spatial observations to assign coherent track identities over time. This raises limits in scenarios with intermittent and moving speakers, i.e., speakers that may change position when they are…

音频与语音处理 · 电气工程与系统科学 2025-06-26 Taous Iatariene , Can Cui , Alexandre Guérin , Romain Serizel

In spite of the impressive success of convolutional neural networks (CNNs) in speaker recognition, our understanding to CNNs' internal functions is still limited. A major obstacle is that some popular visualization tools are difficult to…

声音 · 计算机科学 2022-04-13 Pengqi Li , Lantian Li , Askar Hamdulla , Dong Wang

Modern automatic speaker verification relies largely on deep neural networks (DNNs) trained on mel-frequency cepstral coefficient (MFCC) features. While there are alternative feature extraction methods based on phase, prosody and long-term…

音频与语音处理 · 电气工程与系统科学 2020-07-31 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

Recent advancements in speaker verification techniques show promise, but their performance often deteriorates significantly in challenging acoustic environments. Although speech enhancement methods can improve perceived audio quality, they…

音频与语音处理 · 电气工程与系统科学 2025-08-27 Adam Katav , Yair Moshe , Israel Cohen

The task of video-to-speech aims to translate silent video of lip movement to its corresponding audio signal. Previous approaches to this task are generally limited to the case of a single speaker, but a method that accounts for multiple…

音频与语音处理 · 电气工程与系统科学 2021-05-21 Dan Oneata , Adriana Stan , Horia Cucu

The classical i-vectors and the latest end-to-end deep speaker embeddings are the two representative categories of utterance-level representations in automatic speaker verification systems. Traditionally, once i-vectors or deep speaker…

音频与语音处理 · 电气工程与系统科学 2018-06-12 Weicheng Cai , Jinkun Chen , Ming Li

Speaker embeddings extracted with deep 2D convolutional neural networks are typically modeled as projections of first and second order statistics of channel-frequency pairs onto a linear layer, using either average or attentive pooling…

音频与语音处理 · 电气工程与系统科学 2021-07-08 Themos Stafylakis , Johan Rohdin , Lukas Burget

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

In this paper, we apply the variational information bottleneck approach to end-to-end neural diarization with encoder-decoder attractors (EEND-EDA). This allows us to investigate what information is essential for the model. EEND-EDA…

声音 · 计算机科学 2024-06-21 Lin Zhang , Themos Stafylakis , Federico Landini , Mireia Diez , Anna Silnova , Lukáš Burget

End-to-end training of deep learning-based models allows for implicit learning of intermediate representations based on the final task loss. However, the end-to-end approach ignores the useful domain knowledge encoded in explicit…

计算与语言 · 计算机科学 2017-04-20 Shubham Toshniwal , Hao Tang , Liang Lu , Karen Livescu

This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an…

音频与语音处理 · 电气工程与系统科学 2019-02-27 Koji Okabe , Takafumi Koshinaka , Koichi Shinoda

In forensic voice comparison the speaker embedding has become widely popular in the last 10 years. Most of the pretrained speaker embeddings are trained on English corpora, because it is easily accessible. Thus, language dependency can be…

声音 · 计算机科学 2023-04-12 Dávid Sztahó , Attila Fejes

The conventional speaker recognition frameworks (e.g., the i-vector and CNN-based approach) have been successfully applied to various tasks when the channel of the enrolment dataset is similar to that of the test dataset. However, in…

音频与语音处理 · 电气工程与系统科学 2019-02-26 Xin Fang , Liang Zou , Jin Li , Lei Sun , Zhen-Hua Ling

Recently deep neural networks (DNNs) have been used to learn speaker features. However, the quality of the learned features is not sufficiently good, so a complex back-end model, either neural or probabilistic, has to be used to address the…

声音 · 计算机科学 2017-05-11 Lantian Li , Yixiang Chen , Ying Shi , Zhiyuan Tang , Dong Wang

Recent speaker verification (SV) systems have shown a trend toward adopting deeper speaker embedding extractors. Although deeper and larger neural networks can significantly improve performance, their substantial memory requirements hinder…

音频与语音处理 · 电气工程与系统科学 2024-12-03 Bei Liu , Yanmin Qian

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. In this paper, a hierarchical attention network is proposed to solve a weakly labelled speaker identification problem. The use of…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

This paper proposes a human-in-the-loop speaker-adaptation method for multi-speaker text-to-speech. With a conventional speaker-adaptation method, a target speaker's embedding vector is extracted from his/her reference speech using a…

声音 · 计算机科学 2022-06-22 Kenta Udagawa , Yuki Saito , Hiroshi Saruwatari

For many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications. However, mirroring the rise of deep learning in various domains, neural network based audio…

音频与语音处理 · 电气工程与系统科学 2022-01-25 Quan Wang , Carlton Downey , Li Wan , Philip Andrew Mansfield , Ignacio Lopez Moreno