中文
相关论文

相关论文: Serialized Multi-Layer Multi-Head Attention for Ne…

200 篇论文

This paper proposes a novel unsupervised autoregressive neural model for learning generic speech representations. In contrast to other speech representation learning methods that aim to remove noise or speaker variabilities, ours is…

计算与语言 · 计算机科学 2019-06-20 Yu-An Chung , Wei-Ning Hsu , Hao Tang , James Glass

This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention. Instead of using a vector, we use a 2-D matrix to represent the embedding, with each row of the matrix attending on a…

计算与语言 · 计算机科学 2017-03-10 Zhouhan Lin , Minwei Feng , Cicero Nogueira dos Santos , Mo Yu , Bing Xiang , Bowen Zhou , Yoshua Bengio

Deep speaker embeddings have become the leading method for encoding speaker identity in speaker recognition tasks. The embedding space should ideally capture the variations between all possible speakers, encoding the multiple acoustic…

声音 · 计算机科学 2021-04-26 Chau Luu , Peter Bell , Steve Renals

Recently, hyperspherical embeddings have established themselves as a dominant technique for face and voice recognition. Specifically, Euclidean space vector embeddings are learned to encode person-specific information in their direction…

音频与语音处理 · 电气工程与系统科学 2022-10-25 Nikita Kuzmin , Igor Fedorov , Alexey Sholokhov

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy…

音频与语音处理 · 电气工程与系统科学 2019-06-19 Xu Xiang , Shuai Wang , Houjun Huang , Yanmin Qian , Kai Yu

The Transformer architecture model, based on self-attention and multi-head attention, has achieved remarkable success in offline end-to-end Automatic Speech Recognition (ASR). However, self-attention and multi-head attention cannot be…

计算与语言 · 计算机科学 2022-10-03 Chendong Zhao , Jianzong Wang , Wen qi Wei , Xiaoyang Qu , Haoqian Wang , Jing Xiao

The target speech extraction has attracted widespread attention in recent years. In this work, we focus on investigating the dynamic interaction between different mixtures and the target speaker to exploit the discriminative target speaker…

音频与语音处理 · 电气工程与系统科学 2021-10-20 Jiangyu Han , Wei Rao , Yanhua Long , Jiaen Liang

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Wayner Barrios , SouYoung Jin

In many real-world scenarios, such as meetings, multiple speakers are present with an unknown number of participants, and their utterances often overlap. We address these multi-speaker challenges by a novel attention-based encoder-decoder…

计算与语言 · 计算机科学 2024-09-25 Yosuke Kashiwagi , Hayato Futami , Emiru Tsunoo , Siddhant Arora , Shinji Watanabe

This study investigates the explainability of embedding representations, specifically those used in modern audio spoofing detection systems based on deep neural networks, known as spoof embeddings. Building on established work in speaker…

声音 · 计算机科学 2024-12-25 Xuechen Liu , Junichi Yamagishi , Md Sahidullah , Tomi kinnunen

Training speaker-discriminative and robust speaker verification systems without explicit speaker labels remains a persistent challenge. In this paper, we propose a novel self-supervised speaker verification approach, Self-Distillation…

音频与语音处理 · 电气工程与系统科学 2024-12-30 Yafeng Chen , Siqi Zheng , Hui Wang , Luyao Cheng , Qian Chen , Chong Deng , Shiliang Zhang , Wen Wang

Since the first speech recognition systems were built more than 30 years ago, improvement in voice technology has enabled applications such as smart assistants and automated customer support. However, conversation intelligence of the future…

音频与语音处理 · 电气工程与系统科学 2024-02-15 Desh Raj

Verifying the identity of a speaker is crucial in modern human-machine interfaces, e.g., to ensure privacy protection or to enable biometric authentication. Classical speaker verification (SV) approaches estimate a fixed-dimensional…

音频与语音处理 · 电气工程与系统科学 2022-06-29 Ahmad Aloradi , Wolfgang Mack , Mohamed Elminshawi , Emanuël A. P. Habets

End-to-end speaker diarization approaches have shown exceptional performance over the traditional modular approaches. To further improve the performance of the end-to-end speaker diarization for real speech recordings, recently works have…

声音 · 计算机科学 2022-04-19 Chenyu Yang , Yu Wang

Speaker verification is an established yet challenging task in speech processing and a very vibrant research area. Recent speaker verification (SV) systems rely on deep neural networks to extract high-level embeddings which are able to…

音频与语音处理 · 电气工程与系统科学 2020-03-23 Fei Tao , Gokhan Tur

Significant progress has recently been made in speaker diarisation after the introduction of d-vectors as speaker embeddings extracted from neural network (NN) speaker classifiers for clustering speech segments. To extract better-performing…

声音 · 计算机科学 2021-05-10 Guangzhi Sun , Chao Zhang , Phil Woodland

Single channel target speaker separation (TSS) aims at extracting a speaker's voice from a mixture of multiple talkers given an enrollment utterance of that speaker. A typical deep learning TSS framework consists of an upstream model that…

声音 · 计算机科学 2022-10-27 Xiaoyu Liu , Xu Li , Joan Serrà

Multilingual speaker verification introduces the challenge of verifying a speaker in multiple languages. Existing systems were built using i-vector/x-vector approaches along with Bi-LSTMs, which were trained to discriminate speakers,…

声音 · 计算机科学 2024-08-09 Aravinda Reddy PN , Raghavendra Ramachandra , K. Sreenivasa Rao , Pabitra Mitra

Sequential recommendation models have achieved state-of-the-art performance using self-attention mechanism. It has since been found that moving beyond only using item ID and positional embeddings leads to a significant accuracy boost when…

信息检索 · 计算机科学 2024-09-10 Linsey Pang , Amir Hossein Raffiee , Wei Liu , Keld Lundgaard

This paper proposes a neural network based speech separation method using spatially distributed microphones. Unlike with traditional microphone array settings, neither the number of microphones nor their spatial arrangement is known in…

音频与语音处理 · 电气工程与系统科学 2020-05-01 Dongmei Wang , Zhuo Chen , Takuya Yoshioka