中文
相关论文

相关论文: Discriminative Speaker Representation via Contrast…

200 篇论文

Recently, self-supervised learning (SSL) has demonstrated strong performance in speaker recognition, even if the pre-training objective is designed for speech recognition. In this paper, we study which factor leads to the success of…

计算与语言 · 计算机科学 2022-06-28 Sanyuan Chen , Yu Wu , Chengyi Wang , Shujie Liu , Zhuo Chen , Peidong Wang , Gang Liu , Jinyu Li , Jian Wu , Xiangzhan Yu , Furu Wei

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

声音 · 计算机科学 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

End-to-end Automatic Speech Recognition (ASR) models are usually trained to optimize the loss of the whole token sequence, while neglecting explicit phonemic-granularity supervision. This could result in recognition errors due to…

音频与语音处理 · 电气工程与系统科学 2022-06-22 Li Fu , Xiaoxiao Li , Runyu Wang , Lu Fan , Zhengchen Zhang , Meng Chen , Youzheng Wu , Xiaodong He

Environmental Sound Classification (ESC) is a challenging field of research in non-speech audio processing. Most of current research in ESC focuses on designing deep models with special architectures tailored for specific audio datasets,…

声音 · 计算机科学 2021-03-03 Alireza Nasiri , Jianjun Hu

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification…

音频与语音处理 · 电气工程与系统科学 2021-12-22 Melikasadat Emami , Dung Tran , Kazuhito Koishida

Deep-Neural-Network (DNN) based speaker verification sys-tems use the angular softmax loss with margin penalties toenhance the intra-class compactness of speaker embeddings,which achieved remarkable performance. In this paper, we pro-pose a…

声音 · 计算机科学 2021-06-16 Runqiu Xiao

Contrastive learning has gained significant attention in short text clustering, yet it has an inherent drawback of mistakenly identifying samples from the same category as negatives and then separating them in the feature space (false…

机器学习 · 计算机科学 2026-03-16 Zhihao Yao

Existing contrastive learning methods for anomalous sound detection refine the audio representation of each audio sample by using the contrast between the samples' augmentations (e.g., with time or frequency masking). However, they might be…

声音 · 计算机科学 2023-04-11 Jian Guan , Feiyang Xiao , Youde Liu , Qiaoxi Zhu , Wenwu Wang

Speaker embedding extractors are typically trained using a classification loss over the training speakers. During the last few years, the standard softmax/cross-entropy loss has been replaced by the margin-based losses, yielding significant…

音频与语音处理 · 电气工程与系统科学 2024-06-19 Themos Stafylakis , Anna Silnova , Johan Rohdin , Oldrich Plchot , Lukas Burget

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

Previous deep learning approaches for survival analysis have primarily relied on ranking losses to improve discrimination performance, which often comes at the expense of calibration performance. To address such an issue, we propose a novel…

机器学习 · 计算机科学 2024-11-22 Dongjoon Lee , Hyeryn Park , Changhee Lee

Carrying conversations in multi-sound environments is one of the more challenging tasks, since the sounds overlap across time and frequency making it difficult to understand a single sound source. One proposed approach to help isolate an…

机器学习 · 计算机科学 2024-10-25 Seyed Ali Alavi Bajestan , Mark Pitt , Donald S. Williamson

End-to-end speaker verification systems have received increasing interests. The traditional i-vector approach trains a generative model (basically a factor-analysis model) to extract i-vectors as speaker embeddings. In contrast, the…

音频与语音处理 · 电气工程与系统科学 2018-12-13 Yutian Li , Feng Gao , Zhijian Ou , Jiasong Sun

Lexical difficulty prediction is a fundamental problem in language learning and readability assessment, requiring models to estimate word difficulty across different first-language (L1) backgrounds. However, existing approaches rely on…

This paper presents an experimental study on deep speaker embedding with an attention mechanism that has been found to be a powerful representation learning technique in speaker recognition. In this framework, an attention model works as a…

声音 · 计算机科学 2018-09-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Hitoshi Yamamoto , Takafumi Koshinaka

Recent advances in unsupervised speech representation learning discover new approaches and provide new state-of-the-art for diverse types of speech processing tasks. This paper presents an investigation of using wav2vec 2.0 deep speech…

Recent advances in self-supervised learning through contrastive training have shown that it is possible to learn a competitive speech recognition system with as little as 10 minutes of labeled data. However, these systems are…

音频与语音处理 · 电气工程与系统科学 2021-02-02 Lasse Borgholt , Tycho Max Sylvester Tax , Jakob Drachmann Havtorn , Lars Maaløe , Christian Igel

Contrastive learning, along with its variations, has been a highly effective self-supervised learning method across diverse domains. Contrastive learning measures the distance between representations using cosine similarity and uses…

机器学习 · 计算机科学 2023-10-11 Daniel Rho , TaeSoo Kim , Sooill Park , Jaehyun Park , JaeHan Park

Existing speaker verification (SV) systems often suffer from performance degradation if there is any language mismatch between model training, speaker enrollment, and test. A major cause of this degradation is that most existing SV methods…

声音 · 计算机科学 2017-06-27 Lantian Li , Dong Wang , Askar Rozi , Thomas Fang Zheng