English
Related papers

Related papers: Experimenting with Additive Margins for Contrastiv…

200 papers

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

Sound · Computer Science 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

Contrastive learning, along with its variations, has been a highly effective self-supervised learning method across diverse domains. Contrastive learning measures the distance between representations using cosine similarity and uses…

Machine Learning · Computer Science 2023-10-11 Daniel Rho , TaeSoo Kim , Sooill Park , Jaehyun Park , JaeHan Park

Standard contrastive learning approaches usually require a large number of negatives for effective unsupervised learning and often exhibit slow convergence. We suspect this behavior is due to the suboptimal selection of negatives used for…

Machine Learning · Computer Science 2021-12-22 Anshul Shah , Suvrit Sra , Rama Chellappa , Anoop Cherian

Speaker embedding extractors are typically trained using a classification loss over the training speakers. During the last few years, the standard softmax/cross-entropy loss has been replaced by the margin-based losses, yielding significant…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Themos Stafylakis , Anna Silnova , Johan Rohdin , Oldrich Plchot , Lukas Burget

In this paper, we propose a novel auxiliary loss function for target-speaker automatic speech recognition (ASR). Our method automatically extracts and transcribes target speaker's utterances from a monaural mixture of multiple speakers…

Computation and Language · Computer Science 2019-06-27 Naoyuki Kanda , Shota Horiguchi , Ryoichi Takashima , Yusuke Fujita , Kenji Nagamatsu , Shinji Watanabe

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

Sound · Computer Science 2026-05-13 Adam Wynn , Jingyun Wang

A reliable voice anti-spoofing countermeasure system needs to robustly protect automatic speaker verification (ASV) systems in various kinds of spoofing scenarios. However, the performance of countermeasure systems could be degraded by…

Sound · Computer Science 2022-11-15 Yikang Wang , Xingming Wang , Hiromitsu Nishizaki , Ming Li

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

Speaker verification systems often degrade significantly when there is a language mismatch between training and testing data. Being able to improve cross-lingual speaker verification system using unlabeled data can greatly increase the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-03 Wei Xia , Jing Huang , John H. L. Hansen

In speaker verification, contrastive learning is gaining popularity as an alternative to the traditionally used classification-based approaches. Contrastive methods can benefit from an effective use of hard negative pairs, which are…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Piotr Masztalski , Michał Romaniuk , Jakub Żak , Mateusz Matuszewski , Konrad Kowalczyk

The performances of the automatic speaker verification (ASV) systems degrade due to the reduction in the amount of speech used for enrollment and verification. Combining multiple systems based on different features and classifiers…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Arnab Poddar , Md Sahidullah , Goutam Saha

The goal of self-supervised learning (SSL) for automatic speech recognition (ASR) is to learn good speech representations from a large amount of unlabeled speech for the downstream ASR task. However, most SSL frameworks do not consider…

Computation and Language · Computer Science 2022-01-27 Yiming Wang , Jinyu Li , Heming Wang , Yao Qian , Chengyi Wang , Yu Wu

Contrastive speaker embedding assumes that the contrast between the positive and negative pairs of speech segments is attributed to speaker identity only. However, this assumption is incorrect because speech signals contain not only speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-26 Youzhi Tu , Man-Wai Mak , Jen-Tzung Chien

Research in the past several years has boosted the performance of automatic speaker verification systems and countermeasure systems to deliver low Equal Error Rates (EERs) on each system. However, research on joint optimization of both…

Sound · Computer Science 2022-03-28 Zhongwei Teng , Quchen Fu , Jules White , Maria E. Powell , Douglas C. Schmidt

This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-27 Koji Okabe , Takafumi Koshinaka , Koichi Shinoda

Recently, a popular line of research in face recognition is adopting margins in the well-established softmax loss function to maximize class separability. In this paper, we first introduce an Additive Angular Margin Loss (ArcFace), which…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Jiankang Deng , Jia Guo , Jing Yang , Niannan Xue , Irene Kotsia , Stefanos Zafeiriou

Conventional semi-supervised contrastive learning methods assign pseudo-labels only to samples whose highest predicted class probability exceeds a predefined threshold, and then perform supervised contrastive learning using those selected…

Machine Learning · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

The performance of spoofing countermeasure systems depends fundamentally upon the use of sufficiently representative training data. With this usually being limited, current solutions typically lack generalisation to attacks encountered in…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Hemlata Tak , Massimiliano Todisco , Xin Wang , Jee-weon Jung , Junichi Yamagishi , Nicholas Evans

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Open-set speaker recognition can be regarded as a metric learning problem, which is to maximize inter-class variance and minimize intra-class variance. Supervised metric learning can be categorized into entity-based learning and proxy-based…

Sound · Computer Science 2021-09-07 Jiachen Lian , Aiswarya Vinod Kumar , Hira Dhamyal , Bhiksha Raj , Rita Singh