English
Related papers

Related papers: Experimenting with Additive Margins for Contrastiv…

200 papers

Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled…

Computation and Language · Computer Science 2025-02-25 Bulat Khaertdinov , Pedro Jeuris , Annanda Sousa , Enrique Hortal

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

In this paper, we perform an in-depth study of how data augmentation techniques improve synthetic or spoofed audio detection. Specifically, we propose methods to deal with channel variability, different audio compressions, different…

Sound · Computer Science 2021-10-22 Ariel Cohen , Inbal Rimon , Eran Aflalo , Haim Permuter

Our prior experiments show that humans and machines seem to employ different approaches to speaker discrimination, especially in the presence of speaking style variability. The experiments examined read versus conversational speech.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 Amber Afshan , Abeer Alwan

Anti-spoofing for automatic speaker verification is now a well established area of research, with three competitive challenges having been held in the last 6 years. A great deal of research effort over this time has been invested into the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Hemlata Tak , Jose Patino , Andreas Nautsch , Nicholas Evans , Massimiliano Todisco

Recent developments in Self-Supervised Learning (SSL) have demonstrated significant potential for Speaker Verification (SV), but closing the performance gap with supervised systems remains an ongoing challenge. SSL frameworks rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-28 Theo Lepage , Reda Dehak

Speaker verification can be formulated as a representation learning task, where speaker-discriminative embeddings are extracted from utterances of variable lengths. Momentum Contrast (MoCo) is a recently proposed unsupervised representation…

Computation and Language · Computer Science 2020-09-08 Ke Ding , Xuanji He , Guanglu Wan

Considering the abundance of unlabeled speech data and the high labeling costs, unsupervised learning methods can be essential for better system development. One of the most successful methods is contrastive self-supervised methods, which…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-11 Jaejin Cho , Raghavendra Pappagari , Piotr Żelasko , Laureano Moro-Velazquez , Jesús Villalba , Najim Dehak

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

Sound · Computer Science 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

This paper describes our submitted systems to the ASVspoof 5 Challenge Track 1: Speech Deepfake Detection - Open Condition, which consists of a stand-alone speech deepfake (bonafide vs spoof) detection task. Recently, large-scale…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Theophile Stourbe , Victor Miara , Theo Lepage , Reda Dehak

Self-supervised learning (SSL) for automated speech recognition in terms of its emotional content, can be heavily degraded by the presence noise, affecting the efficiency of modeling the intricate temporal and spectral informative…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-13 Ioannis Ziogas , Hessa Alfalahi , Ahsan H. Khandoker , Leontios J. Hadjileontiadis

In this work, we study the features extracted by English self-supervised learning (SSL) models in cross-lingual contexts and propose a new metric to predict the quality of feature representations. Using automatic speech recognition (ASR) as…

Computation and Language · Computer Science 2023-11-28 Shuyue Stella Li , Beining Xu , Xiangyu Zhang , Hexin Liu , Wenhan Chao , Leibny Paola Garcia

Vocoder models have recently achieved substantial progress in generating authentic audio comparable to human quality while significantly reducing memory requirement and inference time. However, these data-hungry generative models require…

Sound · Computer Science 2023-12-19 Haoming Guo , Seth Z. Zhao , Jiachen Lian , Gopala Anumanchipalli , Gerald Friedland

Neural network based speech recognition systems suffer from performance degradation due to accented speech, especially unfamiliar accents. In this paper, we study the supervised contrastive learning framework for accented speech…

Sound · Computer Science 2021-07-05 Tao Han , Hantao Huang , Ziang Yang , Wei Han

One of the most important parts of an end-to-end speaker verification system is the speaker embedding generation. In our previous paper, we reported that shortcut connections-based multi-layer aggregation improves the representational power…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Soonshin Seo , Ji-Hwan Kim

Deepfake speech detection presents a growing challenge as generative audio technologies continue to advance. We propose a hybrid training framework that advances detection performance through novel augmentation strategies. First, we…

Sound · Computer Science 2025-11-14 Inbal Rimon , Oren Gal , Haim Permuter

Automatic speaker verification (ASV) systems use a playback detector to filter out playback attacks and ensure verification reliability. Since current playback detection models are almost always trained using genuine and played-back speech,…

Sound · Computer Science 2018-09-14 Fuming Fang , Junichi Yamagishi , Isao Echizen , Md Sahidullah , Tomi Kinnunen

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-22 Melikasadat Emami , Dung Tran , Kazuhito Koishida

Contrastive representation learning has been outstandingly successful in practice. In this work, we identify two key properties related to the contrastive loss: (1) alignment (closeness) of features from positive pairs, and (2) uniformity…

Machine Learning · Computer Science 2022-08-17 Tongzhou Wang , Phillip Isola

In this study, we focus on nonlinear compression methods in spectral features for speaker verification based on deep neural network. We consider different kinds of channel-dependent (CD) nonlinear compression methods optimized in a…

Sound · Computer Science 2022-02-11 Xuechen Liu , Md Sahidullah , Tomi Kinnunen