English
Related papers

Related papers: Pushing the limits of self-supervised speaker veri…

200 papers

Recently, the attention mechanism such as squeeze-and-excitation module (SE) and convolutional block attention module (CBAM) has achieved great success in deep learning-based speaker verification system. This paper introduces an alternative…

Sound · Computer Science 2021-10-14 Xiaoyi Qin , Na Li , Chao Weng , Dan Su , Ming Li

Self-supervised speech representation learning enables the extraction of meaningful features from raw waveforms. These features can then be efficiently used across multiple downstream tasks. However, two significant issues arise when…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-14 Heitor R. Guimarães , Arthur Pimentel , Anderson R. Avila , Mehdi Rezagholizadeh , Boxing Chen , Tiago H. Falk

In this paper, we demonstrate a method for training speaker embedding extractors using weak annotation. More specifically, we are using the full VoxCeleb recordings and the name of the celebrities appearing on each video without knowledge…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-10 Themos Stafylakis , Ladislav Mošner , Oldřich Plchot , Johan Rohdin , Anna Silnova , Lukáš Burget , Jan "Honza'' Černocký

This paper presents a computationally efficient and distributed speaker diarization framework for networked IoT-style audio devices. The work proposes a Federated Learning model which can identify the participants in a conversation without…

Sound · Computer Science 2024-12-02 Amit Kumar Bhuyan , Hrishikesh Dutta , Subir Biswas

Self-supervised learning models have been shown to learn rich visual representations without requiring human annotations. However, in many real-world scenarios, labels are partially available, motivating a recent line of work on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Enrico Fini , Pietro Astolfi , Karteek Alahari , Xavier Alameda-Pineda , Julien Mairal , Moin Nabi , Elisa Ricci

As the size of pre-trained speech recognition models increases, running these large models in low-latency or resource-constrained environments becomes challenging. In this work, we leverage pseudo-labelling to assemble a large-scale…

Computation and Language · Computer Science 2023-11-02 Sanchit Gandhi , Patrick von Platen , Alexander M. Rush

Even though deep speaker models have demonstrated impressive accuracy in speaker verification tasks, this often comes at the expense of increased model size and computation time, presenting challenges for deployment in resource-constrained…

Sound · Computer Science 2023-12-21 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

Background noise considerably reduces the accuracy and reliability of speaker verification (SV) systems. These challenges can be addressed using a speech enhancement system as a front-end module. Recently, diffusion probabilistic models…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-20 Ju-ho Kim , Jungwoo Heo , Hyun-seo Shin , Chan-yeong Lim , Ha-Jin Yu

Is self-supervised deep learning (DL) for medical image analysis already a serious alternative to the de facto standard of end-to-end trained supervised DL? We tackle this question for medical image classification, with a particular focus…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Maximilian Nielsen , Laura Wenderoth , Thilo Sentker , René Werner

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

Sound · Computer Science 2026-05-13 Adam Wynn , Jingyun Wang

Automatic Speaker Verification (ASV) suffers from performance degradation in noisy conditions. To address this issue, we propose a novel adversarial learning framework that incorporates noise-disentanglement to establish a noise-independent…

Sound · Computer Science 2024-09-27 Xujiang Xing , Mingxing Xu , Thomas Fang Zheng

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Training AI models to understand images without costly labeled data remains a challenge. We combine two techniques--DINO (teacher-student learning) and Barlow Twins (redundancy reduction)--to create a model that learns better with fewer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Michael Podsiadly , Brendon K Lay

Learning from noisy data has become essential for adapting deep learning models to real-world applications. Traditional methods often involve first evaluating the noise and then applying strategies such as discarding noisy samples,…

Machine Learning · Computer Science 2024-11-27 Lechao Cheng , Kaifeng Chen , Jiyang Li , Shengeng Tang , Shufei Zhang , Meng Wang

In recent years, using raw waveforms as input for deep networks has been widely explored for the speaker verification system. For example, RawNet and RawNet2 extracted speaker's feature embeddings from waveforms automatically for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Jin Li , Nan Yan , Lan Wang

Large language models are increasingly post-trained with reinforcement learning in verifiable domains such as code and math. Yet, current methods for reinforcement learning with verifiable rewards (RLVR) learn only from a scalar outcome…

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

Sound · Computer Science 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung

Incremental improvements in accuracy of Convolutional Neural Networks are usually achieved through use of deeper and more complex models trained on larger datasets. However, enlarging dataset and models increases the computation and storage…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-24 Mahdi Hajibabaei , Dengxin Dai

While large audio language models excel at tasks like ASR and emotion recognition, they still struggle with complex reasoning due to the modality gap between audio and text as well as the lack of structured intermediate supervision. To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Runyan Yang , Yuke Si , Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Although deep learning-based computer-aided diagnosis systems have recently achieved expert-level performance, developing a robust deep learning model requires large, high-quality data with manual annotation, which is expensive to obtain.…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Sangjoon Park , Gwanghyun Kim , Yujin Oh , Joon Beom Seo , Sang Min Lee , Jin Hwan Kim , Sungjun Moon , Jae-Kwang Lim , Chang Min Park , Jong Chul Ye