中文
相关论文

相关论文: Pushing the limits of self-supervised speaker veri…

200 篇论文

Recently, the attention mechanism such as squeeze-and-excitation module (SE) and convolutional block attention module (CBAM) has achieved great success in deep learning-based speaker verification system. This paper introduces an alternative…

声音 · 计算机科学 2021-10-14 Xiaoyi Qin , Na Li , Chao Weng , Dan Su , Ming Li

Self-supervised speech representation learning enables the extraction of meaningful features from raw waveforms. These features can then be efficiently used across multiple downstream tasks. However, two significant issues arise when…

音频与语音处理 · 电气工程与系统科学 2024-03-14 Heitor R. Guimarães , Arthur Pimentel , Anderson R. Avila , Mehdi Rezagholizadeh , Boxing Chen , Tiago H. Falk

In this paper, we demonstrate a method for training speaker embedding extractors using weak annotation. More specifically, we are using the full VoxCeleb recordings and the name of the celebrities appearing on each video without knowledge…

音频与语音处理 · 电气工程与系统科学 2022-08-10 Themos Stafylakis , Ladislav Mošner , Oldřich Plchot , Johan Rohdin , Anna Silnova , Lukáš Burget , Jan "Honza'' Černocký

This paper presents a computationally efficient and distributed speaker diarization framework for networked IoT-style audio devices. The work proposes a Federated Learning model which can identify the participants in a conversation without…

声音 · 计算机科学 2024-12-02 Amit Kumar Bhuyan , Hrishikesh Dutta , Subir Biswas

Self-supervised learning models have been shown to learn rich visual representations without requiring human annotations. However, in many real-world scenarios, labels are partially available, motivating a recent line of work on…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Enrico Fini , Pietro Astolfi , Karteek Alahari , Xavier Alameda-Pineda , Julien Mairal , Moin Nabi , Elisa Ricci

As the size of pre-trained speech recognition models increases, running these large models in low-latency or resource-constrained environments becomes challenging. In this work, we leverage pseudo-labelling to assemble a large-scale…

计算与语言 · 计算机科学 2023-11-02 Sanchit Gandhi , Patrick von Platen , Alexander M. Rush

Even though deep speaker models have demonstrated impressive accuracy in speaker verification tasks, this often comes at the expense of increased model size and computation time, presenting challenges for deployment in resource-constrained…

声音 · 计算机科学 2023-12-21 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

Background noise considerably reduces the accuracy and reliability of speaker verification (SV) systems. These challenges can be addressed using a speech enhancement system as a front-end module. Recently, diffusion probabilistic models…

音频与语音处理 · 电气工程与系统科学 2023-12-20 Ju-ho Kim , Jungwoo Heo , Hyun-seo Shin , Chan-yeong Lim , Ha-Jin Yu

Is self-supervised deep learning (DL) for medical image analysis already a serious alternative to the de facto standard of end-to-end trained supervised DL? We tackle this question for medical image classification, with a particular focus…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Maximilian Nielsen , Laura Wenderoth , Thilo Sentker , René Werner

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

声音 · 计算机科学 2026-05-13 Adam Wynn , Jingyun Wang

Automatic Speaker Verification (ASV) suffers from performance degradation in noisy conditions. To address this issue, we propose a novel adversarial learning framework that incorporates noise-disentanglement to establish a noise-independent…

声音 · 计算机科学 2024-09-27 Xujiang Xing , Mingxing Xu , Thomas Fang Zheng

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

机器学习 · 计算机科学 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Training AI models to understand images without costly labeled data remains a challenge. We combine two techniques--DINO (teacher-student learning) and Barlow Twins (redundancy reduction)--to create a model that learns better with fewer…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Michael Podsiadly , Brendon K Lay

Learning from noisy data has become essential for adapting deep learning models to real-world applications. Traditional methods often involve first evaluating the noise and then applying strategies such as discarding noisy samples,…

机器学习 · 计算机科学 2024-11-27 Lechao Cheng , Kaifeng Chen , Jiyang Li , Shengeng Tang , Shufei Zhang , Meng Wang

In recent years, using raw waveforms as input for deep networks has been widely explored for the speaker verification system. For example, RawNet and RawNet2 extracted speaker's feature embeddings from waveforms automatically for…

音频与语音处理 · 电气工程与系统科学 2021-10-08 Jin Li , Nan Yan , Lan Wang

Large language models are increasingly post-trained with reinforcement learning in verifiable domains such as code and math. Yet, current methods for reinforcement learning with verifiable rewards (RLVR) learn only from a scalar outcome…

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

声音 · 计算机科学 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung

Incremental improvements in accuracy of Convolutional Neural Networks are usually achieved through use of deeper and more complex models trained on larger datasets. However, enlarging dataset and models increases the computation and storage…

音频与语音处理 · 电气工程与系统科学 2018-07-24 Mahdi Hajibabaei , Dengxin Dai

While large audio language models excel at tasks like ASR and emotion recognition, they still struggle with complex reasoning due to the modality gap between audio and text as well as the lack of structured intermediate supervision. To…

音频与语音处理 · 电气工程与系统科学 2025-09-24 Runyan Yang , Yuke Si , Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Although deep learning-based computer-aided diagnosis systems have recently achieved expert-level performance, developing a robust deep learning model requires large, high-quality data with manual annotation, which is expensive to obtain.…

图像与视频处理 · 电气工程与系统科学 2022-10-12 Sangjoon Park , Gwanghyun Kim , Yujin Oh , Joon Beom Seo , Sang Min Lee , Jin Hwan Kim , Sungjun Moon , Jae-Kwang Lim , Chang Min Park , Jong Chul Ye