中文
相关论文

相关论文: Self-FiLM: Conditioning GANs with self-supervised …

200 篇论文

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

音频与语音处理 · 电气工程与系统科学 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

State-of-the-art speaker verification systems are inherently dependent on some kind of human supervision as they are trained on massive amounts of labeled data. However, manually annotating utterances is slow, expensive and not scalable to…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Théo Lepage , Réda Dehak

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

音频与语音处理 · 电气工程与系统科学 2020-06-16 Luka Chkhetiani , Levan Bejanidze

Training speaker-discriminative and robust speaker verification systems without speaker labels is still challenging and worthwhile to explore. In this study, we propose an effective self-supervised learning framework and a novel…

音频与语音处理 · 电气工程与系统科学 2022-02-03 Mufan Sang , Haoqi Li , Fang Liu , Andrew O. Arnold , Li Wan

Probing beam measurement (PBM)-based hybrid beamforming provides a feasible solution for cell-free MIMO. In this letter, we propose a novel probing beam optimization framework where three collaborative modules respectively realize PBM…

信息论 · 计算机科学 2024-09-23 Cheng Zhang , Shuangbo Xiong , Mengqing He , Lan Wei , Yongming Huang , Wei Zhang

This paper describes our submitted systems to the ASVspoof 5 Challenge Track 1: Speech Deepfake Detection - Open Condition, which consists of a stand-alone speech deepfake (bonafide vs spoof) detection task. Recently, large-scale…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Theophile Stourbe , Victor Miara , Theo Lepage , Reda Dehak

We introduce Condition-Aware Self-Supervised Learning Representation (CA-SSLR), a generalist conditioning model broadly applicable to various speech-processing tasks. Compared to standard fine-tuning methods that optimize for downstream…

音频与语音处理 · 电气工程与系统科学 2024-12-06 Yen-Ju Lu , Jing Liu , Thomas Thebaud , Laureano Moro-Velazquez , Ariya Rastrow , Najim Dehak , Jesus Villalba

In this paper, we propose a simple but powerful unsupervised learning method for speaker recognition, namely Contrastive Equilibrium Learning (CEL), which increases the uncertainty on nuisance factors latent in the embeddings by employing…

音频与语音处理 · 电气工程与系统科学 2020-10-23 Sung Hwan Mun , Woo Hyun Kang , Min Hyun Han , Nam Soo Kim

One of the frontier issues that severely hamper the development of automatic snore sound classification (ASSC) associates to the lack of sufficient supervised training data. To cope with this problem, we propose a novel data augmentation…

机器学习 · 计算机科学 2019-04-01 Zixing Zhang , Jing Han , Kun Qian , Christoph Janott , Yanan Guo , Bjoern Schuller

In this paper, we describe our submissions to the ZeroSpeech 2021 Challenge and SUPERB benchmark. Our submissions are based on the recently proposed FaST-VGS model, which is a Transformer-based model that learns to associate raw speech…

音频与语音处理 · 电气工程与系统科学 2022-03-03 Puyuan Peng , David Harwath

In this paper, we initiate the concern of enhancing the spoofing robustness of the automatic speaker verification (ASV) system, without the primary presence of a separate countermeasure module. We start from the standard ASV framework of…

声音 · 计算机科学 2022-04-27 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

Self-supervised features are typically used in place of filter-bank features in speaker verification models. However, these models were originally designed to ingest filter-bank features as inputs, and thus, training them on top of…

In conventional supervised pattern recognition tasks, model selection is typically accomplished by minimizing the classification error rate on a set of so-called development data, subject to ground-truth labeling by human experts or some…

机器学习 · 统计学 2011-08-25 Christopher M. White , Sanjeev P. Khudanpur , Patrick J. Wolfe

We employ a combination of recent developments in semi-supervised learning for automatic speech recognition to obtain state-of-the-art results on LibriSpeech utilizing the unlabeled audio of the Libri-Light dataset. More precisely, we carry…

音频与语音处理 · 电气工程与系统科学 2022-07-22 Yu Zhang , James Qin , Daniel S. Park , Wei Han , Chung-Cheng Chiu , Ruoming Pang , Quoc V. Le , Yonghui Wu

Self-supervised learning representation (SSLR) has demonstrated its significant effectiveness in automatic speech recognition (ASR), mainly with clean speech. Recent work pointed out the strength of integrating SSLR with single-channel…

声音 · 计算机科学 2022-10-20 Yoshiki Masuyama , Xuankai Chang , Samuele Cornell , Shinji Watanabe , Nobutaka Ono

As automatic speaker verification (ASV) systems are vulnerable to spoofing attacks, they are typically used in conjunction with spoofing countermeasure (CM) systems to improve security. For example, the CM can first determine whether the…

声音 · 计算机科学 2022-01-25 Anssi Kanervisto , Ville Hautamäki , Tomi Kinnunen , Junichi Yamagishi

In this paper, we address the unsupervised speech enhancement problem based on recurrent variational autoencoder (RVAE). This approach offers promising generalization performance over the supervised counterpart. Nevertheless, the involved…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Mostafa Sadeghi , Romain Serizel

We study architectural and optimization techniques for sample-efficient language modeling under the constraints of the BabyLM 2025 shared task. Our model, BLaLM, replaces self-attention with a linear-time mLSTM token mixer and explores…

计算与语言 · 计算机科学 2025-11-11 Patrick Haller , Jonas Golde , Alan Akbik

We present a novel self-supervised learning approach for conditional generative adversarial networks (GANs) under a semi-supervised setting. Unlike prior self-supervised approaches which often involve geometric augmentations on the image…

计算机视觉与模式识别 · 计算机科学 2020-10-12 Jiaze Sun , Binod Bhattarai , Tae-Kyun Kim

Convolutions operate only locally, thus failing to model global interactions. Self-attention is, however, able to learn representations that capture long-range dependencies in sequences. We propose a network architecture for audio…

声音 · 计算机科学 2021-08-27 Nathanaël Carraz Rakotonirina