English
Related papers

Related papers: Multi-task Voice Activated Framework using Self-su…

200 papers

Recent work on intracranial brain-machine interfaces has demonstrated that spoken speech can be decoded with high accuracy, essentially by treating the problem as an instance of supervised learning and training deep neural networks to map…

Neurons and Cognition · Quantitative Biology 2024-05-30 Brian A. Yuan , Joseph G. Makin

Recent advances in sophisticated synthetic speech generated from text-to-speech (TTS) or voice conversion (VC) systems cause threats to the existing automatic speaker verification (ASV) systems. Since such synthetic speech is generated from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-15 Youngsik Eom , Yeonghyeon Lee , Ji Sub Um , Hoirin Kim

Although highly correlated, speech and speaker recognition have been regarded as two independent tasks and studied by two communities. This is certainly not the way that people behave: we decipher both speech content and speaker traits at…

Computation and Language · Computer Science 2016-09-28 Zhiyuan Tang , Lantian Li , Dong Wang

Self-supervised learning (SSL) has shown significant progress in speech processing tasks. However, despite the intrinsic randomness in the Transformer structure, such as dropout variants and layer-drop, improving the model-level consistency…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-16 Ji Won Yoon , Seok Min Kim , Nam Soo Kim

We consider the task of unsupervised extraction of meaningful latent representations of speech by applying autoencoding neural networks to speech waveforms. The goal is to learn a representation able to capture high level semantic content…

Machine Learning · Computer Science 2019-09-12 Jan Chorowski , Ron J. Weiss , Samy Bengio , Aäron van den Oord

We employ a combination of recent developments in semi-supervised learning for automatic speech recognition to obtain state-of-the-art results on LibriSpeech utilizing the unlabeled audio of the Libri-Light dataset. More precisely, we carry…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Yu Zhang , James Qin , Daniel S. Park , Wei Han , Chung-Cheng Chiu , Ruoming Pang , Quoc V. Le , Yonghui Wu

With the advances in deep learning, the performance of end-to-end (E2E) single-task models for speech and audio processing has been constantly improving. However, it is still challenging to build a general-purpose model with high…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-21 Xiaoyu Yang , Qiujia Li , Chao Zhang , Phil Woodland

Spoofing attacks posed by generating artificial speech can severely degrade the performance of a speaker verification system. Recently, many anti-spoofing countermeasures have been proposed for detecting varying types of attacks from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-08 Yuanjun Zhao , Roberto Togneri , Victor Sreeram

In this paper, we propose self-supervised speaker representation learning strategies, which comprise of a bootstrap equilibrium speaker representation learning in the front-end and an uncertainty-aware probabilistic speaker embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-28 Sung Hwan Mun , Min Hyun Han , Dongjune Lee , Jihwan Kim , Nam Soo Kim

It is well known that recognizers personalized to each user are much more effective than user-independent recognizers. With the popularity of smartphones today, although it is not difficult to collect a large set of audio data for each…

Sound · Computer Science 2017-06-27 Cheng-Kuan Wei , Cheng-Tao Chung , Hung-Yi Lee , Lin-Shan Lee

Approaching Speech-to-Text and Automatic Speech Recognition problems in low-resource languages is notoriously challenging due to the scarcity of validated datasets and the diversity of dialects. Arabic, Russian, and Portuguese exemplify…

Computation and Language · Computer Science 2025-01-03 Or Haim Anidjar , Revital Marbel , Roi Yozevitch

Current visual representation learning remains bifurcated: vision-language models (e.g., CLIP) excel at global semantic alignment but lack spatial precision, while self-supervised methods (e.g., MAE, DINO) capture intricate local structures…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shangzhe Di , Zhonghua Zhai , Weidi Xie

In this paper, we propose a novel deep neural network architecture, Speech2Vec, for learning fixed-length vector representations of audio segments excised from a speech corpus, where the vectors contain semantic information pertaining to…

Computation and Language · Computer Science 2018-06-12 Yu-An Chung , James Glass

Recent breakthroughs in deep learning often rely on representation learning and knowledge transfer. In recent years, unsupervised and self-supervised techniques for learning speech representation were developed to foster automatic speech…

Computation and Language · Computer Science 2021-12-15 Pierre Beckmann , Mikolaj Kegler , Milos Cernak

We present Burst2Vec, our multi-task learning approach to predict emotion, age, and origin (i.e., native country/language) from vocal bursts. Burst2Vec utilises pre-trained speech representations to capture acoustic information from raw…

Sound · Computer Science 2022-10-19 Atijit Anuchitanukul , Lucia Specia

We present a novel approach to any-to-one (A2O) voice conversion (VC) in a sequence-to-sequence (seq2seq) framework. A2O VC aims to convert any speaker, including those unseen during training, to a fixed target speaker. We utilize…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Wen-Chin Huang , Yi-Chiao Wu , Tomoki Hayashi , Tomoki Toda

Over recent decades have witnessed considerable progress in whether multi-task learning or multi-view learning, but the situation that consider both learning scenes simultaneously has received not too much attention. How to utilize multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Run-kun Lu , Jian-wei Liu , Si-ming Lian , Xin Zuo

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

In this paper, we demonstrated the benefit of using pre-trained model to extract acoustic embedding to jointly predict (multitask learning) three tasks: emotion, age, and native country. The pre-trained model was trained with wav2vec 2.0…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Bagus Tris Atmaja , Zanjabila , Akira Sasou