中文
相关论文

相关论文: Disentangled representation learning for multiling…

200 篇论文

Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and…

For recognizing speakers in video streams, significant research studies have been made to obtain a rich machine learning model by extracting high-level speaker's features such as facial expression, emotion, and gender. However, generating…

计算机视觉与模式识别 · 计算机科学 2020-07-22 Ehsan Asali , Farzan Shenavarmasouleh , Farid Ghareh Mohammadi , Prasanth Sengadu Suresh , Hamid R. Arabnia

The speech representations learned from large-scale unlabeled data have shown better generalizability than those from supervised learning and thus attract a lot of interest to be applied for various downstream tasks. In this paper, we…

声音 · 计算机科学 2022-01-25 Zhengyang Chen , Sanyuan Chen , Yu Wu , Yao Qian , Chengyi Wang , Shujie Liu , Yanmin Qian , Michael Zeng

This paper describes the submission to the speaker diarization track of VoxCeleb Speaker Recognition Challenge 2021 done by North America Bixby Lab of Samsung Research America. Our speaker diarization system consists of four main components…

音频与语音处理 · 电气工程与系统科学 2021-09-29 Myungjong Kim , Taeyeon Ki , Aviral Anshu , Vijendra Raj Apsingekar

Distance Metric Learning (DML) has typically dominated the audio-visual speaker verification problem space, owing to strong performance in new and unseen classes. In our work, we explored multitask learning techniques to further enhance…

声音 · 计算机科学 2024-09-25 Anith Selvakumar , Homa Fashandi

Voice style transfer, also called voice conversion, seeks to modify one speaker's voice to generate speech as if it came from another (target) speaker. Previous works have made progress on voice conversion with parallel training data and…

音频与语音处理 · 电气工程与系统科学 2021-03-18 Siyang Yuan , Pengyu Cheng , Ruiyi Zhang , Weituo Hao , Zhe Gan , Lawrence Carin

This paper is concerned with the task of speaker verification on audio with multiple overlapping speakers. Most speaker verification systems are designed with the assumption of a single speaker being present in a given audio segment.…

音频与语音处理 · 电气工程与系统科学 2023-04-10 Jenthe Thienpondt , Nilesh Madhu , Kris Demuynck

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

声音 · 计算机科学 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

Multi-view (or -modality) representation learning aims to understand the relationships between different view representations. Existing methods disentangle multi-view representations into consistent and view-specific representations by…

计算机视觉与模式识别 · 计算机科学 2023-08-07 Guanzhou Ke , Yang Yu , Guoqing Chao , Xiaoli Wang , Chenyang Xu , Shengfeng He

Speech recognition is very challenging in student learning environments that are characterized by significant cross-talk and background noise. To address this problem, we present a bilingual speech recognition system that uses an…

Large datasets are very useful for training speaker recognition systems, and various research groups have constructed several over the years. Voxceleb is a large dataset for speaker recognition that is extracted from Youtube videos. This…

声音 · 计算机科学 2022-03-11 Desmond Caulley , Yufeng Yang , David Anderson

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

声音 · 计算机科学 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

Representation learning for speech emotion recognition is challenging due to labeled data sparsity issue and lack of gold standard references. In addition, there is much variability from input speech signals, human subjective perception of…

音频与语音处理 · 电气工程与系统科学 2021-08-13 Haoqi Li , Ming Tu , Jing Huang , Shrikanth Narayanan , Panayiotis Georgiou

Many approaches can derive information about a single speaker's identity from the speech by learning to recognize consistent characteristics of acoustic parameters. However, it is challenging to determine identity information when there are…

音频与语音处理 · 电气工程与系统科学 2020-08-07 Hyewon Han , Soo-Whan Chung , Hong-Goo Kang

In this paper, we propose a simple but powerful unsupervised learning method for speaker recognition, namely Contrastive Equilibrium Learning (CEL), which increases the uncertainty on nuisance factors latent in the embeddings by employing…

音频与语音处理 · 电气工程与系统科学 2020-10-23 Sung Hwan Mun , Woo Hyun Kang , Min Hyun Han , Nam Soo Kim

Dialogue disentanglement aims to detach the chronologically ordered utterances into several independent sessions. Conversation utterances are essentially organized and described by the underlying discourse, and thus dialogue disentanglement…

计算与语言 · 计算机科学 2023-06-13 Bobo Li , Hao Fei , Fei Li , Shengqiong Wu , Lizi Liao , Yinwei Wei , Tat-Seng Chua , Donghong Ji

Multilingual speech emotion recognition aims to estimate a speaker's emotional state using a contactless method across different languages. However, variability in voice characteristics and linguistic diversity poses significant challenges…

计算与语言 · 计算机科学 2025-03-31 Heqing Zou , Fengmao Lv , Desheng Zheng , Eng Siong Chng , Deepu Rajan

Learning disentangled representations of high-dimensional data is currently an active research area. However, compared to the field of computer vision, less work has been done for speech processing. In this paper, we provide a review of two…

声音 · 计算机科学 2018-08-10 Yuan Gong , Christian Poellabauer

The mismatch between close-set training and open-set testing usually leads to significant performance degradation for speaker verification task. For existing loss functions, metric learning-based objectives depend strongly on searching…

音频与语音处理 · 电气工程与系统科学 2023-07-18 Bing Han , Zhengyang Chen , Yanmin Qian

This technical report describes the IDLab submission for track 1 and 2 of the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). This speaker verification competition focuses on short duration test recordings and cross-lingual trials.…

音频与语音处理 · 电气工程与系统科学 2021-09-10 Jenthe Thienpondt , Brecht Desplanques , Kris Demuynck