中文
相关论文

相关论文: Joint Speaker Features Learning for Audio-visual M…

200 篇论文

Automatic speech recognition (ASR) of overlapped speech remains a highly challenging task to date. To this end, multi-channel microphone array data are widely used in state-of-the-art ASR systems. Motivated by the invariance of visual…

音频与语音处理 · 电气工程与系统科学 2020-11-19 Jianwei Yu , Bo Wu , Rongzhi Gu , Shi-Xiong Zhang , Lianwu Chen , Yong Xu. Meng Yu , Dan Su , Dong Yu , Xunying Liu , Helen Meng

In this work, we propose a novel method for modeling numerous speakers, which enables expressing the overall characteristics of speakers in detail like a trained multi-speaker model without additional training on the target speaker's…

声音 · 计算机科学 2024-06-03 Jungil Kong , Junmo Lee , Jeongmin Kim , Beomjeong Kim , Jihoon Park , Dohee Kong , Changheon Lee , Sangjin Kim

Voice conversion systems have made significant advancements in terms of naturalness and similarity in common voice conversion tasks. However, their performance in more complex tasks such as cross-lingual voice conversion and expressive…

音频与语音处理 · 电气工程与系统科学 2023-07-04 Houjian Guo , Chaoran Liu , Carlos Toshinori Ishi , Hiroshi Ishiguro

Recent advancements in deep learning led to human-level performance in single-speaker speech synthesis. However, there are still limitations in terms of speech quality when generalizing those systems into multiple-speaker models especially…

音频与语音处理 · 电气工程与系统科学 2020-08-13 Dipjyoti Paul , Yannis Pantazis , Yannis Stylianou

Neural network based speech recognition systems suffer from performance degradation due to accented speech, especially unfamiliar accents. In this paper, we study the supervised contrastive learning framework for accented speech…

声音 · 计算机科学 2021-07-05 Tao Han , Hantao Huang , Ziang Yang , Wei Han

Multi-modal based speech separation has exhibited a specific advantage on isolating the target character in multi-talker noisy environments. Unfortunately, most of current separation strategies prefer a straightforward fusion based on…

声音 · 计算机科学 2022-03-08 Junwen Xiong , Peng Zhang , Lei Xie , Wei Huang , Yufei Zha , Yanning Zhang

This paper proposes a novel Wavelet Packet based feature extraction approach for the task of text independent speaker recognition. The features are extracted by using the combination of Mel Frequency Cepstral Coefficient (MFCC) and Wavelet…

Speech enhancement has recently achieved great success with various deep learning methods. However, most conventional speech enhancement systems are trained with supervised methods that impose two significant challenges. First, a majority…

音频与语音处理 · 电气工程与系统科学 2022-02-22 Viet Anh Trinh , Sebastian Braun

This paper introduces a novel framework for open-set speaker identification in household environments, playing a crucial role in facilitating seamless human-computer interactions. Addressing the limitations of current speaker models and…

音频与语音处理 · 电气工程与系统科学 2024-09-25 Zhiyong Chen , Zhiqi Ai , Xinnuo Li , Shugong Xu

By implicitly recognizing a user based on his/her speech input, speaker identification enables many downstream applications, such as personalized system behavior and expedited shopping checkouts. Based on whether the speech content is…

机器学习 · 计算机科学 2021-06-21 Ruirui Li , Chelsea J. -T. Ju , Zeya Chen , Hongda Mao , Oguz Elibol , Andreas Stolcke

This paper aims to improve the widely used deep speaker embedding x-vector model. We propose the following improvements: (1) a hybrid neural network structure using both time delay neural network (TDNN) and long short-term memory neural…

计算与语言 · 计算机科学 2019-02-22 Yun Tang , Guohong Ding , Jing Huang , Xiaodong He , Bowen Zhou

Speaker identification in multilingual settings presents unique challenges, particularly when conventional models are predominantly trained on English data. In this paper, we propose WSI (Whisper Speaker Identification), a framework that…

声音 · 计算机科学 2025-03-14 Jakaria Islam Emon , Md Abu Salek , Kazi Tamanna Alam

In recent years, neural network based methods for multi-speaker text-to-speech synthesis (TTS) have made significant progress. However, the current speaker encoder models used in these methods still cannot capture enough speaker…

声音 · 计算机科学 2022-03-29 Jinlong Xue , Yayue Deng , Yichen Han , Ya Li , Jianqing Sun , Jiaen Liang

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

音频与语音处理 · 电气工程与系统科学 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

This paper presents an improved deep embedding learning method based on convolutional neural network (CNN) for text-independent speaker verification. Two improvements are proposed for x-vector embedding learning: (1) Multi-scale convolution…

音频与语音处理 · 电气工程与系统科学 2020-01-15 Bin Gu , Wu Guo

The many-to-many multilingual neural machine translation can be regarded as the process of integrating semantic features from the source sentences and linguistic features from the target sentences. To enhance zero-shot translation, models…

计算与语言 · 计算机科学 2024-08-05 Mengyu Bu , Shuhao Gu , Yang Feng

Speaker identification systems in a real-world scenario are tasked to identify a speaker amongst a set of enrolled speakers given just a few samples for each enrolled speaker. This paper demonstrates the effectiveness of meta-learning and…

音频与语音处理 · 电气工程与系统科学 2022-07-25 Ashutosh Chaubey , Sparsh Sinha , Susmita Ghose

The performance of automatic speech recognition (ASR) systems severely degrades when multi-talker speech overlap occurs. In meeting environments, speech separation is typically performed to improve the robustness of ASR systems. Recently,…

音频与语音处理 · 电气工程与系统科学 2023-01-18 Hassan Taherian , DeLiang Wang

Single-channel speech enhancement approaches do not always improve automatic recognition rates in the presence of noise, because they can introduce distortions unhelpful for recognition. Following a trend towards end-to-end training of…

声音 · 计算机科学 2021-12-14 Peter Plantinga , Deblin Bagchi , Eric Fosler-Lussier

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain