中文
相关论文

相关论文: Expressive Voice Conversion: A Joint Framework for…

200 篇论文

The emotion recognition in conversation (ERC) task aims to predict the emotion label of an utterance in a conversation. Since the dependencies between speakers are complex and dynamic, which consist of intra- and inter-speaker dependencies,…

计算与语言 · 计算机科学 2022-06-08 Yinan Bao , Qianwen Ma , Lingwei Wei , Wei Zhou , Songlin Hu

Cross-lingual speech emotion recognition (SER) remains a challenging task due to differences in phonetic variability and speaker-specific expressive styles across languages. Effectively capturing emotion under such diverse conditions…

计算与语言 · 计算机科学 2025-09-26 Shreya G. Upadhyay , Carlos Busso , Chi-Chun Lee

Traditional voice conversion methods rely on parallel recordings of multiple speakers pronouncing the same sentences. For real-world applications however, parallel data is rarely available. We propose MelGAN-VC, a voice conversion method…

音频与语音处理 · 电气工程与系统科学 2019-12-06 Marco Pasini

Emotional voice conversion (EVC) involves modifying various acoustic characteristics, such as pitch and spectral envelope, to match a desired emotional state while preserving the speaker's identity. Existing EVC methods often rely on text…

声音 · 计算机科学 2025-01-22 Hyung-Seok Oh , Sang-Hoon Lee , Deok-Hyeon Cho , Seong-Whan Lee

In expressive speech synthesis, there are high requirements for emotion interpretation. However, it is time-consuming to acquire emotional audio corpus for arbitrary speakers due to their deduction ability. In response to this problem, this…

音频与语音处理 · 电气工程与系统科学 2021-10-12 Pengfei Wu , Junjie Pan , Chenchang Xu , Junhui Zhang , Lin Wu , Xiang Yin , Zejun Ma

Voice conversion (VC) is a task to transform a person's voice to different style while conserving linguistic contents. Previous state-of-the-art on VC is based on sequence-to-sequence (seq2seq) model, which could mislead linguistic…

音频与语音处理 · 电气工程与系统科学 2019-11-28 Tae-Ho Kim , Sungjae Cho , Shinkook Choi , Sejik Park , Soo-Young Lee

We propose a nonparallel data-driven emotional speech conversion method. It enables the transfer of emotion-related characteristics of a speech signal while preserving the speaker's identity and linguistic content. Most existing approaches…

机器学习 · 计算机科学 2020-04-14 Jian Gao , Deep Chakraborty , Hamidou Tembine , Olaitan Olaleye

Voice conversion is a challenging task which transforms the voice characteristics of a source speaker to a target speaker without changing linguistic content. Recently, there have been many works on many-to-many Voice Conversion (VC) based…

音频与语音处理 · 电气工程与系统科学 2021-09-23 Manh Luong , Viet Anh Tran

Emotion Recognition in Conversation (ERC) is a more challenging task than conventional text emotion recognition. It can be regarded as a personalized and interactive emotion recognition task, which is supposed to consider not only the…

计算与语言 · 计算机科学 2021-01-01 Jiangnan Li , Zheng Lin , Peng Fu , Qingyi Si , Weiping Wang

The Emotional Voice Conversion (EVC) aims to convert the discrete emotional state from the source emotion to the target for a given speech utterance while preserving linguistic content. In this paper, we propose regularizing emotion…

音频与语音处理 · 电气工程与系统科学 2024-12-31 Ashishkumar Gudmalwar , Ishan D. Biyani , Nirmesh Shah , Pankaj Wasnik , Rajiv Ratn Shah

Voice conversion is a task of synthesizing an utterance with target speaker's voice while maintaining linguistic information of the source utterance. While a speaker can produce varying utterances from a single script with different…

声音 · 计算机科学 2025-04-17 Soobin Suh , Dabi Ahn , Heewoong Park , Jonghun Park

Voice conversion (VC) refers to transforming the speaker characteristics of an utterance without altering its linguistic contents. Many works on voice conversion require to have parallel training data that is highly expensive to acquire.…

声音 · 计算机科学 2020-02-18 Shindong Lee , BongGu Ko , Keonnyeong Lee , In-Chul Yoo , Dongsuk Yook

Emotional voice conversion aims to convert the spectrum and prosody to change the emotional patterns of speech, while preserving the speaker identity and linguistic content. Many studies require parallel speech data between different…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Kun Zhou , Berrak Sisman , Haizhou Li

The goal of cross-speaker style transfer in TTS is to transfer a speech style from a source speaker with expressive data to a target speaker with only neutral data. In this context, we propose using a pre-trained singing voice conversion…

音频与语音处理 · 电气工程与系统科学 2024-10-10 Leonardo B. de M. M. Marques , Lucas H. Ueda , Mário U. Neto , Flávio O. Simões , Fernando Runstein , Bianca Dal Bó , Paula D. P. Costa

This paper introduces a novel voice conversion (VC) model, guided by text instructions such as "articulate slowly with a deep tone" or "speak in a cheerful boyish voice". Unlike traditional methods that rely on reference utterances to…

音频与语音处理 · 电气工程与系统科学 2024-01-17 Chun-Yi Kuan , Chen An Li , Tsu-Yuan Hsu , Tse-Yang Lin , Ho-Lam Chung , Kai-Wei Chang , Shuo-yiin Chang , Hung-yi Lee

This paper introduces a new framework for non-parallel emotion conversion in speech. Our framework is based on two key contributions. First, we propose a stochastic version of the popular CycleGAN model. Our modified loss function…

音频与语音处理 · 电气工程与系统科学 2022-11-10 Ravi Shankar , Hsi-Wei Hsieh , Nicolas Charon , Archana Venkataraman

Face-based Voice Conversion (FVC) is a novel task that leverages facial images to generate the target speaker's voice style. Previous work has two shortcomings: (1) suffering from obtaining facial embeddings that are well-aligned with the…

声音 · 计算机科学 2024-09-05 Yan Rong , Li Liu

We propose SelfVC, a training strategy to iteratively improve a voice conversion model with self-synthesized examples. Previous efforts on voice conversion focus on factorizing speech into explicitly disentangled representations that…

Cross-speaker emotion intensity control aims to generate emotional speech of a target speaker with desired emotion intensities using only their neutral speech. A recently proposed method, emotion arithmetic, achieves emotion intensity…

声音 · 计算机科学 2025-07-08 Masato Murata , Koichi Miyazaki , Tomoki Koriyama

Voice conversion is the task to transform voice characteristics of source speech while preserving content information. Nowadays, self-supervised representation learning models are increasingly utilized in content extraction. However, in…

声音 · 计算机科学 2024-05-02 Yimin Deng , Jianzong Wang , Xulong Zhang , Ning Cheng , Jing Xiao