中文
相关论文

相关论文: ZSDEVC: Zero-Shot Diffusion-based Emotional Voice …

200 篇论文

Expressive voice conversion aims to transfer both speaker identity and expressive attributes from a target speech to a given source speech. In this work, we improve over a self-supervised, non-autoregressive framework with a conditional…

声音 · 计算机科学 2025-06-05 Seymanur Akti , Tuan Nam Nguyen , Alexander Waibel

Currently, zero-shot voice conversion systems are capable of synthesizing the voice of unseen speakers. However, most existing approaches struggle to accurately replicate the speaking style of the source speaker or mimic the distinctive…

声音 · 计算机科学 2025-06-02 Kaidi Wang , Wenhao Guan , Ziyue Jiang , Hukai Huang , Peijie Chen , Weijie Wu , Qingyang Hong , Lin Li

The problem of audio-to-audio (A2A) style transfer involves replacing the style features of the source audio with those from the target audio while preserving the content related attributes of the source audio. In this paper, we propose an…

音频与语音处理 · 电气工程与系统科学 2024-01-10 Soumya Dutta , Sriram Ganapathy

Zero-shot voice conversion aims to transfer the voice of a source speaker to that of a speaker unseen during training, while preserving the content information. Although various methods have been proposed to reconstruct speaker information…

声音 · 计算机科学 2024-08-22 Anastasia Avdeeva , Aleksei Gusev

Voice conversion is the task of converting a spoken utterance from a source speaker so that it appears to be said by a different target speaker while retaining the linguistic content of the utterance. Recent advances have led to major…

音频与语音处理 · 电气工程与系统科学 2021-06-02 Matthew Baas , Herman Kamper

Primary goal of an emotional voice conversion (EVC) system is to convert the emotion of a given speech signal from one style to another style without modifying the linguistic content of the signal. Most of the state-of-the-art approaches…

声音 · 计算机科学 2023-02-22 Nirmesh Shah , Mayank Kumar Singh , Naoya Takahashi , Naoyuki Onoe

Emotional Text-To-Speech (TTS) is an important task in the development of systems (e.g., human-like dialogue agents) that require natural and emotional speech. Existing approaches, however, only aim to produce emotional TTS for seen…

声音 · 计算机科学 2023-05-24 Minki Kang , Wooseok Han , Sung Ju Hwang , Eunho Yang

The goal of voice conversion is to transform the speech of a source speaker to sound like that of a reference speaker while preserving the original content. A key challenge is to extract disentangled linguistic content from the source and…

声音 · 计算机科学 2025-01-15 Jaehun Kim , Ji-Hoon Kim , Yeunju Choi , Tan Dat Nguyen , Seongkyu Mun , Joon Son Chung

Controllable emotional voice conversion (EVC) aims to manipulate emotional expressions to increase the diversity of synthesized speech. Existing methods typically rely on predefined labels, reference audios, or prespecified factor values,…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Tianhua Qi , Shiyan Wang , Cheng Lu , Tengfei Song , Hao Yang , Zhanglin Wu , Wenming Zheng

Speech emotion conversion is the task of modifying the perceived emotion of a speech utterance while preserving the lexical content and speaker identity. In this study, we cast the problem of emotion conversion as a spoken language…

Zero-shot voice conversion (VC) aims to transfer the source speaker timbre to arbitrary unseen target speaker timbre, while keeping the linguistic content unchanged. Although the voice of generated speech can be controlled by providing the…

声音 · 计算机科学 2024-01-31 Junjie Li , Yiwei Guo , Xie Chen , Kai Yu

Voice conversion (VC) is a task that transforms voice from target audio to source without losing linguistic contents, it is challenging especially when source and target speakers are unseen during training (zero-shot VC). Previous…

声音 · 计算机科学 2021-04-14 Shijun Wang , Damian Borth

Emotional voice conversion (EVC) aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. In this paper, we study the disentanglement and recomposition of emotional…

声音 · 计算机科学 2020-11-05 Kun Zhou , Berrak Sisman , Haizhou Li

In Emotion Recognition in Conversations (ERC), the emotions of target utterances are closely dependent on their context. Therefore, existing works train the model to generate the response of the target utterance, which aims to recognise…

计算与语言 · 计算机科学 2023-05-30 Kailai Yang , Tianlin Zhang , Sophia Ananiadou

Face-based Voice Conversion (FVC) is a novel task that leverages facial images to generate the target speaker's voice style. Previous work has two shortcomings: (1) suffering from obtaining facial embeddings that are well-aligned with the…

声音 · 计算机科学 2024-09-05 Yan Rong , Li Liu

In recent years, diffusion-based generative models have demonstrated remarkable performance in speech conversion, including Denoising Diffusion Probabilistic Models (DDPM) and others. However, the advantages of these models come at the cost…

声音 · 计算机科学 2025-06-03 Pengyu Ren , Wenhao Guan , Kaidi Wang , Peijie Chen , Qingyang Hong , Lin Li

Traditional voice conversion(VC) has been focused on speaker identity conversion for speech with a neutral expression. We note that emotional expression plays an essential role in daily communication, and the emotional style of speech can…

音频与语音处理 · 电气工程与系统科学 2021-10-22 Zongyang Du , Berrak Sisman , Kun Zhou , Haizhou Li

Emotional voice conversion (EVC) aims to modify the emotional style of speech while preserving its linguistic content. In practical EVC, controllability, the ability to independently control speaker identity and emotional style using…

声音 · 计算机科学 2025-08-12 Jinsung Yoon , Wooyeol Jeong , Jio Gim , Young-Joo Suh

Unsupervised Zero-Shot Voice Conversion (VC) aims to modify the speaker characteristic of an utterance to match an unseen target speaker without relying on parallel training data. Recently, self-supervised learning of speech representation…

声音 · 计算机科学 2022-02-14 Trung Dang , Dung Tran , Peter Chin , Kazuhito Koishida

Despite previous success in generating audio-driven talking heads, most of the previous studies focus on the correlation between speech content and the mouth shape. Facial emotion, which is one of the most important features on natural…

计算机视觉与模式识别 · 计算机科学 2021-05-21 Xinya Ji , Hang Zhou , Kaisiyuan Wang , Wayne Wu , Chen Change Loy , Xun Cao , Feng Xu