中文
相关论文

相关论文: Cross-speaker Emotion Transfer Based on Speaker Co…

200 篇论文

Recent advancements in transformer-based speech representation models have greatly transformed speech processing. However, there has been limited research conducted on evaluating these models for speech emotion recognition (SER) across…

计算与语言 · 计算机科学 2023-08-21 Anant Singh , Akshat Gupta

Recently, there has been an increasing interest in neural speech synthesis. While the deep neural network achieves the state-of-the-art result in text-to-speech (TTS) tasks, how to generate a more emotional and more expressive speech is…

计算与语言 · 计算机科学 2021-06-24 Chenye Cui , Yi Ren , Jinglin Liu , Feiyang Chen , Rongjie Huang , Ming Lei , Zhou Zhao

Despite rapid advances in the field of emotional text-to-speech (TTS), recent studies primarily focus on mimicking the average style of a particular emotion. As a result, the ability to manipulate speech emotion remains constrained to…

声音 · 计算机科学 2024-11-06 Deok-Hyeon Cho , Hyung-Seok Oh , Seung-Bin Kim , Sang-Hoon Lee , Seong-Whan Lee

Utilizing Self-Supervised Learning (SSL) models for Speech Emotion Recognition (SER) has proven effective, yet limited research has explored cross-lingual scenarios. This study presents a comparative analysis between human performance and…

音频与语音处理 · 电气工程与系统科学 2025-05-01 Zhichen Han , Tianqi Geng , Hui Feng , Jiahong Yuan , Korin Richmond , Yuanchao Li

Speech emotion recognition (SER) is essential for enhancing human-computer interaction in speech-based applications. Despite improvements in specific emotional datasets, there is still a research gap in SER's capability to generalize across…

Cross-corpus speech emotion recognition (SER) plays a vital role in numerous practical applications. Traditional approaches to cross-corpus emotion transfer often concentrate on adapting acoustic features to align with different corpora,…

声音 · 计算机科学 2024-12-31 Shreya G. Upadhyay , Ali N. Salman , Carlos Busso , Chi-Chun Lee

This paper aims to synthesize the target speaker's speech with desired speaking style and emotion by transferring the style and emotion from reference speech recorded by other speakers. We address this challenging problem with a two-stage…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Xinfa Zhu , Yi Lei , Kun Song , Yongmao Zhang , Tao Li , Lei Xie

Emotional voice conversion (EVC) traditionally targets the transformation of spoken utterances from one emotional state to another, with previous research mainly focusing on discrete emotion categories. This paper departs from the norm by…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Kun Zhou , Berrak Sisman , Carlos Busso , Bin Ma , Haizhou Li

Many frameworks for emotional text-to-speech (E-TTS) rely on human-annotated emotion labels that are often inaccurate and difficult to obtain. Learning emotional prosody implicitly presents a tough challenge due to the subjective nature of…

音频与语音处理 · 电气工程与系统科学 2024-05-21 Shreeram Suresh Chandra , Zongyang Du , Berrak Sisman

Speech emotion conversion aims to convert the expressed emotion of a spoken utterance to a target emotion while preserving the lexical information and the speaker's identity. In this work, we specifically focus on in-the-wild emotion…

音频与语音处理 · 电气工程与系统科学 2023-06-06 Navin Raj Prabhu , Nale Lehmann-Willenbrock , Timo Gerkmann

Cross-lingual alignment in pretrained language models enables knowledge transfer across languages. Similar alignment has been reported in Whisper-style speech encoders, based on spoken translation retrieval using representational…

计算与语言 · 计算机科学 2026-04-07 Ryan Soh-Eun Shim , Domenico De Cristofaro , Chengzhi Martin Hu , Alessandro Vietti , Barbara Plank

Given a pair of source and reference speech recordings, speech-to-speech (S2S) emotion style transfer involves the generation of an output speech that mimics the emotion characteristics of the reference while preserving the content and…

音频与语音处理 · 电气工程与系统科学 2026-03-11 Soumya Dutta , Avni Jain , Sriram Ganapathy

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

计算机视觉与模式识别 · 计算机科学 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

Fueled by recent advances of self-supervised models, pre-trained speech representations proved effective for the downstream speech emotion recognition (SER) task. Most prior works mainly focus on exploiting pre-trained representations and…

声音 · 计算机科学 2023-03-02 Siyuan Shen , Feng Liu , Aimin Zhou

It remains a challenge to effectively control the emotion rendering in text-to-speech (TTS) synthesis. Prior studies have primarily focused on learning a global prosodic representation at the utterance level, which strongly correlates with…

声音 · 计算机科学 2024-05-16 Sho Inoue , Kun Zhou , Shuai Wang , Haizhou Li

Speech emotion recognition plays a crucial role in human-computer interactions. However, most speech emotion recognition research is biased toward English-speaking adults, which hinders its applicability to other demographic groups in…

计算与语言 · 计算机科学 2023-06-27 Samuel Cahyawijaya , Holy Lovenia , Willy Chung , Rita Frieske , Zihan Liu , Pascale Fung

Speech generation for machine dubbing adds complexity to conventional Text-To-Speech solutions as the generated output is required to match the expressiveness, emotion and speaking rate of the source content. Capturing and transferring…

音频与语音处理 · 电气工程与系统科学 2023-06-22 Jakub Swiatkowski , Duo Wang , Mikolaj Babianski , Giuseppe Coccia , Patrick Lumban Tobing , Ravichander Vipperla , Viacheslav Klimkov , Vincent Pollet

Cross-corpus speech emotion recognition (SER) poses a challenge due to feature distribution mismatch, potentially degrading the performance of established SER methods. In this paper, we tackle this challenge by proposing a novel transfer…

声音 · 计算机科学 2023-12-12 Yan Zhao , Yuan Zong , Hailun Lian , Cheng Lu , Jingang Shi , Wenming Zheng

Data-driven models achieve successful results in Speech Emotion Recognition (SER). However, these models, which are often based on general acoustic features or end-to-end approaches, show poor performance when the testing set has a…

音频与语音处理 · 电气工程与系统科学 2025-12-15 Duowei Tang , Peter Kuppens , Lucca Geurts , Toon van Waterschoot

Emotion Recognition in Conversation (ERC) is a more challenging task than conventional text emotion recognition. It can be regarded as a personalized and interactive emotion recognition task, which is supposed to consider not only the…

计算与语言 · 计算机科学 2021-01-01 Jiangnan Li , Zheng Lin , Peng Fu , Qingyi Si , Weiping Wang