English
Related papers

Related papers: Controllable Emotion Transfer For End-to-End Speec…

200 papers

We present a methodology to train our multi-speaker emotional text-to-speech synthesizer that can express speech for 10 speakers' 7 different emotions. All silences from audio samples are removed prior to learning. This results in fast…

Computation and Language · Computer Science 2021-12-08 Sungjae Cho , Soo-Young Lee

Emotional voice conversion (EVC) is one way to generate expressive synthetic speech. Previous approaches mainly focused on modeling one-to-one mapping, i.e., conversion from one emotional state to another emotional state, with Mel-cepstral…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Songxiang Liu , Yuewen Cao , Helen Meng

Traditional anti-spoofing focuses on models and datasets built on synthetic speech with mostly neutral state, neglecting diverse emotional variations. As a result, their robustness against high-quality, emotionally expressive synthetic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Aurosweta Mahapatra , Ismail Rasim Ulgen , Abinay Reddy Naini , Carlos Busso , Berrak Sisman

Emotional state of a speaker is found to have significant effect in speech production, which can deviate speech from that arising from neutral state. This makes identifying speakers with different emotions a challenging task as generally…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-09 Biswajit Dev Sarma , Rohan Kumar Das

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

Emotional Text-To-Speech (TTS) is an important task in the development of systems (e.g., human-like dialogue agents) that require natural and emotional speech. Existing approaches, however, only aim to produce emotional TTS for seen…

Sound · Computer Science 2023-05-24 Minki Kang , Wooseok Han , Sung Ju Hwang , Eunho Yang

Neural sequence-to-sequence text-to-speech synthesis (TTS), such as Tacotron-2, transforms text into high-quality speech. However, generating speech with natural prosody still remains a challenge. Yasuda et. al. show that unlike natural…

Sound · Computer Science 2021-04-12 Mahsa Elyasi , Gaurav Bharaj

Recently, emotional speech synthesis has achieved remarkable performance. The emotion strength of synthesized speech can be controlled flexibly using a strength descriptor, which is obtained by an emotion attribute ranking function.…

Sound · Computer Science 2021-10-11 Rui Liu , Berrak Sisman , Haizhou Li

In this paper, an end-to-end neural embedding system based on triplet loss and residual learning has been proposed for speech emotion recognition. The proposed system learns the embeddings from the emotional information of the speech…

Despite the recent achievements made in the multi-modal emotion recognition task, two problems still exist and have not been well investigated: 1) the relationship between different emotion categories are not utilized, which leads to…

Computation and Language · Computer Science 2020-10-08 Wenliang Dai , Zihan Liu , Tiezheng Yu , Pascale Fung

Modern neural text-to-speech (TTS) synthesis can generate speech that is indistinguishable from natural speech. However, the prosody of generated utterances often represents the average prosodic style of the database instead of having wide…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-16 Tuomo Raitio , Ramya Rasipuram , Dan Castellani

Incorporating cross-speaker style transfer in text-to-speech (TTS) models is challenging due to the need to disentangle speaker and style information in audio. In low-resource expressive data scenarios, voice conversion (VC) can generate…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Lucas H. Ueda , Leonardo B. de M. M. Marques , Flávio O. Simões , Mário U. Neto , Fernando Runstein , Bianca Dal Bó , Paula D. P. Costa

Emotional Text-to-Speech (E-TTS) synthesis has garnered significant attention in recent years due to its potential to revolutionize human-computer interaction. However, current E-TTS approaches often struggle to capture the intricacies of…

Computation and Language · Computer Science 2025-02-20 Zhi-Qi Cheng , Xiang Li , Jun-Yan He , Junyao Chen , Xiaomao Fan , Xiaojiang Peng , Alexander G. Hauptmann

Intonations play an important role in delivering the intention of a speaker. However, current end-to-end TTS systems often fail to model proper intonations. To alleviate this problem, we propose a novel, intuitive method to synthesize…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Jihwan Lee , Joun Yeop Lee , Heejin Choi , Seongkyu Mun , Sangjun Park , Jae-Sung Bae , Chanwoo Kim

Although current neural text-to-speech (TTS) models are able to generate high-quality speech, intensity controllable emotional TTS is still a challenging task. Most existing methods need external optimizations for intensity calculation,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-17 Yiwei Guo , Chenpeng Du , Xie Chen , Kai Yu

Recent advances in style transfer text-to-speech (TTS) have improved the expressiveness of synthesized speech. However, encoding stylistic information (e.g., timbre, emotion, and prosody) from diverse and unseen reference speech remains a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-29 Ahad Jawaid , Shreeram Suresh Chandra , Junchen Lu , Berrak Sisman

During the last few years, spoken language technologies have known a big improvement thanks to Deep Learning. However Deep Learning-based algorithms require amounts of data that are often difficult and costly to gather. Particularly,…

Sound · Computer Science 2019-01-15 Noé Tits , Kevin El Haddad , Thierry Dutoit

The field of Text-to-Speech has experienced huge improvements last years benefiting from deep learning techniques. Producing realistic speech becomes possible now. As a consequence, the research on the control of the expressiveness,…

Computation and Language · Computer Science 2019-03-28 Noé Tits , Fengna Wang , Kevin El Haddad , Vincent Pagel , Thierry Dutoit

We propose a nonparallel data-driven emotional speech conversion method. It enables the transfer of emotion-related characteristics of a speech signal while preserving the speaker's identity and linguistic content. Most existing approaches…

Machine Learning · Computer Science 2020-04-14 Jian Gao , Deep Chakraborty , Hamidou Tembine , Olaitan Olaleye

We propose a novel training strategy for Tacotron-based text-to-speech (TTS) system to improve the expressiveness of speech. One of the key challenges in prosody modeling is the lack of reference that makes explicit modeling difficult. The…

Sound · Computer Science 2021-04-13 Rui Liu , Berrak Sisman , Guanglai Gao , Haizhou Li
‹ Prev 1 4 5 6 7 8 10 Next ›