English
Related papers

Related papers: StrengthNet: Deep Learning-based Emotion Strength …

200 papers

Speech synthesis has significantly advanced from statistical methods to deep neural network architectures, leading to various text-to-speech (TTS) models that closely mimic human speech patterns. However, capturing nuances such as emotion…

Sound · Computer Science 2025-01-14 Shaozuo Zhang , Ambuj Mehrish , Yingting Li , Soujanya Poria

Detecting emotions directly from a speech signal plays an important role in effective human-computer interactions. Existing speech emotion recognition models require massive computational and storage resources, making them hard to implement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Arya Aftab , Alireza Morsali , Shahrokh Ghaemmaghami , Benoit Champagne

In this paper, we propose a new deep network that learns multi-level deep representations for image emotion classification (MldrNet). Image emotion can be recognized through image semantics, image aesthetics and low-level visual features…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Tianrong Rao , Min Xu , Dong Xu

Large speech models-derived features have recently shown increased performance over signal-based features across multiple downstream tasks, even when the networks are not finetuned towards the target task. In this paper we show the results…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-02 Adrian Bogdan Stânea , Vlad Striletchi , Cosmin Striletchi , Adriana Stan

Thanks to advancements in deep learning, speech generation systems now power a variety of real-world applications, such as text-to-speech for individuals with speech disorders, voice chatbots in call centers, cross-linguistic speech…

In recent years, prompting has quickly become one of the standard ways of steering the outputs of generative machine learning models, due to its intuitive use of natural language. In this work, we propose a system conditioned on embeddings…

Computation and Language · Computer Science 2024-06-13 Thomas Bott , Florian Lux , Ngoc Thang Vu

In this work, we train fully convolutional networks to detect anger in speech. Since training these deep architectures requires large amounts of data and the size of emotion datasets is relatively small, we use transfer learning. However,…

Machine Learning · Computer Science 2019-02-07 Mohamed Ezzeldin A. ElShaer , Scott Wisdom , Taniya Mishra

State-of-the-art speech synthesis models try to get as close as possible to the human voice. Hence, modelling emotions is an essential part of Text-To-Speech (TTS) research. In our work, we selected FastSpeech2 as the starting point and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-04 Daria Diatlova , Vitaly Shutov

Emotion Classification based on text is a task with many applications which has received growing interest in recent years. This paper presents a preliminary study with the goal to help researchers and practitioners gain insight into…

Computation and Language · Computer Science 2023-03-01 Anna Koufakou , Jairo Garciga , Adam Paul , Joseph Morelli , Christopher Frank

It remains a challenge to effectively control the emotion rendering in text-to-speech (TTS) synthesis. Prior studies have primarily focused on learning a global prosodic representation at the utterance level, which strongly correlates with…

Sound · Computer Science 2024-05-16 Sho Inoue , Kun Zhou , Shuai Wang , Haizhou Li

While deep learning models have greatly improved the performance of most artificial intelligence tasks, they are often criticized to be untrustworthy due to the black-box problem. Consequently, many works have been proposed to study the…

Computation and Language · Computer Science 2021-09-08 Lijie Wang , Hao Liu , Shuyuan Peng , Hongxuan Tang , Xinyan Xiao , Ying Chen , Hua Wu , Haifeng Wang

Recently, deep learning (DL)-based non-intrusive speech assessment models have attracted great attention. Many studies report that these DL-based models yield satisfactory assessment performance and good flexibility, but their performance…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-01 Ryandhimas E. Zezario , Szu-wei Fu , Fei Chen , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

We proposed the industry level deep learning approach for speech emotion recognition task. In industry, carefully proposed deep transfer learning technology shows real results due to mostly low amount of training data availability, machine…

Sound · Computer Science 2021-09-10 Enkhtogtokh Togootogtokh , Christian Klasen

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

Acoustically expressed emotions can make communication with a robot more efficient. Detecting emotions like anger could provide a clue for the robot indicating unsafe/undesired situations. Recently, several deep neural network-based models…

Robotics · Computer Science 2018-04-12 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

Emotion detection from the text is an important and challenging problem in text analytics. The opinion-mining experts are focusing on the development of emotion detection applications as they have received considerable attention of online…

While deep learning has made impressive progress in speech synthesis and voice conversion, the assessment of the synthesized speech is still carried out by human participants. Several recent papers have proposed deep-learning-based…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-10 Yeunju Choi , Youngmoon Jung , Hoirin Kim

Speech is the fundamental mode of human communication, and its synthesis has long been a core priority in human-computer interaction research. In recent years, machines have managed to master the art of generating speech that is…

Neural text-to-speech (TTS) approaches generally require a huge number of high quality speech data, which makes it difficult to obtain such a dataset with extra emotion labels. In this paper, we propose a novel approach for emotional TTS…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-19 Xiong Cai , Dongyang Dai , Zhiyong Wu , Xiang Li , Jingbei Li , Helen Meng

In this work, we address the problem of finegrained traceback of emotional and manipulation characteristics from synthetically manipulated speech. We hypothesize that combining semantic-prosodic cues captured by Speech Foundation Models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-17 Girish , Mohd Mujtaba Akhtar , Farhan Sheth , Muskaan Singh