English

Read it to me: An emotionally aware Speech Narration Application

Sound 2022-09-08 v1 Computation and Language Machine Learning Audio and Speech Processing
Authors: Rishibha Bansal
View on arXiv ↗ PDF ↗

Abstract

In this work we try to perform emotional style transfer on audios. In particular, MelGAN-VC architecture is explored for various emotion-pair transfers. The generated audio is then classified using an LSTM-based emotion classifier for audio. We find that "sad" audio is generated well as compared to "happy" or "anger" as people have similar expressions of sadness.

Keywords

speech emotion recognition sentiment analysis speech recognition

Cite

@article{arxiv.2209.02785,
  title  = {Read it to me: An emotionally aware Speech Narration Application},
  author = {Rishibha Bansal},
  journal= {arXiv preprint arXiv:2209.02785},
  year   = {2022}
}

Related papers

View all related →
Audio and Speech Processing · Electrical Eng. & Systems
Speech Emotion Recognition using Support Vector Machine
Manas Jain, Shruthi Narayan, Pratibha Balaji, Bharath K P +3
2020-02-19
Sound · Computer Science
Speech Emotion Detection Based on MFCC and CNN-LSTM Architecture
Qianhe Ouyang
2025-01-22
Sound · Computer Science
Cross-speaker Emotion Transfer by Manipulating Speech Style Latents
Suhee Jo, Younggun Lee, Yookyung Shin, Yeongtae Hwang +1
2023-03-16
Sound · Computer Science
Emotion Recognition from Speech
Kannan Venkataramanan, Haresh Rengaraj Rajamohan
2019-12-24
Human-Computer Interaction · Computer Science
Speech-Based Emotion Recognition using Neural Networks and Information Visualization
Jumana Almahmoud, Kruthika Kikkeri
2021-01-21
Sound · Computer Science
ML-SAN: Multi-Level Speaker-Adaptive Network for Emotion Recognition in Conversations
Kexue Wang, Yinfeng Yu, Liejun Wang
2026-04-29
Sound · Computer Science
Multilingual Speech Emotion Recognition With Multi-Gating Mechanism and Neural Architecture Search
Zihan Wang, Qi Meng, HaiFeng Lan, XinRui Zhang +2
2022-11-17
Computation and Language · Computer Science
Conversational Transfer Learning for Emotion Recognition
Devamanyu Hazarika, Soujanya Poria, Roger Zimmermann, Rada Mihalcea
2020-05-21
Sound · Computer Science
ET-GAN: Cross-Language Emotion Transfer Based on Cycle-Consistent Generative Adversarial Networks
Xiaoqi Jia, Jianwei Tai, Hang Zhou, Yakai Li +3
2020-03-06
Audio and Speech Processing · Electrical Eng. & Systems
Expressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer
Zongyang Du, Berrak Sisman, Kun Zhou, Haizhou Li
2021-10-22
Audio and Speech Processing · Electrical Eng. & Systems
Multi-Modal Emotion Detection with Transfer Learning
Amith Ananthram, Kailash Karthik Saravanakumar, Jessica Huynh, Homayoon Beigi
2020-11-16
Sound · Computer Science
Affective social anthropomorphic intelligent system
Md. Adyelullahil Mamun, Hasnat Md. Abdullah, Md. Golam Rabiul Alam, Muhammad Mehedi Hassan +1
2023-04-24
Computation and Language · Computer Science
Beyond Isolated Utterances: Conversational Emotion Recognition
Raghavendra Pappagari, Piotr Żelasko, Jesús Villalba, Laureano Moro-Velazquez +1
2021-09-14
Computation and Language · Computer Science
Multimodal Speech Emotion Recognition Using Audio and Text
Seunghyun Yoon, Seokhyun Byun, Kyomin Jung
2018-10-11
Computation and Language · Computer Science
Learning Alignment for Multimodal Emotion Recognition from Speech
Haiyang Xu, Hui Zhang, Kun Han, Yun Wang +2
2020-04-06
Sound · Computer Science
Detection and Analysis of Emotion From Speech Signals
Assel Davletcharova, Sherin Sugathan, Bibia Abraham, Alex Pappachen James
2015-06-24
Audio and Speech Processing · Electrical Eng. & Systems
Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speech
Pengfei Wu, Junjie Pan, Chenchang Xu, Junhui Zhang +3
2021-10-12
Sound · Computer Science
Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model
Adelekun Oluwademilade, Ademola Adedamola, Abiola Abdulhakeem, Akinpelu Azeezat +6
2026-04-30
Audio and Speech Processing · Electrical Eng. & Systems
Speech Emotion Recognition with Dual-Sequence LSTM Architecture
Jianyou Wang, Michael Xue, Ryan Culhane, Enmao Diao +2
2020-07-24
Sound · Computer Science
AHD ConvNet for Speech Emotion Classification
Asfand Ali, Danial Nasir, Mohammad Hassan Jawad
2022-06-22
Computation and Language · Computer Science
A Sentiment-and-Semantics-Based Approach for Emotion Detection in Textual Conversations
Umang Gupta, Ankush Chatterjee, Radhakrishnan Srikanth, Puneet Agrawal
2018-04-02
Audio and Speech Processing · Electrical Eng. & Systems
x-vectors meet emotions: A study on dependencies between emotion and speaker recognition
Raghavendra Pappagari, Tianzi Wang, Jesus Villalba, Nanxin Chen +1
2020-02-13
Audio and Speech Processing · Electrical Eng. & Systems
StarGAN-VC++: Towards Emotion Preserving Voice Conversion Using Deep Embeddings
Arnab Das, Suhita Ghosh, Tim Polzehl, Sebastian Stober
2023-09-15
Computer Vision and Pattern Recognition · Computer Science
MFCC based Enlargement of the Training Set for Emotion Recognition in Speech
Inma Mohino-Herranz, Roberto Gil-Pita, Sagrario Alonso-Diaz, Manuel Rosa-Zurera
2014-03-20
Audio and Speech Processing · Electrical Eng. & Systems
DeepEmoNet: Building Machine Learning Models for Automatic Emotion Recognition in Human Speeches
Tai Vu
2025-09-03
R2 v1 2026-06-28T00:50:09.758Z