English
Related papers

Related papers: Analysis of speech under stress using Linear techn…

200 papers

We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the…

Multimedia · Computer Science 2017-08-01 Erik Cambria , Devamanyu Hazarika , Soujanya Poria , Amir Hussain , R. B. V. Subramaanyam

This paper proposes a personalization method for speech emotion recognition (SER) through in-context learning (ICL). Since the expression of emotions varies from person to person, speaker-specific adaptation is crucial for improving the SER…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-11 Mana Ihori , Taiga Yamane , Naotaka Kawata , Naoki Makishima , Tomohiro Tanaka , Satoshi Suzuki , Shota Orihashi , Ryo Masumura

Identifying the emotional state from speech is essential for the natural interaction of the machine with the speaker. However, extracting effective features for emotion recognition is difficult, as emotions are ambiguous. We propose a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Dongyang Dai , Zhiyong Wu , Runnan Li , Xixin Wu , Jia Jia , Helen Meng

Emotion classification in text is typically performed with neural network models which learn to associate linguistic units with emotions. While this often leads to good predictive performance, it does only help to a limited degree to…

Computation and Language · Computer Science 2022-05-17 Felix Casel , Amelie Heindl , Roman Klinger

Sentiment analysis has evolved over past few decades, most of the work in it revolved around textual sentiment analysis with text mining techniques. But audio sentiment analysis is still in a nascent stage in the research community. In this…

Computation and Language · Computer Science 2018-02-20 Maghilnan S , Rajesh Kumar M

In this paper, we explore the use of pre-trained language models to learn sentiment information of written texts for speech sentiment analysis. First, we investigate how useful a pre-trained language model would be in a 2-step pipeline…

Computation and Language · Computer Science 2021-06-15 Suwon Shon , Pablo Brusco , Jing Pan , Kyu J. Han , Shinji Watanabe

Emotion detection from text seeks to identify an individual's emotional or mental state - positive, negative, or neutral - based on linguistic cues. While significant progress has been made for English and other high-resource languages,…

Computation and Language · Computer Science 2025-11-11 Abdullah Al Maruf , Aditi Golder , Zakaria Masud Jiyad , Abdullah Al Numan , Tarannum Shaila Zaman

We investigate the effect and usefulness of spontaneity (i.e. whether a given speech is spontaneous or not) in speech in the context of emotion recognition. We hypothesize that emotional content in speech is interrelated with its…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-15 Karttikeya Mangalam , Tanaya Guha

Speech emotion recognition is a challenging task in speech processing field. For this reason, feature extraction process has a crucial importance to demonstrate and process the speech signals. In this work, we represent a model, which feeds…

Sound · Computer Science 2023-07-07 Zeynep Hilal Kilimci , Ulku Bayraktar , Ayhan Kucukmanisa

Speech emotion recognition (SER) is crucial for enhancing affective computing and enriching the domain of human-computer interaction. However, the main challenge in SER lies in selecting relevant feature representations from speech signals…

Sound · Computer Science 2024-12-16 Niloy Kumar Kundu , Sarah Kobir , Md. Rayhan Ahmed , Tahmina Aktar , Niloya Roy

This paper investigates the possibility of creating a machine learning tool that automatically determines the state of mind and emotion of an individual through a questionnaire, without the aid of a human expert. The state of mind and…

Machine Learning · Computer Science 2021-08-10 Rodrigo S. Jamisola

Detection of human emotions based on facial images in real-world scenarios is a difficult task due to low image quality, variations in lighting, pose changes, background distractions, small inter-class variations, noisy crowd-sourced…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sahil Naik , Soham Bagayatkar , Pavankumar Singh

Accurately detecting emotions in conversation is a necessary yet challenging task due to the complexity of emotions and dynamics in dialogues. The emotional state of a speaker can be influenced by many different factors, such as…

Computation and Language · Computer Science 2023-02-07 Jiachen Luo , Huy Phan , Joshua Reiss

Human affects are complex paradox and an active research domain in affective computing. Affects are traditionally determined through a self-report based psychometric questionnaire or through facial expression recognition. However, few…

Human-Computer Interaction · Computer Science 2021-02-16 Md. Mahbubur Rahman , Akash Poddar , Md. Golam Rabiul Alam , Samrat Kumar Dey

Speech Emotion Recognition (SER) is crucial in human-machine interactions. Mainstream approaches utilize Convolutional Neural Networks or Recurrent Neural Networks to learn local energy feature representations of speech segments from speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Xiaoyu Tang , Yixin Lin , Ting Dang , Yuanfang Zhang , Jintao Cheng

Inter-subject or subject-independent emotion recognition has been a challenging task in affective computing. This work is about an easy-to-implement emotion recognition model that classifies emotions from EEG signals subject independently.…

Human-Computer Interaction · Computer Science 2023-12-27 Mohammad Asif , Diya Srivastava , Aditya Gupta , Uma Shanker Tiwary

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

Artificial Intelligence · Computer Science 2024-02-13 Minoo Shayaninasab , Bagher Babaali

Knowledge of users' emotion states helps improve human-computer interaction. In this work, we presented EmoNet, an emotion detector of Chinese daily dialogues based on deep convolutional neural networks. In order to maintain the original…

Computation and Language · Computer Science 2017-10-04 Jialiang Zhao , Qi Gao

This paper illustrates our submission method to the fourth Affective Behavior Analysis in-the-Wild (ABAW) Competition. The method is used for the Multi-Task Learning Challenge. Instead of using only face information, we employ full…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Irfan Haider , Minh-Trieu Tran , Soo-Hyung Kim , Hyung-Jeong Yang , Guee-Sang Lee

In this paper, we evaluate the different features sets, feature types, and classifiers on both song and speech emotion recognition. Three feature sets: GeMAPS, pyAudioAnalysis, and LibROSA; two feature types: low-level descriptors and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Bagus Tris Atmaja , Masato Akagi