English
Related papers

Related papers: learning discriminative features from spectrograms…

200 papers

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Researches using margin based comparison loss demonstrate the effectiveness of penalizing the distance between face feature and their corresponding class centers. Despite their popularity and excellent performance, they do not explicitly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Ying Huang , Shangfeng Qiu , Wenwei Zhang , Xianghui Luo , Jinzhuo Wang

Discrete speech tokens offer significant advantages for storage and language model integration, but their application in speech emotion recognition (SER) is limited by paralinguistic information loss during quantization. This paper presents…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Esther Sun , Abinay Reddy Naini , Carlos Busso

Humans are able to comprehend information from multiple domains for e.g. speech, text and visual. With advancement of deep learning technology there has been significant improvement of speech recognition. Recognizing emotion from speech is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Mandeep Singh , Yuan Fang

Emotion recognition from speech plays a vital role in the development of empathetic human-computer interaction systems. This paper presents a comparative analysis of lightweight transformer-based models, DistilHuBERT and PaSST, by…

Sound · Computer Science 2025-11-04 Lucky Onyekwelu-Udoka , Md Shafiqul Islam , Md Shahedul Hasan

Speech emotion recognition~(SER) refers to the technique of inferring the emotional state of an individual from speech signals. SERs continue to garner interest due to their wide applicability. Although the domain is mainly founded on…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-29 Sneha Das , Nicklas Leander Lund , Nicole Nadine Lønfeldt , Anne Katrine Pagsberg , Line H. Clemmensen

Different from the emotion recognition in individual utterances, we propose a multimodal learning framework using relation and dependencies among the utterances for conversational emotion analysis. The attention mechanism is applied to the…

Computation and Language · Computer Science 2019-10-25 Zheng Lian , Jianhua Tao , Bin Liu , Jian Huang

Incremental learning is a complex process due to potential catastrophic forgetting of old tasks when learning new ones. This is mainly due to transient features that do not fit from task to task. In this paper, we focus on complex emotion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Thibault Geoffroy , Gauthier Gerspacher , Lionel Prevost

Ensembles of Convolutional neural networks have shown remarkable results in learning discriminative semantic features for image classification tasks. Though, the models in the ensemble often concentrate on similar regions in images. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Tobias Schlagenhauf , Yiwen Lin , Benjamin Noack

Automatic emotion recognition plays a significant role in the process of human computer interaction and the design of Internet of Things (IOT) technologies. Yet, a common problem in emotion recognition systems lies in the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-05 Kexin Feng , Theodora Chaspari

Person re-identification is a challenging task because of the high intra-class variance induced by the unrestricted nuisance factors of variations such as pose, illumination, viewpoint, background, and sensor noise. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Sinan Sabri , Zaigham Randhawa , Gianfranco Doretto

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

Human-Computer Interaction · Computer Science 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

Multilingual speech emotion recognition aims to estimate a speaker's emotional state using a contactless method across different languages. However, variability in voice characteristics and linguistic diversity poses significant challenges…

Computation and Language · Computer Science 2025-03-31 Heqing Zou , Fengmao Lv , Desheng Zheng , Eng Siong Chng , Deepu Rajan

The study proposes and tests a technique for automated emotion recognition through mouth detection via Convolutional Neural Networks (CNN), meant to be applied for supporting people with health disorders with communication skills issues…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Giulio Biondi , Valentina Franzoni , Osvaldo Gervasi , Damiano Perri

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

Sound · Computer Science 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

In emotion recognition from speech, a key challenge lies in identifying speech signal segments that carry the most relevant acoustic variations for discerning specific emotions. Traditional approaches compute functionals for features such…

Computation and Language · Computer Science 2025-06-04 Sofoklis Kakouros

Analysis of speech for recognition of stress is important for identification of emotional state of person. This can be done using 'Linear Techniques', which has different parameters like pitch, vocal tract spectrum, formant frequencies,…

Sound · Computer Science 2012-07-24 A. A. Khulage , Prof. B. V. Pathak

Emotion classification of speech and assessment of the emotion strength are required in applications such as emotional text-to-speech and voice conversion. The emotion attribute ranking function based on Support Vector Machine (SVM) was…

Sound · Computer Science 2022-06-16 Rui Liu , Berrak Sisman , Björn Schuller , Guanglai Gao , Haizhou Li

This paper presents a transfer learning method in speech emotion recognition based on a Time-Delay Neural Network (TDNN) architecture. A major challenge in the current speech-based emotion detection research is data scarcity. The proposed…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Sitong Zhou , Homayoon Beigi

In this paper, we investigate the usage of autoencoders in modeling textual data. Traditional autoencoders suffer from at least two aspects: scalability with the high dimensionality of vocabulary size and dealing with task-irrelevant words.…

Machine Learning · Computer Science 2015-12-15 Shuangfei Zhai , Zhongfei Zhang