English
Related papers

Related papers: Multi-Modal Emotion recognition on IEMOCAP Dataset…

200 papers

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

Machine Learning · Computer Science 2025-06-23 Tri Duc Ly , Gia H. Ngo

Emotion recognition based on electroencephalography (EEG) has received attention as a way to implement human-centric services. However, there is still much room for improvement, particularly in terms of the recognition accuracy. In this…

Human-Computer Interaction · Computer Science 2018-09-13 Seong-Eun Moon , Soobeom Jang , Jong-Seok Lee

There is an imminent need for guidelines and standard test sets to allow direct and fair comparisons of speech emotion recognition (SER). While resources, such as the Interactive Emotional Dyadic Motion Capture (IEMOCAP) database, have…

The significance of emotion detection is increasing in education, entertainment, and various other domains. We are developing a system that can identify and transform facial expressions into emojis to provide immediate feedback.The project…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Abhilash Khuntia , Shubham Kale

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Deep learning is popular as an end-to-end framework extracting the prominent features and performing the classification also. In this paper, we extensively investigate deep networks as an alternate to feature encoding technique of low level…

Machine Learning · Computer Science 2018-11-15 Bhalaji Nagarajan , V Ramana Murthy Oruganti

Studies on emotion recognition (ER) show that combining lexical and acoustic information results in more robust and accurate models. The majority of the studies focus on settings where both modalities are available in training and…

Computation and Language · Computer Science 2019-06-26 Gustavo Aguilar , Viktor Rozgić , Weiran Wang , Chao Wang

Speech emotion recognition (SER) has been a challenging problem in spoken language processing research, because it is unclear how human emotions are connected to various components of sounds such as pitch, loudness, and energy. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tai Vu

The integration of dialogue interfaces in mobile devices has become ubiquitous, providing a wide array of services. As technology progresses, humanoid robots designed with human-like features to interact effectively with people are gaining…

Human-Computer Interaction · Computer Science 2025-01-14 Mohamed Ala Yahyaoui , Mouaad Oujabour , Leila Ben Letaifa , Amine Bohi

Emotion Recognition in Conversations (ERC) is crucial in developing sympathetic human-machine interaction. In conversational videos, emotion can be present in multiple modalities, i.e., audio, video, and transcript. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Vishal Chudasama , Purbayan Kar , Ashish Gudmalwar , Nirmesh Shah , Pankaj Wasnik , Naoyuki Onoe

Recognizing emotions from text in multimodal architectures has yielded promising results, surpassing video and audio modalities under certain circumstances. However, the method by which multimodal data is collected can be significant for…

Machine Learning · Computer Science 2021-03-08 A. Sutherland , S. Magg , C. Weber , S. Wermter

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Facial expression recognition has been an active research area over the past few decades, and it is still challenging due to the high intra-class variation. Traditional approaches for this problem rely on hand-crafted features such as SIFT,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Shervin Minaee , Amirali Abdolrashidi

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

With the fast development of artificial intelligence and short videos, emotion recognition in short videos has become one of the most important research topics in human-computer interaction. At present, most emotion recognition methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xuecheng Wu , Mengmeng Tian , Lanhang Zhai

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Recognizing a speaker's emotion from their speech can be a key element in emergency call centers. End-to-end deep learning systems for speech emotion recognition now achieve equivalent or even better results than conventional machine…

Artificial Intelligence · Computer Science 2021-10-29 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers