English
Related papers

Related papers: Human Emotion Detection from Audio and Video Signa…

200 papers

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

Sound · Computer Science 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

Conversational agents (CAs) are revolutionizing human-computer interaction by evolving from text-based chatbots to empathetic digital humans (DHs) capable of rich emotional expressions. This paper explores the integration of neural and…

Human-Computer Interaction · Computer Science 2025-08-11 Nastaran Saffaryazdi , Tamil Selvan Gunasekaran , Kate Laveys , Elizabeth Broadbent , Mark Billinghurst

Emotion recognition plays a pivotal role in enhancing human-computer interaction, particularly in movie recommendation systems where understanding emotional content is essential. While multimodal approaches combining audio and video have…

Sound · Computer Science 2025-11-25 Xiangrui Xiong , Zhou Zhou , Guocai Nong , Junlin Deng , Ning Wu

Recognizing human affect and emotions is a problem that has a wide range of applications within both academia and industry. Affect and emotion recognition within computer vision primarily relies on images of faces. With the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Elmar Langholz

Human affects are complex paradox and an active research domain in affective computing. Affects are traditionally determined through a self-report based psychometric questionnaire or through facial expression recognition. However, few…

Human-Computer Interaction · Computer Science 2021-02-16 Md. Mahbubur Rahman , Akash Poddar , Md. Golam Rabiul Alam , Samrat Kumar Dey

Understanding emotional signals in older adults is crucial for designing virtual assistants that support their well-being. However, existing affective computing models often face significant limitations: (1) limited availability of datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Josep Lopez Camunas , Cristina Bustos , Yanjun Zhu , Raquel Ros , Agata Lapedriza

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

Computation and Language · Computer Science 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

In this paper, we analyze the performance of an agent developed according to a well-accepted appraisal theory of human emotion with respect to how it modulates play in the context of a social dilemma. We ask if the agent will be capable of…

Artificial Intelligence · Computer Science 2021-07-19 Moojan Ghafurian , Neil Budnarain , Jesse Hoey

Emotion recognition has received considerable attention from the Computer Vision community in the last 20 years. However, most of the research focused on analyzing the six basic emotions (e.g. joy, anger, surprise), with a limited work…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mina Bishay , Jay Turcot , Graham Page , Mohammad Mavadati

Emotion expressions serve as important communicative signals and are crucial cues in intuitive interactions between humans. Hence, it is essential to include these fundamentals in robotic behavior strategies when interacting with humans to…

Robotics · Computer Science 2023-11-08 Thorsten Hempel , Laslo Dinges , Ayoub Al-Hamadi

Acoustically expressed emotions can make communication with a robot more efficient. Detecting emotions like anger could provide a clue for the robot indicating unsafe/undesired situations. Recently, several deep neural network-based models…

Robotics · Computer Science 2018-04-12 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

Existing emotion-aware conversational models usually focus on controlling the response contents to align with a specific emotion class, whereas empathy is the ability to understand and concern the feelings and experience of others. Hence,…

Computation and Language · Computer Science 2021-05-26 Yanran Li , Ke Li , Hongke Ning , xiaoqiang Xia , Yalong Guo , Chen Wei , Jianwei Cui , Bin Wang

Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it…

Machine Learning · Computer Science 2025-10-07 David S. Johnson , Olya Hakobyan , Hanna Drimalla

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

To provide consistent emotional interaction with users, dialog systems should be capable to automatically select appropriate emotions for responses like humans. However, most existing works focus on rendering specified emotions in responses…

Computation and Language · Computer Science 2021-07-01 Wen Zhiyuan , Cao Jiannong , Yang Ruosong , Liu Shuaiqi , Shen Jiaxing

Emotion prediction is a key emerging research area that focuses on identifying and forecasting the emotional state of a human from multiple modalities. Among other data sources, physiological data can serve as an indicator for emotions with…

Machine Learning · Computer Science 2022-01-19 Maryam Khalid , Emily Willis

Electromyography is an unexplored field of study when it comes to alternate input modality while interacting with a computer. However, to make computers understand human emotions is pivotal in the area of human-computer interaction and in…

Human-Computer Interaction · Computer Science 2019-11-14 Muhammad Shihab Rashid , Zubayet Zaman , Hasan Mahmud , Md. Kamrul Hasan

Big data contain rich information for machine learning algorithms to utilize when learning important features during classification tasks. Human beings express their emotion using certain words, speech (tone, pitch, speed) or facial…

Machine Learning · Computer Science 2024-07-02 Mazen Elabd , Sardar Jaf

In Affective computing, recognizing users' emotions accurately is the basis of affective human-computer interaction. Understanding users' interoception contributes to a better understanding of individually different emotional abilities,…

Human-Computer Interaction · Computer Science 2025-04-24 Tadashi Okoshi , Zexiong Gao , Tan Yi Zhen , Takumi Karasawa , Takeshi Miki , Wataru Sasaki , Rajesh K. Balan

People are known to judge artificial intelligence using a utilitarian moral philosophy and humans using a moral philosophy emphasizing perceived intentions. But why do people judge humans and machines differently? Psychology suggests that…

Computers and Society · Computer Science 2023-09-20 Jingling Zhang , Jane Conway , César A. Hidalgo