English
Related papers

Related papers: A Multimodal Emotion Sensing Platform for Building…

200 papers

As we build towards developing interactive systems that can recognize human emotional states and respond to individual needs more intuitively and empathetically in more personalized and context-aware computing time. This is especially…

Human-Computer Interaction · Computer Science 2024-06-25 Rahul Islam , Sang Won Bae

Affective computing - combining sensor technology, machine learning, and psychology - have been studied for over three decades and is employed in AI-powered technologies to enhance emotional awareness in AI systems, and detect symptoms of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Anders Rolighed Larsen , Sneha Das , Nicole Nadine Lønfeldt , Paula Petcu , Line Clemmensen

Human emotion is expressed in many communication modalities and media formats and so their computational study is equally diversified into natural language processing, audio signal analysis, computer vision, etc. Similarly, the large…

Machine Learning · Computer Science 2023-08-16 Sven Buechel , Udo Hahn

Many individuals especially those with autism spectrum disorder (ASD), alexithymia, or other neurodivergent profiles face challenges in recognizing, expressing, or interpreting emotions. To support more inclusive and personalized emotion…

Human-Computer Interaction · Computer Science 2025-08-14 Von Ralph Dane Marquez Herbuela , Yukie Nagai

Consumers often react expressively to products such as food samples, perfume, jewelry, sunglasses, and clothing accessories. This research discusses a multimodal affect recognition system developed to classify whether a consumer likes or…

Human-Computer Interaction · Computer Science 2017-05-09 Amol S Patwardhan , Gerald M Knapp

Sentiment Analysis and Emotion Detection in conversation is key in several real-world applications, with an increase in modalities available aiding a better understanding of the underlying emotions. Multi-modal Emotion Detection and…

Computation and Language · Computer Science 2020-08-04 Aman Shenoy , Ashish Sardana

As technologies become more and more pervasive, there is a need for considering the affective dimension of interaction with computer systems to make them more human-like. Current demands for this matter include accurate emotion recognition,…

Human-Computer Interaction · Computer Science 2018-06-13 Barbara Giżycka , Grzegorz J. Nalepa , Paweł Jemioło

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

Computation and Language · Computer Science 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Related tasks often have inter-dependence on each other and perform better when solved in a joint framework. In this paper, we present a deep multi-task learning framework that jointly performs sentiment and emotion analysis both. The…

Computation and Language · Computer Science 2019-05-16 Md Shad Akhtar , Dushyant Singh Chauhan , Deepanway Ghosal , Soujanya Poria , Asif Ekbal , Pushpak Bhattacharyya

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

We introduce the concept of "empathic grounding" in conversational agents as an extension of Clark's conceptualization of grounding in conversation in which the grounding criterion includes listener empathy for the speaker's affective…

Human-Computer Interaction · Computer Science 2024-07-03 Mehdi Arjmand , Farnaz Nouraei , Ian Steenstra , Timothy Bickmore

Multimodality can make (especially mobile) device interaction more efficient. Sensors and communication capabilities of modern smartphones and tablets lay the technical basis for its implementation. Still, mobile platforms do not make…

Human-Computer Interaction · Computer Science 2014-06-13 Andreas Möller , Stefan Diewald , Luis Roalter , Matthias Kranz

Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced…

Computation and Language · Computer Science 2022-05-06 Abhinav Joshi , Ashwani Bhat , Ayush Jain , Atin Vikram Singh , Ashutosh Modi

Speech emotion recognition is a challenging research topic that plays a critical role in human-computer interaction. Multimodal inputs further improve the performance as more emotional information is used. However, existing studies learn…

Sound · Computer Science 2023-02-28 Weidong Chen , Xiaofeng Xing , Xiangmin Xu , Jichen Yang , Jianxin Pang

The continuous improvement of human-computer interaction technology makes it possible to compute emotions. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). Sentiment…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tao Shu , Xinke Wang , Ruotong Wang , Chuang Chen , Yixin Zhang , Xiao Sun

Limited by the computational capabilities and battery energy of terminal devices and network bandwidth, emotion recognition tasks fail to achieve good interactive experience for users. The intolerable latency for users also seriously…

Networking and Internet Architecture · Computer Science 2019-06-06 Long Hu , Wei Li , Jun Yang , Giancarlo Fortino , Min Chen

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within…

Computation and Language · Computer Science 2018-11-14 Bernhard Kratzwald , Suzana Ilic , Mathias Kraus , Stefan Feuerriegel , Helmut Prendinger

Understanding Affect from video segments has brought researchers from the language, audio and video domains together. Most of the current multimodal research in this area deals with various techniques to fuse the modalities, and mostly…

Computation and Language · Computer Science 2018-06-11 Saurav Sahay , Shachi H Kumar , Rui Xia , Jonathan Huang , Lama Nachman

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada