English
Related papers

Related papers: Multimodal Affect Analysis for Product Feedback As…

200 papers

Multimodal emotion recognition (MER) aims to detect the emotional status of a given expression by combining the speech and text information. Intuitively, label information should be capable of helping the model locate the salient…

Computation and Language · Computer Science 2023-09-06 Peiying Wang , Sunlu Zeng , Junqing Chen , Lu Fan , Meng Chen , Youzheng Wu , Xiaodong He

Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects…

Computation and Language · Computer Science 2018-05-23 Yue Gu , Kangning Yang , Shiyu Fu , Shuhong Chen , Xinyu Li , Ivan Marsic

We present an approach utilizing Topological Data Analysis to study the structure of face poses used in affective computing, i.e., the process of recognizing human emotion. The approach uses a conditional comparison of different emotions,…

Human-Computer Interaction · Computer Science 2021-08-04 Hamza Elhamdadi , Shaun Canavan , Paul Rosen

Human affects are complex paradox and an active research domain in affective computing. Affects are traditionally determined through a self-report based psychometric questionnaire or through facial expression recognition. However, few…

Human-Computer Interaction · Computer Science 2021-02-16 Md. Mahbubur Rahman , Akash Poddar , Md. Golam Rabiul Alam , Samrat Kumar Dey

With the growing integration of human-computer interaction into everyday life, advances in machine learning have enabled systems to better perceive and respond to users' emotional states. Most existing affect recognition datasets focus on…

Machine Learning · Computer Science 2026-05-04 Karim Alghoul , Faisal Mohd , Fedwa Laamarti , Hussein Al Osman , Abdulmotaleb El Saddik

Human-Computer Interaction (HCI) is a multi-modal, interdisciplinary field focused on designing, studying, and improving the interactions between people and computer systems. This involves the design of systems that can recognize,…

Human-Computer Interaction · Computer Science 2025-08-15 Paul Schreiber , Beyza Cinar , Lennart Mackert , Maria Maleshkova

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

Computation and Language · Computer Science 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiwen Zheng , Xuri Ge , Junchen Fu , Jun Peng , Joemon M. Jose

In this work, user's emotion using its facial expressions will be detected. These expressions can be derived from the live feed via system's camera or any pre-exisiting image available in the memory. Emotions possessed by humans can be…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Raghav Puri , Archit Gupta , Manas Sikri , Mohit Tiwari , Nitish Pathak , Shivendra Goel

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Sachihiro Youoku , Yuushi Toyoda , Takahisa Yamamoto , Junya Saito , Ryosuke Kawamura , Xiaoyu Mi , Kentaro Murase

Despite the abundance of current researches working on the sentiment analysis from videos and audios, finding the best model that gives the highest accuracy rate is still considered a challenge for researchers in this field. The main…

Sound · Computer Science 2024-12-13 Antonio Fernandez , Suzan Awinat

Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understanding how visual content shapes cognitive interpretations and elicits specific affective…

Artificial Intelligence · Computer Science 2026-04-28 Nastaran Dab , Raziyeh Zall , Mohammadreza Kangavari

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

Multimedia · Computer Science 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

Deep convolutional neural networks have been shown to successfully recognize facial emotions for the past years in the realm of computer vision. However, the existing detection approaches are not always reliable or explainable, we here…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Jiawen Wang , Leah Kawka

Electromyography is an unexplored field of study when it comes to alternate input modality while interacting with a computer. However, to make computers understand human emotions is pivotal in the area of human-computer interaction and in…

Human-Computer Interaction · Computer Science 2019-11-14 Muhammad Shihab Rashid , Zubayet Zaman , Hasan Mahmud , Md. Kamrul Hasan

Accurate recognition of human emotions is a crucial challenge in affective computing and human-robot interaction (HRI). Emotional states play a vital role in shaping behaviors, decisions, and social interactions. However, emotional…

Robotics · Computer Science 2024-09-19 Youssef Mohamed , Severin Lemaignan , Arzu Guneysu , Patric Jensfelt , Christian Smith

After the development of different machine learning and manifold learning algorithms, it may be a good time to put them together to make a powerful mind for machine. In this work, we propose affective manifolds as components of a machine's…

Machine Learning · Computer Science 2022-08-30 Benyamin Ghojogh

Micro-expressions are brief spontaneous facial expressions that appear on a face when a person conceals an emotion, making them different to normal facial expressions in subtlety and duration. Currently, emotion classes within the CASME II…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Adrian K. Davison , Walied Merghani , Moi Hoon Yap

Dynamic facial expression recognition has many useful applications in social networks, multimedia content analysis, security systems and others. This challenging process must be done under recurrent problems of image illumination and low…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ali Raza Shahid , Sheheryar Khan , Hong Yan

Psychological studies indicate that emotional states are expressed in the way people walk and the human gait is investigated in terms of its ability to reveal a person's emotional state. And Microsoft Kinect is a rapidly developing,…

Computers and Society · Computer Science 2015-08-05 Shun Li , Changye Zhu , Liqing Cui , Nan Zhao , Baobin Li , Tingshao Zhu
‹ Prev 1 3 4 5 6 7 10 Next ›