English
Related papers

Related papers: WEMAC: Women and Emotion Multi-modal Affective Com…

200 papers

Multimodal Sentiment Analysis in Real-life Media (MuSe) 2020 is a Challenge-based Workshop focusing on the tasks of sentiment recognition, as well as emotion-target engagement and trustworthiness detection by means of more comprehensively…

Information processing tasks involve complex cognitive mechanisms that are shaped by various factors, including individual goals, prior experience, and system environments. Understanding such behaviors requires a sophisticated and…

Human-Computer Interaction · Computer Science 2025-07-24 Kaixin Ji , Danula Hettiachchi , Falk Scholer , Flora D. Salim , Damiano Spina

The ever-evolving social media discourse has witnessed an overwhelming use of memes to express opinions or dissent. Besides being misused for spreading malcontent, they are mined by corporations and political parties to glean the public's…

Computers and Society · Computer Science 2024-03-18 Shivam Sharma , Ramaneswaran S , Md. Shad Akhtar , Tanmoy Chakraborty

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

In this study, we illustrate the progress of BCI research and present scores of unveiled contemporary approaches. First, we explore a decoding natural speech approach that is designed to decode human speech directly from the human brain…

Signal Processing · Electrical Eng. & Systems 2022-07-15 Md Jobair Hossain Faruk , Maria Valero , Hossain Shahriar

Assessing progress toward the Sustainable Development Goals (SDGs) requires multi-step reasoning over visual cues, contextual knowledge, and development indicators, where incomplete evidence use and imperfect evidence integration can…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zihang Lin , Huaiyuan Qin , Muli Yang , Hongyuan Zhu

Emotion understanding is a critical yet challenging task. Most existing approaches rely heavily on identity-sensitive information, such as facial expressions and speech, which raises concerns about personal privacy. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deng Li , Bohao Xing , Xin Liu , Baiqiang Xia , Bihan Wen , Heikki Kälviäinen

In a world where technology is increasingly embedded in our everyday experiences, systems that sense and respond to human emotions are elevating digital interaction. At the intersection of artificial intelligence and human-computer…

Human-Computer Interaction · Computer Science 2025-05-06 Karishma Hegde , Hemadri Jayalath

Human affect recognition has been a significant topic in psychophysics and computer vision. However, the currently published datasets have many limitations. For example, most datasets contain frames that contain only information about…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Zhihang Ren , Jefferson Ortega , Yifan Wang , Zhimin Chen , Yunhui Guo , Stella X. Yu , David Whitney

Multimodal Sentiment Analysis (MSA) that integrates Electroencephalogram (EEG) with peripheral physiological signals (PPS) is crucial for the development of brain-computer interface (BCI) systems. However, existing methods encounter three…

Human-Computer Interaction · Computer Science 2026-04-01 Hongyu Zhu , Lin Chen , Mingsheng Shang

In affective computing, the task of Emotion Recognition in Conversations (ERC) has emerged as a focal area of research. The primary objective of this task is to predict emotional states within conversations by analyzing multimodal data…

Multimedia · Computer Science 2024-11-22 Xiaomin Yu , Feiyang Wang , Ziyue Qiao

This article presents our unimodal privacy-safe and non-individual proposal for the audio-video group emotion recognition subtask at the Emotion Recognition in the Wild (EmotiW) Challenge 2020 1. This sub challenge aims to classify in the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Anastasia Petrova , Dominique Vaufreydaz , Philippe Dessus

Visual emotion analysis holds significant research value in both computer vision and psychology. However, existing methods for visual emotion analysis suffer from limited generalizability due to the ambiguity of emotion perception and the…

Artificial Intelligence · Computer Science 2025-07-21 Chuang Chen , Xiao Sun , Zhi Liu

In this work, we present a lightweight and privacy-preserving Multimodal Emotion Recognition (MER) framework designed for deployment on edge devices. To demonstrate framework's versatility, our implementation uses three modalities - speech,…

Artificial Intelligence · Computer Science 2026-02-11 Rémi Grzeczkowicz , Eric Soriano , Ali Janati , Miyu Zhang , Gerard Comas-Quiles , Victor Carballo Araruna , Aneesh Jonelagadda

In this research, we introduce a novel methodology for assessing Emotional Mimicry Intensity (EMI) as part of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild. Our methodology utilises the Wav2Vec 2.0…

Sound · Computer Science 2024-06-18 Tobias Hallmen , Fabian Deuser , Norbert Oswald , Elisabeth André

Despite the abundance of current researches working on the sentiment analysis from videos and audios, finding the best model that gives the highest accuracy rate is still considered a challenge for researchers in this field. The main…

Sound · Computer Science 2024-12-13 Antonio Fernandez , Suzan Awinat

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

Sentiment analysis and emotion recognition in videos are challenging tasks, given the diversity and complexity of the information conveyed in different modalities. Developing a highly competent framework that effectively addresses the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Prasad Chaudhari , Aman Kumar , Chandravardhan Singh Raghaw , Mohammad Zia Ur Rehman , Nagendra Kumar

In the field of affective computing, fully leveraging information from a variety of sensory modalities is essential for the comprehensive understanding and processing of human emotions. Inspired by the process through which the human brain…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xinji Mai , Junxiong Lin , Haoran Wang , Zeng Tao , Yan Wang , Shaoqi Yan , Xuan Tong , Jiawen Yu , Boyang Wang , Ziheng Zhou , Qing Zhao , Shuyong Gao , Wenqiang Zhang