English
Related papers

Related papers: MRAC Track 1: 2nd Workshop on Multimodal, Generati…

200 papers

Explainable Multimodal Emotion Recognition (EMER) is an emerging task that aims to achieve reliable and accurate emotion recognition. However, due to the high annotation cost, the existing dataset (denoted as EMER-Fine) is small, making it…

Human-Computer Interaction · Computer Science 2024-07-11 Zheng Lian , Haiyang Sun , Licai Sun , Jiangyan Yi , Bin Liu , Jianhua Tao

In recent years, cross-modal reasoning (CMR), the process of understanding and reasoning across different modalities, has emerged as a pivotal area with applications spanning from multimedia analysis to healthcare diagnostics. As the…

Artificial Intelligence · Computer Science 2023-09-15 Dizhan Xue , Shengsheng Qian , Zuyi Zhou , Changsheng Xu

Sensory and emotional experiences such as pain and empathy are essential for mental and physical health. Cognitive neuroscience has been working on revealing mechanisms underlying pain and empathy. Furthermore, as trending research areas,…

Artificial Intelligence · Computer Science 2024-08-27 Siqi Cao , Di Fu , Xu Yang , Stefan Wermter , Xun Liu , Haiyan Wu

Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential…

Computers and Society · Computer Science 2025-03-10 Michael Klenk

This work presents MAD (Multimodal Affection Dataset), a multimodal emotion dataset designed for affective computing and neurophysiological modeling. MAD is built upon synchronous collection of diverse physiological signals (EEG, ECG, EOG,…

Signal Processing · Electrical Eng. & Systems 2026-03-09 Shengwei Guo , Yunqing Qiao , Wenzhan Zhang , Bo Liu , Yong Wang , Guobing Sun

The intricate relationship between human decision-making and emotions, particularly guilt and regret, has significant implications on behavior and well-being. Yet, these emotions subtle distinctions and interplay are often overlooked in…

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

In an era where user interaction with technology is ubiquitous, the importance of user interface (UI) design cannot be overstated. A well-designed UI not only enhances usability but also fosters more natural, intuitive, and emotionally…

Human-Computer Interaction · Computer Science 2024-11-12 Shiyu Duan , Ziyi Wang , Shixiao Wang , Mengmeng Chen , Runsheng Zhang

Test-time scaling has significantly improved how AI models solve problems, yet current methods often get stuck in repetitive, incorrect patterns of thought. We introduce HEART, a framework that uses emotional cues to guide the model's…

Computation and Language · Computer Science 2026-02-24 Gabriela Pinto , Palash Goyal , Mihir Parmar , Yiwen Song , Souradip Chakraborty , Zifeng Wang , Jinsung Yoon , Tomas Pfister , Hamid Palangi

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

The second international CREST workshop continued the focus of the first CREST workshop: addressing approaches to causal reasoning in engineering complex embedded and safety-critical systems. Relevant approaches to causal reasoning have…

Logic in Computer Science · Computer Science 2017-10-10 Alex Groce , Stefan Leue

Recently, emotional talking face generation has received considerable attention. However, existing methods only adopt one-hot coding, image, or audio as emotion conditions, thus lacking flexible control in practical applications and failing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chao Xu , Junwei Zhu , Jiangning Zhang , Yue Han , Wenqing Chu , Ying Tai , Chengjie Wang , Zhifeng Xie , Yong Liu

As emotions play a central role in human communication, automatic emotion recognition has attracted increasing attention in the last two decades. While multimodal systems enjoy high performances on lab-controlled data, they are still far…

Machine Learning · Computer Science 2024-03-20 Denis Dresvyanskiy , Maxim Markitantov , Jiawei Yu , Peitong Li , Heysem Kaya , Alexey Karpov

The objective assessment of human affective and psychological states presents a significant challenge, particularly through non-verbal channels. This paper introduces digital drawing as a rich and underexplored modality for affective…

As digital social platforms and mobile technologies are becoming more prevalent and robust, the use of Artificial Intelligence (AI) in facilitating human communication will grow. This, in turn, will pave the way for the development of…

Human-Computer Interaction · Computer Science 2021-10-29 Roxana Girju

Speech has been a widely used modality in the field of affective computing. Recently however, there has been a growing interest in the use of multi-modal affective computing systems. These multi-modal systems incorporate both verbal and…

Human-Computer Interaction · Computer Science 2018-05-18 Jonny O'Dwyer , Niall Murray , Ronan Flynn

Music is a powerful medium for influencing listeners' emotional states, and this capacity has driven a surge of research interest in AI-based affective music generation in recent years. Many existing systems, however, are a black box which…

Human-Computer Interaction · Computer Science 2025-06-23 Kat R. Agres , Adyasha Dash , Phoebe Chua , Stefan K. Ehrlich

Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as…

Computers and Society · Computer Science 2020-07-29 Procheta Sen , Debasis Ganguly

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

The ability to represent emotion plays a significant role in human cognition and social interaction, yet the high-dimensional geometry of this affective space and its neural underpinnings remain debated. A key challenge, the…

Human-Computer Interaction · Computer Science 2025-09-30 Changde Du , Yizhuo Lu , Zhongyu Huang , Yi Sun , Zisen Zhou , Shaozheng Qin , Huiguang He