English
Related papers

Related papers: MRAC Track 1: 2nd Workshop on Multimodal, Generati…

200 papers

Why should moral philosophers, moral psychologists, and machine ethicists care about computational complexity? Debates on whether artificial intelligence (AI) can or should be used to solve problems in ethical domains have mainly been…

Computational Complexity · Computer Science 2023-02-09 Jakob Stenseke

The presence of artificial agents in human social networks is growing. From chatbots to robots, human experience in the developed world is moving towards a socio-technical system in which agents can be technological or biological, with…

Artificial Intelligence · Computer Science 2019-09-04 Jesse Hoey , Neil J. MacKinnon

Generative AI systems (ChatGPT, DALL-E, etc) are expanding into multiple areas of our lives, from art Rombach et al. [2021] to mental health Rob Morris and Kareem Kouddous [2022]; their rapidly growing societal impact opens new…

Artificial Intelligence · Computer Science 2024-05-21 Alexis Roger , Esma Aïmeur , Irina Rish

Collaborative interactions require social robots to adapt to the dynamics of human affective behaviour. Yet, current approaches for affective behaviour generation in robots focus on instantaneous perception to generate a one-to-one mapping…

Robotics · Computer Science 2022-02-28 Nikhil Churamani , Pablo Barros , Hatice Gunes , Stefan Wermter

The field of affective computing has seen significant advancements in exploring the relationship between emotions and emerging technologies. This paper presents a novel and valuable contribution to this field with the introduction of a…

Artificial Intelligence · Computer Science 2025-01-15 Nessrine Farhat , Amine Bohi , Leila Ben Letaifa , Rim Slama

The objective of the Multiple Appropriate Facial Reaction Generation (MAFRG) task is to produce contextually appropriate and diverse listener facial behavioural responses based on the multimodal behavioural data of the conversational…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Guanyu Hu , Jie Wei , Siyang Song , Dimitrios Kollias , Xinyu Yang , Zhonglin Sun , Odysseus Kaloidas

Empathetic Response Generation (ERG) is one of the key tasks of the affective computing area, which aims to produce emotionally nuanced and compassionate responses to user's queries. However, existing ERG research is predominantly confined…

Multimedia · Computer Science 2025-02-10 Han Zhang , Zixiang Meng , Meng Luo , Hong Han , Lizi Liao , Erik Cambria , Hao Fei

Agentic AI systems capable of autonomous goal setting and proactive intervention introduce new challenges for regulating moral-emotional processes in learning environments. Existing frameworks typically treat emotion as reactive feedback or…

Computers and Society · Computer Science 2026-05-01 Ji Yeon Kim

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Affective sharing within groups strengthens coordination and empathy, leads to better health outcomes, and increases productivity and performance. Existing tools for affective sharing face one main challenge: creating a representation of…

Human-Computer Interaction · Computer Science 2020-10-15 Chao Ying Qin , Marios Constantinides , Luca Maria Aiello , Daniele Quercia

Music is used to convey emotions, and thus generating emotional music is important in automatic music generation. Previous work on emotional music generation directly uses annotated emotion labels as control signals, which suffers from…

Sound · Computer Science 2023-07-06 Chenfei Kang , Peiling Lu , Botao Yu , Xu Tan , Wei Ye , Shikun Zhang , Jiang Bian

As we build towards developing interactive systems that can recognize human emotional states and respond to individual needs more intuitively and empathetically in more personalized and context-aware computing time. This is especially…

Human-Computer Interaction · Computer Science 2024-06-25 Rahul Islam , Sang Won Bae

Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states. Although multimodal large language models excel at multimodal reasoning, they typically treat emotion categories as…

Machine Learning · Computer Science 2026-05-20 Zeheng Wang , Bo Zhao , Yijie Zhu , Zhishu Liu , Hui Ma , Ruixin Zhang , Shouhong Ding , Qianyu Xie , Zitong Yu

The Audio/Visual Emotion Challenge and Workshop (AVEC 2019) "State-of-Mind, Detecting Depression with AI, and Cross-cultural Affect Recognition" is the ninth competition event aimed at the comparison of multimedia processing and machine…

Multimodal emotion recognition (MER) extracts emotions from multimodal data, including visual, speech, and text inputs, playing a key role in human-computer interaction. Attention-based fusion methods dominate MER research, achieving strong…

Artificial Intelligence · Computer Science 2025-06-03 Jiajun He , Jinyi Mi , Tomoki Toda

Although AI is transforming the world, there are serious concerns about its ability to behave and make decisions responsibly. Many ethical regulations, principles, and frameworks for responsible AI have been issued recently. However, they…

Software Engineering · Computer Science 2022-03-17 Qinghua Lu , Liming Zhu , Xiwei Xu , Jon Whittle , Zhenchang Xing

We observe that MLRMs oriented toward human-centric service are highly susceptible to user emotional cues during the deep-thinking stage, often overriding safety protocols or built-in safety checks under high emotional intensity. Inspired…

Artificial Intelligence · Computer Science 2025-08-07 Yuan Xun , Xiaojun Jia , Xinwei Liu , Hua Zhang

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable…

Machine Learning · Computer Science 2024-10-28 Ashish Ramayee Asokan , Nidarshan Kumar , Anirudh Venkata Ragam , Shylaja S Sharath

The ability to understand emotions is an essential component of human-like artificial intelligence, as emotions greatly influence human cognition, decision making, and social interactions. In addition to emotion recognition in…

Computation and Language · Computer Science 2024-07-09 Fanfan Wang , Heqing Ma , Jianfei Yu , Rui Xia , Erik Cambria

This Project was my Undergraduate Final Year dissertation, supervised by Dimitrios Kollias This research delves into the realm of affective computing for image analysis, aiming to enhance the efficiency and effectiveness of multi-task…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Fazeel Asim