English
Related papers

Related papers: Face2Feel: Emotion-Aware Adaptive User Interface

200 papers

As voice assistants (VAs) become increasingly integrated into daily life, the need for emotion-aware systems that can recognize and respond appropriately to user emotions has grown. While significant progress has been made in speech emotion…

Human-Computer Interaction · Computer Science 2025-02-24 Yong Ma , Yuchong Zhang , Di Fu , Stephanie Zubicueta Portales , Danica Kragic , Morten Fjeld

Adaptive User Interfaces (AUI) play a crucial role in modern software applications by dynamically adjusting interface elements to accommodate users' diverse and evolving needs. However, existing adaptation strategies often lack real-time…

Human-Computer Interaction · Computer Science 2025-04-30 Daniel Gaspar-Figueiredo , Marta Fernández-Diego , Silvia Abrahão , Emilio Insfran

This article presents a multimodal emotion recognition module integrated into a proactive Socially Interactive Agent (SIA) powered by generative artificial intelligence. The system evaluates real-time affective states through two distinct…

Human-Computer Interaction · Computer Science 2026-05-21 Adnana Dragut , Raquel Lacuesta , F. Xavier Gaya-Morey , Jose M. Buades-Rubio

The interaction context (or environment) is key to any HCI task and especially to adaptive user interfaces (AUIs), since it represents the conditions under which users interact with computers. Unfortunately, there are currently no formal…

Human-Computer Interaction · Computer Science 2022-04-01 Mateusz Dubiel , Bereket Abera Yilma , Kayhan Latifzadeh , Luis A. Leiva

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

Modeling face-to-face communication in computer vision, which focuses on recognizing and analyzing nonverbal cues and behaviors during interactions, serves as the foundation for our proposed alternative to text-based Human-AI interaction.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Dragos Costea , Alina Marcu , Cristina Lazar , Marius Leordeanu

The significance of emotion detection is increasing in education, entertainment, and various other domains. We are developing a system that can identify and transform facial expressions into emojis to provide immediate feedback.The project…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Abhilash Khuntia , Shubham Kale

This study presents high-throughput, real-time multi-agent affective computing framework designed to enhance classroom learning through emotional state monitoring. As large classroom sizes and limited teacher student interaction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hai Nguyen , Hieu Dao , Hung Nguyen , Nam Vu , Cong Tran

As the boundaries of human computer interaction expand, Generative AI emerges as a key driver in reshaping user interfaces, introducing new possibilities for personalized, multimodal and cross-platform interactions. This integration…

Human-Computer Interaction · Computer Science 2024-11-18 J. Bieniek , M. Rahouti , D. C. Verma

Front-end personalization has traditionally relied on static designs or rule-based adaptations, which fail to fully capture user behavior patterns. This paper presents an AI driven approach for dynamic front-end personalization, where UI…

Human-Computer Interaction · Computer Science 2026-02-04 Mona Rajhans

Adaptive user interfaces (UIs) automatically change an interface to better support users' tasks. Recently, machine learning techniques have enabled the transition to more powerful and complex adaptive UIs. However, a core challenge for…

Human-Computer Interaction · Computer Science 2023-10-30 Thomas Langerak , Sammy Christen , Mert Albaba , Christoph Gebhardt , Otmar Hilliges

Expression recognition holds great promise for applications such as content recommendation and mental healthcare by accurately detecting users' emotional states. Traditional methods often rely on cameras or wearable sensors, which raise…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Guangjing Wang , Juexing Wang , Ce Zhou , Weikang Ding , Huacheng Zeng , Tianxing Li , Qiben Yan

Considerable effort has been devoted to the automatic extraction of information about action of the face from image sequences. Within the context of human-computer interaction (HCI) we may distinguish systems that allow expression from…

Human-Computer Interaction · Computer Science 2020-10-06 Michael J. Lyons

How much can we infer about an emotional voice solely from an expressive face? This intriguing question holds great potential for applications such as virtual character dubbing and aiding individuals with expressive language disorders.…

Sound · Computer Science 2025-02-04 Jiaxin Ye , Boyuan Cao , Hongming Shan

Many intelligent user interfaces employ application and user models to determine the user's preferences, goals and likely future actions. Such models require application analysis, adaptation and expansion. Building and maintaining such…

Artificial Intelligence · Computer Science 2013-01-18 Peter J. Gorniak , David L. Poole

Multimodal sentiment analysis benefits various applications such as human-computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm…

Machine Learning · Computer Science 2021-06-29 Sana Rahmani , Saeid Hosseini , Raziyeh Zall , Mohammad Reza Kangavari , Sara Kamran , Wen Hua

Emotions are best way of communicating information; and sometimes it carry more information than words. Recently, there has been a huge interest in automatic recognition of human emotion because of its wide spread application in security,…

Computer Vision and Pattern Recognition · Computer Science 2013-12-05 Nikunj Bajaj , Aurobinda Routray , S L Happy

Ideas about how to increase the unconscious participation in interaction between 'a human' and 'a computer' are developed in this paper. Evidence of impact of the unconscious functioning is presented. The unconscious is characterised as…

Human-Computer Interaction · Computer Science 2009-11-02 Richard V. Diamond

Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent agents and systems. However, key challenges remain in utilizing FER in real-world contexts, including ensuring user…

Human-Computer Interaction · Computer Science 2025-07-31 Sanjeev Nahulanthran , Leimin Tian , Dana Kulić , Mor Vered

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao