English
Related papers

Related papers: Visual Response to Emotional State of User Interac…

200 papers

Multimodal speech emotion recognition aims to detect speakers' emotions from audio and text. Prior works mainly focus on exploiting advanced networks to model and fuse different modality information to facilitate performance, while…

Computation and Language · Computer Science 2023-04-11 Zhen Wu , Yizhe Lu , Xinyu Dai

Emotion recognition through artificial intelligence and smart sensing of physical and physiological signals (Affective Computing) is achieving very interesting results in terms of accuracy, inference times, and user-independent models. In…

Human-Computer Interaction · Computer Science 2024-10-08 Laura Gutierrez-Martin , Celia Lopez Ongil , Jose M. Lanza-Gutierrez , Jose A. Miranda Calero

We put forth Physiologically Driven Storytelling, a new approach to interactive storytelling where narratives adaptively unfold based on the reader's physiological state. We first describe a taxonomy framing how physiological signals can be…

Human-Computer Interaction · Computer Science 2020-03-23 Jérémy Frey , Gilad Ostrin , May Grabli , Jessica Cauchard

Beyond conventional productivity metrics, human interaction and collaboration dynamics merit careful consideration in our increasingly digital workspace. This research proposes a conjectural neuro-adaptive room that enhances group…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Adán Flores-Ramírez , Ángel Mario Alarcón-López , Sofía Vaca-Narvaja , Daniela Leo-Orozco

The Audio/Visual Emotion Challenge and Workshop (AVEC 2019) "State-of-Mind, Detecting Depression with AI, and Cross-cultural Affect Recognition" is the ninth competition event aimed at the comparison of multimedia processing and machine…

This paper proposes a novel 3D speech-to-animation (STA) generation framework designed to address the shortcomings of existing models in producing diverse and emotionally resonant animations. Current STA models often generate animations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xulong Zhang , Xiaoyang Qu , Haoxiang Shi , Chunguang Xiao , Jianzong Wang

This study investigates innovative interaction designs for communication and collaborative learning between learners of mixed hearing and signing abilities, leveraging advancements in mixed reality technologies like Apple Vision Pro and…

Human-Computer Interaction · Computer Science 2025-03-11 Si Chen , Haocong Cheng , Suzy Su , Stephanie Patterson , Raja Kushalnagar , Qi Wang , Yun Huang

Mixed Reality is increasingly used in mobile settings beyond controlled home and office spaces. This mobility introduces the need for user interface layouts that adapt to varying contexts. However, existing adaptive systems are designed…

Human-Computer Interaction · Computer Science 2024-09-20 Zhipeng Li , Christoph Gebhardt , Yves Inglin , Nicolas Steck , Paul Streli , Christian Holz

The efficient integration of multisensory observations is a key property of the brain that yields the robust interaction with the environment. However, artificial multisensory perception remains an open issue especially in situations of…

Artificial Intelligence · Computer Science 2018-10-17 Di Fu , Pablo Barros , German I. Parisi , Haiyan Wu , Sven Magg , Xun Liu , Stefan Wermter

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Real-time captioning is vital for Deaf and Hard of Hearing (DHH) and neurodivergent learners (e.g., those with ADHD), yet it often omits emotional and non-verbal cues essential for comprehension. This omission is particularly consequential…

Human-Computer Interaction · Computer Science 2026-03-24 Sunday David Ubur , Eugenia Ha Rim Rho , Denis Gracanin

Sentiment analysis is the Natural Language Processing (NLP) task dealing with the detection and classification of sentiments in texts. While some tasks deal with identifying the presence of sentiment in the text (Subjectivity analysis),…

Computation and Language · Computer Science 2017-07-06 Souvick Ghosh , Satanu Ghosh , Dipankar Das

Affective computing has recently gained popularity, especially in the field of human-computer interaction systems, where effectively evoking and detecting emotions is of paramount importance to enhance users experience. However, several…

Human-Computer Interaction · Computer Science 2024-07-15 S. M. Hossein Mousavi , Matteo Besenzoni , Davide Andreoletti , Achille Peternier , Silvia Giordano

Although the terms mood and emotion are closely related and often used interchangeably, they are distinguished based on their duration, intensity and attribution. To date, hardly any computational models have (a) examined mood recognition,…

Human-Computer Interaction · Computer Science 2022-10-04 Soujanya Narayana , Ramanathan Subramanian , Ibrahim Radwan , Roland Goecke

With advancements in multimodal communication technologies, remote learning environments such as, distance universities are increasing. Remote learning typically happens asynchronously. As a consequence, unlike face-to-face in-person…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-14 Sargam Vyas , Bogdan Vlasenko , André Mayoraz , Egon Werlen , Per Bergamin , Mathew Magimai. -Doss

Humans possess a remarkable talent for flexibly alternating to different senses when interacting with the environment. Picture a chef skillfully gauging the timing of ingredient additions and controlling the heat according to the colors,…

Robotics · Computer Science 2024-10-28 Ruoxuan Feng , Di Hu , Wenke Ma , Xuelong Li

Affective computing - combining sensor technology, machine learning, and psychology - have been studied for over three decades and is employed in AI-powered technologies to enhance emotional awareness in AI systems, and detect symptoms of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Anders Rolighed Larsen , Sneha Das , Nicole Nadine Lønfeldt , Paula Petcu , Line Clemmensen

In remote and hybrid work contexts, the integration of physical and digital environments is revolutionizing spatial experiences, collaboration, and interpersonal interactions. This study examines three fundamental spatial conditions: the…

Sentiment analysis aims to extract and express a person's perception, opinions and emotions towards an entity, object, product and a service, enabling businesses to obtain feedback from the consumers. The increasing popularity of the social…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Kashif Ahmad , Syed Zohaib , Nicola Conci , Ala Al-Fuqaha

Recent years have seen immense progress in 3D computer vision and computer graphics, with emerging tools that can virtualize real-world 3D environments for numerous Mixed Reality (XR) applications. However, alongside immersive visual…

Sound · Computer Science 2024-06-12 Mason Wang , Ryosuke Sawata , Samuel Clarke , Ruohan Gao , Shangzhe Wu , Jiajun Wu