English
Related papers

Related papers: UGotMe: An Embodied System for Affective Human-Rob…

200 papers

Social robots aim to establish long-term bonds with humans through engaging conversation. However, traditional conversational approaches, reliant on scripted interactions, often fall short in maintaining engaging conversations. This paper…

Robotics · Computer Science 2024-02-20 Zining Wang , Paul Reisert , Eric Nichols , Randy Gomez

Robotic ultrasound systems can enhance medical diagnostics, but patient acceptance is a challenge. We propose a system combining an AI-powered conversational virtual agent with three mixed reality visualizations to improve trust and…

Human-Computer Interaction · Computer Science 2025-07-18 Tianyu Song , Felix Pabst , Ulrich Eck , Nassir Navab

Human emotions are complex and can be conveyed through nuanced touch gestures. Previous research has primarily focused on how humans recognize emotions through touch or on identifying key features of emotional expression for robots.…

Robotics · Computer Science 2025-08-13 Qiaoqiao Ren , Remko Proesmans , Yuanbo Hou , Francis wyffels , Tony Belpaeme

Humanoid social robots are increasingly present in daily life, making sustained user engagement a critical factor for their effectiveness and acceptance. While prior work has often examined affective evaluations or anthropomorphic design,…

Human-Computer Interaction · Computer Science 2026-02-11 Hangyeol Kang , Thiago Freitas dos Santos , Maher Ben Moussa , Nadia Magnenat-Thalmann

Smart autonomous agents are becoming increasingly important in various real-life applications, including robotics and autonomous vehicles. One crucial skill that these agents must possess is the ability to interact with their surrounding…

Robotics · Computer Science 2024-08-09 Niyati Rawal , Roberto Bigazzi , Lorenzo Baraldi , Rita Cucchiara

Artificial Intelligence (AI) has significantly advanced in recent years, driving innovation across various fields, especially in robotics. Even though robots can perform complex tasks with increasing autonomy, challenges remain in ensuring…

Human-Computer Interaction · Computer Science 2025-03-24 Anargh Viswanath , Lokesh Veeramacheneni , Hendrik Buschmeier

In-vehicle emotion recognition underpins adaptive driver-assistance systems and, ultimately, occupant safety. However, practical deployment is hindered by (i) modality fragility - poor lighting and occlusions degrade vision-based methods;…

Machine Learning · Computer Science 2025-07-23 Baran Can Gül , Suraksha Nadig , Stefanos Tziampazis , Nasser Jazdi , Michael Weyrich

Human-robot interaction relies on a noise-robust audio processing module capable of estimating target speech from audio recordings impacted by environmental noise, as well as self-induced noise, so-called ego-noise. While external ambient…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-28 Huajian Fang , Niklas Wittmer , Johannes Twiefel , Stefan Wermter , Timo Gerkmann

Along with the development of chatbot, language models and speech technologies, there is a growing possibility and interest of creating systems able to interface with humans seamlessly through natural language or directly via speech. In…

Artificial Intelligence · Computer Science 2024-06-14 Frank Joublin , Antonello Ceravola , Cristian Sandu

The integration of emotional support into various conversational scenarios presents profound societal benefits, such as social interactions, mental health counseling, and customer service. However, there are unsolved challenges that hinder…

Computation and Language · Computer Science 2023-08-23 Zhonghua Zheng , Lizi Liao , Yang Deng , Liqiang Nie

Embodied robots which can interact with their environment and neighbours are increasingly being used as a test case to develop Artificial Intelligence. This creates a need for multimodal robot controllers that can operate across different…

Robotics · Computer Science 2025-02-05 William Hunt , Sarvapali D. Ramchurn , Mohammad D. Soorati

Multimodal speech emotion recognition aims to detect speakers' emotions from audio and text. Prior works mainly focus on exploiting advanced networks to model and fuse different modality information to facilitate performance, while…

Computation and Language · Computer Science 2023-04-11 Zhen Wu , Yizhe Lu , Xinyu Dai

Open-domain conversational agents or chatbots are becoming increasingly popular in the natural language processing community. One of the challenges is enabling them to converse in an empathetic manner. Current neural response generation…

Computation and Language · Computer Science 2020-12-09 Anuradha Welivita , Pearl Pu

One of the long-term challenges of robotics is to enable robots to interact with humans in the visual world via natural language, as humans are visual animals that communicate through language. Overcoming this challenge requires the ability…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Yuankai Qi , Qi Wu , Peter Anderson , Xin Wang , William Yang Wang , Chunhua Shen , Anton van den Hengel

Social robots need to understand the affective state of the humans with whom they interact. Successful interactions require understanding mood and emotion in the short term, and personality and attitudes over longer periods. Social robots…

Robotics · Computer Science 2017-05-03 D. B. Skillicorn , N. Alsadhan , R. Billingsley , M. -A. - Williams

Accurate recognition of human emotions is a crucial challenge in affective computing and human-robot interaction (HRI). Emotional states play a vital role in shaping behaviors, decisions, and social interactions. However, emotional…

Robotics · Computer Science 2024-09-19 Youssef Mohamed , Severin Lemaignan , Arzu Guneysu , Patric Jensfelt , Christian Smith

Human-robot collaboration (HRC) has become increasingly relevant in industrial, household, and commercial settings. However, the effectiveness of such collaborations is highly dependent on the human and robots' situational awareness of the…

Robotics · Computer Science 2023-05-09 Chelsea Zou , Kishan Chandan , Yan Ding , Shiqi Zhang

Affective Computing (AC) is essential for advancing Artificial General Intelligence (AGI), with emotion recognition serving as a key component. However, human emotions are inherently dynamic, influenced not only by an individual's…

Computation and Language · Computer Science 2025-03-31 Yupei Li , Qiyang Sun , Sunil Munthumoduku Krishna Murthy , Emran Alturki , Björn W. Schuller

Limited by the computational capabilities and battery energy of terminal devices and network bandwidth, emotion recognition tasks fail to achieve good interactive experience for users. The intolerable latency for users also seriously…

Networking and Internet Architecture · Computer Science 2019-06-06 Long Hu , Wei Li , Jun Yang , Giancarlo Fortino , Min Chen

Understanding the intentions of robots is essential for natural and seamless human-robot collaboration. Ensuring that robots have means for non-verbal communication is a basis for intuitive and implicit interaction. For this, we contribute…

Robotics · Computer Science 2024-10-03 Jan Leusmann , Steeven Villa , Thomas Liang , Chao Wang , Albrecht Schmidt , Sven Mayer