English
Related papers

Related papers: Multimodal Signal Processing and Learning Aspects …

200 papers

There has been a growing interest in extending the capabilities of autonomous underwater vehicles (AUVs) in subsea missions, particularly in integrating underwater human-robot interaction (UHRI) for control. UHRI and its subfield,underwater…

Robotics · Computer Science 2024-06-25 Sara Aldhaheri , Federico Renda , Giulia De Masi

Integrated control of wheelchairs and wheelchair-mounted robotic arms (WMRAs) has strong potential to increase independence for users with severe motor limitations, yet existing interfaces often lack the flexibility needed for intuitive…

Robotics · Computer Science 2026-04-17 Guangping Liu , Nicholas Hawkins , Billy Madden , Tipu Sultan , Flavio Esposito , Madi Babaiasl

Recent advances in multimodal Human-Robot Interaction (HRI) datasets emphasize the integration of speech and gestures, allowing robots to absorb explicit knowledge and tacit understanding. However, existing datasets primarily focus on…

Robotics · Computer Science 2025-02-25 Snehesh Shrestha , Yantian Zha , Saketh Banagiri , Ge Gao , Yiannis Aloimonos , Cornelia Fermüller

As intelligent robots become more integrated into human environments, there is a growing need for intuitive and reliable Human-Robot Interaction (HRI) interfaces that are adaptable and more natural to interact with. Traditional robot…

This article presents a method for learning well-coordinated Human-Robot Interaction (HRI) from Human-Human Interactions (HHI). We devise a hybrid approach using Hidden Markov Models (HMMs) as the latent space priors for a Variational…

Human-robot collaboration has benefited users with higher efficiency towards interactive tasks. Nevertheless, most collaborative schemes rely on complicated human-machine interfaces, which might lack the requisite intuitiveness compared…

Robotics · Computer Science 2024-10-28 Haolin Fei , Stefano Tedeschi , Yanpei Huang , Andrew Kennedy , Ziwei Wang

Robots learn as they interact with humans. Consider a human teleoperating an assistive robot arm: as the human guides and corrects the arm's motion, the robot gathers information about the human's desired task. But how does the human know…

Robotics · Computer Science 2024-04-16 James F. Mullen , Josh Mosier , Sounak Chakrabarti , Anqi Chen , Tyler White , Dylan P. Losey

Recently, human-robot interaction (HRI) is an extensive research topic and theme which gained importance and significance. HRI aims at the complementary combination between the robot capabilities and human skills. The robots assist humans…

Robotics · Computer Science 2021-02-02 Abdel-Nasser Sharkawy

To effectively engage in human society, the ability to adapt, filter information, and make informed decisions in ever-changing situations is critical. As robots and intelligent agents become more integrated into human life, there is a…

Artificial Intelligence · Computer Science 2025-11-13 Mingyang Mao , Mariela M. Perez-Cabarcas , Utteja Kallakuri , Nicholas R. Waytowich , Xiaomin Lin , Tinoosh Mohsenin

This paper introduces RABBIT, a novel robot-assisted bed bathing system designed to address the growing need for assistive technologies in personal hygiene tasks. It combines multimodal perception and dual (software and hardware) compliance…

Successful adoption of industrial robots will strongly depend on their ability to safely and efficiently operate in human environments, engage in natural communication, understand their users, and express intentions intuitively while…

Robotics · Computer Science 2025-02-26 Tim Schreiter , Andrey Rudenko , Jens V. Rüppel , Martin Magnusson , Achim J. Lilienthal

Social robots have been used to assist with mental well-being in various ways such as to help children with autism improve on their social skills and executive functioning such as joint attention and bodily awareness. They are also used to…

Robotics · Computer Science 2022-10-26 Raida Karim , Edgar Lopez , Katelynn Oleson , Tony Li , Elin A. Björling , Maya Cakmak

The increasing labor shortage and aging population underline the need for assistive robots to support human care recipients. To enable safe and responsive assistance, robots require accurate human motion prediction in physical interaction…

Natural Human-Robot Interaction (HRI) is one of the key components for service robots to be able to work in human-centric environments. In such dynamic environments, the robot needs to understand the intention of the user to accomplish a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Giorgos Tziafas , Hamidreza Kasaei

We present the Human And Robot Multimodal Observations of Natural Interactive Collaboration (HARMONIC) data set. This is a large multimodal data set of human interactions with a robotic arm in a shared autonomy setting designed to imitate…

Robotics · Computer Science 2020-08-03 Benjamin A. Newman , Reuben M. Aronson , Siddartha S. Srinivasa , Kris Kitani , Henny Admoni

Being able to recognize emotions in human users is considered a highly desirable trait in Human-Robot Interaction (HRI) scenarios. However, most contemporary approaches rarely attempt to apply recognized emotional features in an active…

Human-Computer Interaction · Computer Science 2018-07-27 Nikhil Churamani , Alexander Sutherland , Pablo Barros

Emotions have a major interactive role in defining how humans interact with their environment by encoding their perception to external events and accordingly, influencing their cognition and decision-making process. Therefore, increasing…

Human-Computer Interaction · Computer Science 2021-03-30 Mustaffa Alfatlawi

Physiological signals are increasingly relevant to estimate the mental states of users in human-robot interaction (HRI), yet ROS 2-based HRI frameworks still lack reusable support to integrate such data streams in a standardized way.…

Human-Computer Interaction · Computer Science 2026-03-23 Manuel Scheibl , Julian Leichert , Sinem Görmez , Britta Wrede

In Human-Robot Interaction (HRI) systems, a challenging task is sharing the representation of the operational environment, fusing symbolic knowledge and perceptions, between users and robots. With the existing HRI pipelines, users can teach…

Robotics · Computer Science 2023-01-18 E. Bartoli , F. Argenziano , V. Suriani , D. Nardi

This paper presents an innovative large language model (LLM)-based robotic system for enhancing multi-modal human-robot interaction (HRI). Traditional HRI systems relied on complex designs for intent estimation, reasoning, and behavior…