English
Related papers

Related papers: Multimodal Signal Processing and Learning Aspects …

200 papers

Human-Machine Interaction (HMI) systems have gained huge interest in recent years, with reference expression comprehension being one of the main challenges. Traditionally human-machine interaction has been mostly limited to speech and…

Human-Computer Interaction · Computer Science 2023-06-21 Aman Jain , Anirudh Reddy Kondapally , Kentaro Yamada , Hitomi Yanaka

In order for robots to operate effectively in homes and workplaces, they must be able to manipulate the articulated objects common within environments built for and by humans. Previous work learns kinematic models that prescribe this…

Robotics · Computer Science 2016-07-04 Zhengyang Wu , Mohit Bansal , Matthew R. Walter

Autonomous robots are increasingly being tested into public spaces to enhance user experiences, particularly in cultural and educational settings. This paper presents the design, implementation, and evaluation of the autonomous museum guide…

Robotics · Computer Science 2025-07-18 Luca Garello , Francesca Cocchella , Alessandra Sciutti , Manuel Catalano , Francesco Rea

Affective tactile interaction constitutes a fundamental component of human communication. In natural human-human encounters, touch is seldom experienced in isolation; rather, it is inherently multisensory. Individuals not only perceive the…

Robotics · Computer Science 2025-10-09 Qiaoqiao Ren , Tony Belpaeme

Physically assistive robots in home environments can enhance the autonomy of individuals with impairments, allowing them to regain the ability to conduct self-care and household tasks. Individuals with physical limitations may find existing…

Robotics · Computer Science 2025-02-11 Akhil Padmanabha , Carmel Majidi , Zackory Erickson

Human-Robot Interaction (HRI) is an emerging subfield of service robotics. While most existing approaches rely on explicit signals (i.e. voice, gesture) to engage, current literature is lacking solutions to address implicit user needs. In…

Artificial Intelligence · Computer Science 2022-02-24 Maëlic Neau , Paulo Santos , Anne-Gwenn Bosser , Nathan Beu , Cédric Buche

For many small- and medium-vocabulary tasks, audio-visual speech recognition can significantly improve the recognition rates compared to audio-only systems. However, there is still an ongoing debate regarding the best combination strategy…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Wentao Yu , Steffen Zeiler , Dorothea Kolossa

End-to-end robot policies achieve high performance through neural networks trained via reinforcement learning (RL). Yet, their black box nature and abstract reasoning pose challenges for human-robot interaction (HRI), because humans may…

This paper introduces our dataset featuring human-robot interactions (HRI) in urban public environments. This dataset is rich with social signals that we believe can be modeled to help understand naturalistic human-robot interaction. Our…

Robotics · Computer Science 2024-03-19 Fanjun Bu , Wendy Ju

Multi-robot systems hold significant promise for social environments such as homes and hospitals, yet existing multi-robot works treat robots as functionally identical, overlooking how robots individual identity shape user perception and…

Robotics · Computer Science 2026-04-15 Shaid Hasan , Breenice Lee , Sujan Sarker , Tariq Iqbal

Current technological advances open up new opportunities for bringing human-machine interaction to a new level of human-centered cooperation. In this context, a key issue is the semantic understanding of the environment in order to enable…

Robotics · Computer Science 2022-11-08 Thorsten Hempel , Marc-André Fiedler , Aly Khalifa , Ayoub Al-Hamadi , Laslo Dinges

Human-robot collaboration (HRC) has become increasingly relevant in industrial, household, and commercial settings. However, the effectiveness of such collaborations is highly dependent on the human and robots' situational awareness of the…

Robotics · Computer Science 2023-05-09 Chelsea Zou , Kishan Chandan , Yan Ding , Shiqi Zhang

Robot facial expressions and gaze are important factors for enhancing human-robot interaction (HRI), but their effects on human collaboration and perception are not well understood, for instance, in collaborative game scenarios. In this…

Robotics · Computer Science 2023-03-28 Di Fu , Fares Abawi , Stefan Wermter

For some years now, the use of social, anthropomorphic robots in various situations has been on the rise. These are robots developed to interact with humans and are equipped with corresponding extremities. They already support human users…

Robotics · Computer Science 2021-03-23 Vignesh Prasad , Ruth Stock-Homburg , Jan Peters

Human-robot interaction is increasingly moving toward multi-robot, socially grounded environments. Existing systems struggle to integrate multimodal perception, embodied expression, and coordinated decision-making in a unified framework.…

Robotics · Computer Science 2026-03-25 Shaid Hasan , Breenice Lee , Sujan Sarker , Tariq Iqbal

Mobile telepresence robots (MTRs) have become increasingly popular in the expanding world of remote work, providing new avenues for people to actively participate in activities at a distance. However, humans operating MTRs often have…

Robotics · Computer Science 2022-10-19 Kenechukwu C. Mbanisi , Michael A. Gennert

To enhance human-robot social interaction, it is essential for robots to process multiple social cues in a complex real-world environment. However, incongruency of input information across modalities is inevitable and could be challenging…

Robotics · Computer Science 2023-03-14 Di Fu , Fares Abawi , Hugo Carneiro , Matthias Kerzel , Ziwei Chen , Erik Strahl , Xun Liu , Stefan Wermter

Robots have become ubiquitous tools in various industries and households, highlighting the importance of human-robot interaction (HRI). This has increased the need for easy and accessible communication between humans and robots. Recent…

Robotics · Computer Science 2023-04-03 Ahmad Amine , Mostafa Aldilati , Hadi Hasan , Noel Maalouf , Imad H. Elhajj

Detecting mental states of human users is crucial for the development of cooperative and intelligent robots, as it enables the robot to understand the user's intentions and desires. Despite their importance, it is difficult to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hendric Voß , Heiko Wersing , Stefan Kopp

In 2018 the European Commission highlighted the demand of a human-centered approach to AI. Such a claim is gaining even more relevance considering technologies specifically designed to directly interact and physically collaborate with human…

Robotics · Computer Science 2021-09-15 Rachele Carli , Amro Najjar