English
Related papers

Related papers: Real-Time Multimodal Signal Processing for HRI in …

200 papers

Human-robot interaction (HRI) has become a crucial enabler in houses and industries for facilitating operational flexibility. When it comes to mobile collaborative robots, this flexibility can be further increased due to the autonomous…

The growing presence of service robots in human-centric environments, such as warehouses, demands seamless and intuitive human-robot collaboration. In this paper, we propose a collaborative shelf-picking framework that combines multimodal…

Robotics · Computer Science 2025-04-10 Abhinav Pathak , Kalaichelvi Venkatesan , Tarek Taha , Rajkumar Muthusamy

Natural-language-facilitated human-robot cooperation (NLC), in which natural language (NL) is used to share knowledge between a human and a robot for conducting intuitive human-robot cooperation (HRC), is continuously developing in the…

Robotics · Computer Science 2017-05-30 Rui Liu , Xiaoli Zhang

In human-robot collaborative interaction scenarios, nonverbal communication plays an important role. Both, signals sent by a human collaborator need to be identified and interpreted by the robotic system, and the signals sent by the robot…

The rapid development of Large Language Models (LLMs) creates an exciting potential for flexible, general knowledge-driven Human-Robot Interaction (HRI) systems for assistive robots. Existing HRI systems demonstrate great progress in…

Robotics · Computer Science 2025-07-22 Jens V. Rüppel , Andrey Rudenko , Tim Schreiter , Martin Magnusson , Achim J. Lilienthal

Emotion recognition and touch gesture decoding are crucial for advancing human-robot interaction (HRI), especially in social environments where emotional cues and tactile perception play important roles. However, many humanoid robots, such…

Human-Computer Interaction · Computer Science 2025-01-03 Yuanbo Hou , Qiaoqiao Ren , Wenwu Wang , Dick Botteldooren

Human-robot collaboration has benefited users with higher efficiency towards interactive tasks. Nevertheless, most collaborative schemes rely on complicated human-machine interfaces, which might lack the requisite intuitiveness compared…

Robotics · Computer Science 2024-10-28 Haolin Fei , Stefano Tedeschi , Yanpei Huang , Andrew Kennedy , Ziwei Wang

Haptic perception is highly important for immersive teleoperation of robots, especially for accomplishing manipulation tasks. We propose a low-cost haptic sensing and rendering system, which is capable of detecting and displaying surface…

This paper contributes a first study into how different human users deliver simultaneous control and feedback signals during human-robot interaction. As part of this work, we formalize and present a general interactive learning framework…

Artificial Intelligence · Computer Science 2017-03-16 Kory W. Mathewson , Patrick M. Pilarski

The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly,…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Alberto Signoretti , Cristian Secchi

High-fidelity digital humans are increasingly used in interactive applications, yet achieving both visual realism and real-time responsiveness remains a major challenge. We present a high-fidelity, real-time conversational digital human…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hongbin Huang , Junwei Li , Tianxin Xie , Zhuang Li , Cekai Weng , Yaodong Yang , Yue Luo , Li Liu , Jing Tang , Zhijing Shao , Zeyu Wang

In the context of Human-Robot Collaboration (HRC), it is crucial that the two actors are able to communicate with each other in a natural and efficient manner. The absence of a communication interface is often a cause of undesired…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Cristian Secchi

To improve the cognitive autonomy of humanoid robots, this research proposes a multi-scenario reasoning architecture to solve the technical shortcomings of multi-modal understanding in this field. It draws on simulation based experimental…

Robotics · Computer Science 2025-07-11 Libo Wang

Tight coordination is required for effective human-robot teams in domains involving fast dynamics and tactical decisions, such as multi-car racing. In such settings, robot teammates must react to cues of a human teammate's tactical…

Underlying mechanisms of speech perception masked by background speakers, a common daily listening condition, are often investigated using various and lengthy psychophysical tests. The presence of a social agent, such as an interactive…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-18 Luke Meyer , Gloria Araiza-Illan , Laura Rachman , Etienne Gaudrain , Deniz Baskent

As robots become more integrated into society, detecting robot errors is essential for effective human-robot interaction (HRI). When a robot fails repeatedly, how can it know when to change its behavior? Humans naturally respond to robot…

Robotics · Computer Science 2025-10-13 Shannon Liu , Maria Teresa Parreira , Wendy Ju

Human robot collaboration (HRC) is becoming increasingly important as the paradigm of manufacturing is shifting from mass production to mass customization. The introduction of HRC can significantly improve the flexibility and intelligence…

Robotics · Computer Science 2020-02-19 Yujiao Cheng , Liting Sun , Changliu Liu , Masayoshi Tomizuka

This study explores human-robot interaction (HRI) based on a mobile robot and YOLO to increase real-time situation awareness and prevent accidents in the workplace. Using object segmentation, we propose an approach that is capable of…

Robotics · Computer Science 2024-09-25 Juan M. Deniz , Andre S. Kelboucas , Ricardo Bedin Grando

The study of Human-Robot Interaction (HRI) aims to create close and friendly communication between humans and robots. In the human-center HRI, an essential aspect of implementing a successful and effective HRI is building a natural and…

Human-Computer Interaction · Computer Science 2022-09-20 Xihao Wang , Hao Shen , Hui Yu , Jielong Guo , Xian Wei

Autonomous systems are increasingly deployed in open and dynamic environments -- from city streets to aerial and indoor spaces -- where perception models must remain reliable under sensor noise, environmental variation, and platform shifts.…

Robotics · Computer Science 2026-01-09 Lingdong Kong , Shaoyuan Xie , Zeying Gong , Ye Li , Meng Chu , Ao Liang , Yuhao Dong , Tianshuai Hu , Ronghe Qiu , Rong Li , Hanjiang Hu , Dongyue Lu , Wei Yin , Wenhao Ding , Linfeng Li , Hang Song , Wenwei Zhang , Yuexin Ma , Junwei Liang , Zhedong Zheng , Lai Xing Ng , Benoit R. Cottereau , Wei Tsang Ooi , Ziwei Liu , Zhanpeng Zhang , Weichao Qiu , Wei Zhang , Ji Ao , Jiangpeng Zheng , Siyu Wang , Guang Yang , Zihao Zhang , Yu Zhong , Enzhu Gao , Xinhan Zheng , Xueting Wang , Shouming Li , Yunkai Gao , Siming Lan , Mingfei Han , Xing Hu , Dusan Malic , Christian Fruhwirth-Reisinger , Alexander Prutsch , Wei Lin , Samuel Schulter , Horst Possegger , Linfeng Li , Jian Zhao , Zepeng Yang , Yuhang Song , Bojun Lin , Tianle Zhang , Yuchen Yuan , Chi Zhang , Xuelong Li , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Aodi Wu , Xubo Luo , Erjia Xiao , Lingfeng Zhang , Yingbo Tang , Hao Cheng , Renjing Xu , Wenbo Ding , Lei Zhou , Long Chen , Hangjun Ye , Xiaoshuai Hao , Shuangzhi Li , Junlong Shen , Xingyu Li , Hao Ruan , Jinliang Lin , Zhiming Luo , Yu Zang , Cheng Wang , Hanshi Wang , Xijie Gong , Yixiang Yang , Qianli Ma , Zhipeng Zhang , Wenxiang Shi , Jingmeng Zhou , Weijun Zeng , Kexin Xu , Yuchen Zhang , Haoxiang Fu , Ruibin Hu , Yanbiao Ma , Xiyan Feng , Wenbo Zhang , Lu Zhang , Yunzhi Zhuge , Huchuan Lu , You He , Seungjun Yu , Junsung Park , Youngsun Lim , Hyunjung Shim , Faduo Liang , Zihang Wang , Yiming Peng , Guanyu Zong , Xu Li , Binghao Wang , Hao Wei , Yongxin Ma , Yunke Shi , Shuaipeng Liu , Dong Kong , Yongchun Lin , Huitong Yang , Liang Lei , Haoang Li , Xinliang Zhang , Zhiyong Wang , Xiaofeng Wang , Yuxia Fu , Yadan Luo , Djamahl Etchegaray , Yang Li , Congfei Li , Yuxiang Sun , Wenkai Zhu , Wang Xu , Linru Li , Longjie Liao , Jun Yan , Benwu Wang , Xueliang Ren , Xiaoyu Yue , Jixian Zheng , Jinfeng Wu , Shurui Qin , Wei Cong , Yao He