English
Related papers

Related papers: Gesture-Informed Robot Assistance via Foundation M…

200 papers

Deictic gestures, like pointing, are a fundamental form of non-verbal communication, enabling humans to direct attention to specific objects or locations. This capability is essential in Human-Robot Interaction (HRI), where robots should be…

Robotics · Computer Science 2025-09-08 Luca Müller , Hassan Ali , Philipp Allgeuer , Lukáš Gajdošech , Stefan Wermter

As robots increasingly enter human-centered environments, they must not only be able to navigate safely around humans, but also adhere to complex social norms. Humans often rely on non-verbal communication through gestures and facial…

Translating human intent into robot commands is crucial for the future of service robots in an aging society. Existing Human-Robot Interaction (HRI) systems relying on gestures or verbal commands are impractical for the elderly due to…

Understanding the intentions of robots is essential for natural and seamless human-robot collaboration. Ensuring that robots have means for non-verbal communication is a basis for intuitive and implicit interaction. For this, we contribute…

Robotics · Computer Science 2024-10-03 Jan Leusmann , Steeven Villa , Thomas Liang , Chao Wang , Albrecht Schmidt , Sven Mayer

Body language such as conversational gesture is a powerful way to ease communication. Conversational gestures do not only make a speech more lively but also contain semantic meaning that helps to stress important information in the…

Robotics · Computer Science 2022-10-14 Hitoshi Teshima , Naoki Wake , Diego Thomas , Yuta Nakashima , Hiroshi Kawasaki , Katsushi Ikeuchi

Collaborative robots became a popular tool for increasing productivity in partly automated manufacturing plants. Intuitive robot teaching methods are required to quickly and flexibly adapt the robot programs to new tasks. Gestures have an…

Robotics · Computer Science 2024-01-04 Petr Vanc , Jan Kristof Behrens , Karla Stepanova

In this work, we propose a gesture based language to allow humans to interact with robots using their body in a natural way. We have created a new gesture detection model using neural networks and a custom dataset of humans performing a set…

Robotics · Computer Science 2022-06-16 Javier Laplaza , Joan Jaume Oliver , Ramón Romero , Alberto Sanfeliu , Anaís Garrell

The study of Human-Robot Interaction (HRI) aims to create close and friendly communication between humans and robots. In the human-center HRI, an essential aspect of implementing a successful and effective HRI is building a natural and…

Human-Computer Interaction · Computer Science 2022-09-20 Xihao Wang , Hao Shen , Hui Yu , Jielong Guo , Xian Wei

The use of anthropomorphic robotic hands for assisting individuals in situations where human hands may be unavailable or unsuitable has gained significant importance. In this paper, we propose a novel task called human-assisting dexterous…

Robotics · Computer Science 2025-04-15 Tianhao Wu , Mingdong Wu , Jiyao Zhang , Yunchong Gan , Hao Dong

Physical human-robot interactions (pHRI) are less efficient and communicative than human-human interactions, and a key reason is a lack of informative sense of touch in robotic systems. Interpreting human touch gestures is a nuanced,…

Robotics · Computer Science 2024-12-24 Bibit Bianchini , Prateek Verma , Kenneth Salisbury

Dexterous robotic hands have the capability to interact with a wide variety of household objects to perform tasks like grasping. However, learning robust real world grasping policies for arbitrary objects has proven challenging due to the…

Robotics · Computer Science 2022-10-26 Zoey Qiuyu Chen , Karl Van Wyk , Yu-Wei Chao , Wei Yang , Arsalan Mousavian , Abhishek Gupta , Dieter Fox

Referential gestures, or as termed in linguistics, deixis, are an essential part of communication around data visualizations. Despite their importance, such gestures are often overlooked when documenting data analysis meetings. Transcripts,…

Human-Computer Interaction · Computer Science 2024-08-09 Chang Han , Katherine E. Isaacs

Purpose - Most industrial robots are still programmed using the typical teaching process, through the use of the robot teach pendant. This is a tedious and time-consuming task that requires some technical expertise, and hence new approaches…

Robotics · Computer Science 2013-09-10 Pedro Neto , Norberto Pires , Paulo Moreira

Dexterous grasping is a fundamental yet challenging skill in robotic manipulation, requiring precise interaction between robotic hands and objects. In this paper, we present $\mathcal{D(R,O)}$ Grasp, a novel framework that models the…

Robotics · Computer Science 2025-03-17 Zhenyu Wei , Zhixuan Xu , Jingxiang Guo , Yiwen Hou , Chongkai Gao , Zhehao Cai , Jiayu Luo , Lin Shao

Many task domains require robots to interpret and act upon natural language commands which are given by people and which refer to the robot's physical surroundings. Such interpretation is known variously as the symbol grounding problem,…

Learning structured task representations from human demonstrations is essential for understanding long-horizon manipulation behaviors, particularly in bimanual settings where action ordering, object involvement, and interaction geometry can…

Robotics · Computer Science 2026-01-19 Franziska Herbert , Vignesh Prasad , Han Liu , Dorothea Koert , Georgia Chalvatzaki

In physical human-robot interaction, force feedback has been the most common sensing modality to convey the human intention to the robot. It is widely used in admittance control to allow the human to direct the robot. However, it cannot be…

Robotics · Computer Science 2025-05-16 Gokhan Solak , Gustavo J. G. Lahr , Idil Ozdamar , Arash Ajoudani

Most current anthropomorphic robotic hands can realize part of the human hand functions, particularly for object grasping. However, due to the complexity of the human hand, few current designs target at daily object manipulations, even for…

Achieving reliable robotic manipulation, such as dexterous grasping, requires a synergy between physically stable interactions and semantic task guidance, yet these objectives are often treated as separate, disjoint goals. In this paper, we…

Robotics · Computer Science 2026-05-14 Han Yi Shin , Heeju Ko , Jaewon Mun , Qixing Huang , Jaehyeok Lee , Sung June Kim , Honglak Lee , Sujin Jang , Sangpil Kim

The vision of adaptive architecture proposes that robotic technologies could enable interior spaces to physically transform in a bidirectional interaction with occupants. Yet, it is still unknown how this interaction could unfold in an…

Human-Computer Interaction · Computer Science 2025-01-06 Alex Binh Vinh Duc Nguyen , Jan Leusmann , Sven Mayer , Andrew Vande Moere
‹ Prev 1 2 3 10 Next ›