English
Related papers

Related papers: Gaze-Based Intention Recognition for Human-Robot C…

200 papers

This work proposes a biologically inspired approach that focuses on attention systems that are able to inhibit or constrain what is relevant at any one moment. We propose a radically new approach to making progress in human-robot joint…

Robotics · Computer Science 2016-06-09 Nick DePalma , Cynthia Breazeal

The motivation of this paper is to develop a smart system using multi-modal vision for next-generation mechanical assembly. It includes two phases where in the first phase human beings teach the assembly structure to a robot and in the…

Robotics · Computer Science 2016-01-27 Weiwei Wan , Feng Lu , Zepei Wu , Kensuke Harada

Human gaze is known to be a strong indicator of underlying human intentions and goals during manipulation tasks. This work studies gaze patterns of human teachers demonstrating tasks to robots and proposes ways in which such patterns can be…

Robotics · Computer Science 2021-11-30 Akanksha Saran , Elaine Schaertl Short , Andrea Thomaz , Scott Niekum

For planning an assembly of a product from a given set of parts, robots necessitate certain cognitive skills: high-level planning is needed to decide the order of actuation actions, while geometric reasoning is needed to check the…

Artificial Intelligence · Computer Science 2026-05-14 Momina Rizwan , Volkan Patoglu , Esra Erdem

The rapid development of collaborative robotics has provided a new possibility of helping the elderly who has difficulties in daily life, allowing robots to operate according to specific intentions. However, efficient human-robot…

Robotics · Computer Science 2024-08-15 Xiyuan Zhao , Huijun Li , Tianyuan Miao , Xianyi Zhu , Zhikai Wei , Aiguo Song

Humans have the fascinating capacity of processing non-verbal visual cues to understand and anticipate the actions of other humans. This "intention reading" ability is underpinned by shared motor-repertoires and action-models, which we use…

Human intention-based systems enable robots to perceive and interpret user actions to interact with humans and adapt to their behavior proactively. Therefore, intention prediction is pivotal in creating a natural interaction with social…

Robotics · Computer Science 2025-04-09 Hassan Ali , Philipp Allgeuer , Stefan Wermter

Efficiently detecting human intent to interact with ubiquitous robots is crucial for effective human-robot interaction (HRI) and collaboration. Over the past decade, deep learning has gained traction in this field, with most existing…

Robotics · Computer Science 2025-09-29 Farida Mohsen , Ali Safa

In real-life scenarios, humans seek out objects in the 3D world to fulfill their daily needs or intentions. This inspires us to introduce 3D intention grounding, a new task in 3D object detection employing RGB-D, based on human intention,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Weitai Kang , Mengxue Qu , Jyoti Kini , Yunchao Wei , Mubarak Shah , Yan Yan

Much of the literature on robotic perception focuses on the visual modality. Vision provides a global observation of a scene, making it broadly useful. However, in the domain of robotic manipulation, vision alone can sometimes prove…

Robotics · Computer Science 2019-03-11 Justin Lin , Roberto Calandra , Sergey Levine

Improving the effectiveness of human-robot interaction requires social robots to accurately infer human goals through robust intention understanding. This challenge is particularly critical in multimodal settings, where agents must…

Human-Computer Interaction · Computer Science 2026-04-28 Hamed Rahimi , Clemence Grislain , Adrien Jacquet Cretides , Olivier Sigaud , Mohamed Chetouani

The semantic understanding of natural dialogues composes of several parts. Some of them, like intent classification and entity detection, have a crucial role in deciding the next steps in handling user input. Handling each task as an…

Computation and Language · Computer Science 2021-09-08 Petr Lorenc

Human activity recognition (HAR) is fundamental in human-robot collaboration (HRC), enabling robots to respond to and dynamically adapt to human intentions. This paper introduces a HAR system combining a modular data glove equipped with…

Current orthopedic robotic systems largely focus on navigation, aiding surgeons in positioning a guiding tube but still requiring manual drilling and screw placement. The automation of this task not only demands high precision and safety…

Robotics · Computer Science 2025-02-04 Chen Chen , Qikai Zou , Yuhang Song , Mingrui Yu , Senqiang Zhu , Shiji Song , Xiang Li

An intent expression system using eye robots is proposed for a mascot robot system from a viewpoint of humatronics. The eye robot aims at providing a basic interface method for an information terminal robot system. To achieve better…

Developing robots that can assist humans efficiently, safely, and adaptively is crucial for real-world applications such as healthcare. While previous work often assumes a centralized system for co-optimizing human-robot interactions, we…

Robotics · Computer Science 2024-12-30 Jason Qin , Shikun Ban , Wentao Zhu , Yizhou Wang , Dimitris Samaras

Nowadays, robots are found in a growing number of areas where they collaborate closely with humans. Enabled by lightweight materials and safety sensors, these cobots are gaining increasing popularity in domestic care, supporting people with…

Human-Computer Interaction · Computer Science 2023-06-26 Max Pascher , Til Franzen , Kirill Kronhardt , Jens Gerken

Shared autonomy enables robots to infer user intent and assist in accomplishing it. But when the user wants to do a new task that the robot does not know about, shared autonomy will hinder their performance by attempting to assist them with…

Robotics · Computer Science 2021-04-15 Matthew Zurek , Andreea Bobu , Daniel S. Brown , Anca D. Dragan

Recognising intent in collaborative human robot tasks can improve team performance and human perception of robots. Intent can differ from the observed outcome in the presence of mistakes which are likely in physically dynamic tasks. We…

Robotics · Computer Science 2024-10-29 Vidullan Surendran , Alan R. Wagner

Embodied foundation models have achieved significant breakthroughs in robotic manipulation, yet they still depend heavily on large-scale robot demonstrations. Although recent works have explored leveraging human data to alleviate this…

Robotics · Computer Science 2026-05-01 Chengyang Li , Kaiyi Xiong , Yuan Xu , Lei Qian , Yizhou Wang , Wentao Zhu