English
Related papers

Related papers: Context-aware robot control using gesture episodes

200 papers

When humans control robot arms these robots often need to infer the human's desired task. Prior research on assistive teleoperation and shared autonomy explores how robots can determine the desired task based on the human's joystick inputs.…

Robotics · Computer Science 2022-03-04 Ananth Jonnavittula , Dylan P. Losey

Pointing is a key mode of interaction with robots, yet most prior work has focused on recognition rather than generation. We present a motion capture dataset of human pointing gestures covering diverse styles, handedness, and spatial…

Robotics · Computer Science 2025-09-17 Anna Deichler , Siyang Wang , Simon Alexanderson , Jonas Beskow

Employing skin-like tactile sensors on robots enhances both the safety and usability of collaborative robots by adding the capability to detect human contact. Unfortunately, simple binary tactile sensors alone cannot determine the context…

Robotics · Computer Science 2023-04-20 Christopher Yee Wong , Lucas Vergez , Wael Suleiman

Designing robotic assistance devices for manipulation tasks is challenging. This work is concerned with improving accuracy and usability of semi-autonomous robots, such as human operated manipulators or exoskeletons. The key insight is to…

Robotics · Computer Science 2019-07-18 Claudio Zito , Tomasz Deregowski , Rustam Stolkin

As robots increasingly enter human-centered environments, they must not only be able to navigate safely around humans, but also adhere to complex social norms. Humans often rely on non-verbal communication through gestures and facial…

Human-AI collaboration is typically offered in one of two of user control levels: guidance, where the AI provides suggestions and the human makes the final decision, and delegation, where the AI acts autonomously within user-defined…

Human-Computer Interaction · Computer Science 2025-09-26 Avinash Ajit Nargund , Arthur Caetano , Kevin Yang , Rose Yiwei Liu , Philip Tezaur , Kriteen Shrestha , Qisen Pan , Tobias Höllerer , Misha Sra

Pointing gestures are a common interaction method used in Human-Robot Collaboration for various tasks, ranging from selecting targets to guiding industrial processes. This study introduces a method for localizing pointed targets within a…

Robotics · Computer Science 2025-06-30 Noora Sassali , Roel Pieters

Collaborative manipulation task often requires negotiation using explicit or implicit communication. An important example is determining where to move when the goal destination is not uniquely specified, and who should lead the motion. This…

Robotics · Computer Science 2023-11-07 Zhanibek Rysbek , Siyu Li , Afagh Mehri Shervedani , Milos Zefran

Collaborative robots, or cobots, are increasingly integrated into various industrial and service settings to work efficiently and safely alongside humans. However, for effective human-robot collaboration, robots must reason based on human…

Robotics · Computer Science 2026-01-22 Muhammad Adel Yusuf , Ali Nasir , Zeeshan Hameed Khan

We propose a set of communicative gestures and develop a gesture recognition system with the aim of facilitating more intuitive Human-Robot Interaction (HRI) through gestures. First, we propose a set of commands commonly used for…

Robotics · Computer Science 2021-09-22 Jia Chuan A. Tan , Wesley P. Chan , Nicole L. Robinson , Elizabeth A. Croft , Dana Kulic

This paper studies real-time collaborative robot (cobot) handling, where the cobot maneuvers an object under human dynamic gesture commands. Enabling dynamic gesture commands is useful when the human needs to avoid direct contact with the…

Robotics · Computer Science 2023-04-14 Rui Chen , Alvin Shek , Changliu Liu

The study of human-robot interaction is fundamental to the design and use of robotics in real-world applications. Robots will need to predict and adapt to the actions of human collaborators in order to achieve good performance and improve…

Collaborative robotics requires effective communication between a robot and a human partner. This work proposes a set of interpretive principles for how a robotic arm can use pointing actions to communicate task information to people by…

Robotics · Computer Science 2019-12-16 Malihe Alikhani , Baber Khalid , Rahul Shome , Chaitanya Mitash , Kostas Bekris , Matthew Stone

The increasing presence of robots alongside humans, such as in human-robot teams in manufacturing, gives rise to research questions about the kind of behaviors people prefer in their robot counterparts. We term actions that support…

Collaboration between human and robot requires effective modes of communication to assign robot tasks and coordinate activities. As communication can utilize different modalities, a multi-modal approach can be more expressive than single…

Robotics · Computer Science 2023-12-01 A. Ekrekli , A. Angleraud , G. Sharma , R. Pieters

Constraint-aware estimation of human intent is essential for robots to physically collaborate and interact with humans. Further, to achieve fluid collaboration in dynamic tasks intent estimation should be achieved in real-time. In this…

Robotics · Computer Science 2024-09-04 Yifei Simon Shao , Tianyu Li , Shafagh Keyvanian , Pratik Chaudhari , Vijay Kumar , Nadia Figueroa

In collaborative human-robot manipulation, a robot must predict human intents and adapt its actions accordingly to smoothly execute tasks. However, the human's intent in turn depends on actions the robot takes, creating a chicken-or-egg…

Robotics · Computer Science 2024-06-04 Kushal Kedia , Atiksh Bhardwaj , Prithwish Dan , Sanjiban Choudhury

Emotion expressions serve as important communicative signals and are crucial cues in intuitive interactions between humans. Hence, it is essential to include these fundamentals in robotic behavior strategies when interacting with humans to…

Robotics · Computer Science 2023-11-08 Thorsten Hempel , Laslo Dinges , Ayoub Al-Hamadi

Designing robotic tasks for co-manipulation necessitates to exploit not only proprioceptive but also exteroceptive information for improved safety and autonomy. Following such instinct, this research proposes to formulate intuitive robotic…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Sunny Katyara , Fanny Ficuciello , Tao Teng , Fei Chen , Bruno Siciliano , Darwin G. Caldwell

Within this work, we explore intention inference for user actions in the context of a handheld robot setup. Handheld robots share the shape and properties of handheld tools while being able to process task information and aid manipulation.…

Robotics · Computer Science 2019-03-21 Janis Stolzenwald , Walterio W. Mayol-Cuevas