English
Related papers

Related papers: Multimodal Human-Intent Modeling for Contextual Ro…

200 papers

As augmented reality technology and hardware become more mature and affordable, researchers have been exploring more intuitive and discoverable interaction techniques for immersive environments. In this paper, we investigate multimodal…

Human-Computer Interaction · Computer Science 2022-12-02 Xiaoyan Zhou , Adam S. Williams , Francisco R. Ortega

Assistive robot manipulators must be able to autonomously pick and place a wide range of novel objects to be truly useful. However, current assistive robots lack this capability. Additionally, assistive systems need to have an interface…

Robotics · Computer Science 2019-07-10 Dian Wang , Colin Kohler , Andreas ten Pas , Alexander Wilkinson , Maozhi Liu , Holly Yanco , Robert Platt

Despite significant progress in robotic systems for operation within human-centric environments, existing models still heavily rely on explicit human commands to identify and manipulate specific objects. This limits their effectiveness in…

Robotics · Computer Science 2024-10-16 Shiyu Jin , Jinxuan Xu , Yutian Lei , Liangjun Zhang

Object handover is a common human collaboration behavior that attracts attention from researchers in Robotics and Cognitive Science. Though visual perception plays an important role in the object handover task, the whole handover process…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Ruolin Ye , Wenqiang Xu , Zhendong Xue , Tutian Tang , Yanfeng Wang , Cewu Lu

Mutual adaptation can significantly enhance overall task performance in human-robot co-transportation by integrating both the robot's and human's understanding of the environment. While human modeling helps capture humans' subjective…

Robotics · Computer Science 2025-03-13 Al Jaber Mahmud , Weizi Li , Xuan Wang

Manipulating objects with robotic hands is a complicated task. Not only the fingers of the hand, but also the pose of the robot's end effector need to be coordinated. Using human demonstrations of movements is an intuitive and…

This paper tackles the challenging task of evaluating socially situated conversational robots and presents a novel objective evaluation approach that relies on multimodal user behaviors. In this study, our main focus is on assessing the…

Computation and Language · Computer Science 2023-09-26 Koji Inoue , Divesh Lala , Keiko Ochi , Tatsuya Kawahara , Gabriel Skantze

Handover between a human and a dexterous robotic hand is a fundamental yet challenging task in human-robot collaboration. It requires handling dynamic environments and a wide variety of objects and demands robust and adaptive grasping…

Robotics · Computer Science 2025-07-03 Youzhuo Wang , Jiayi Ye , Chuyang Xiao , Yiming Zhong , Heng Tao , Hang Yu , Yumeng Liu , Jingyi Yu , Yuexin Ma

Humans use semantic concepts such as spatial relations between objects to describe scenes and communicate tasks such as "Put the tea to the right of the cup" or "Move the plate between the fork and the spoon." Just as children, assistive…

Robotics · Computer Science 2023-05-17 Rainer Kartmann , Tamim Asfour

Preference learning has long been studied in Human-Robot Interaction (HRI) in order to adapt robot behavior to specific user needs and desires. Typically, human preferences are modeled as a scalar function; however, such a formulation…

Robotics · Computer Science 2024-04-01 Austin Narcomey , Nathan Tsoi , Ruta Desai , Marynel Vázquez

Assistive robotic systems have shown growing potential to improve the quality of life of those with disabilities. As researchers explore the automation of various caregiving tasks, considerations for how the technology can still preserve…

Human-robot cooperation is essential in environments such as warehouses and retail stores, where workers frequently handle deformable objects like paper, bags, and fabrics. Coordinating robotic actions with human assistance remains…

Robotics · Computer Science 2025-11-06 Rewida Ali , Cristian C. Beltran-Hernandez , Weiwei Wan , Kensuke Harada

Nowadays, robots are found in a growing number of areas where they collaborate closely with humans. Enabled by lightweight materials and safety sensors, these cobots are gaining increasing popularity in domestic care, supporting people with…

Human-Computer Interaction · Computer Science 2023-06-26 Max Pascher , Til Franzen , Kirill Kronhardt , Jens Gerken

The intricate kinematics of the human hand enable simultaneous grasping and manipulation of multiple objects, essential for tasks such as object transfer and in-hand manipulation. Despite its significance, the domain of robotic multi-object…

Robotics · Computer Science 2024-03-15 Yuyang Li , Bo Liu , Yiran Geng , Puhao Li , Yaodong Yang , Yixin Zhu , Tengyu Liu , Siyuan Huang

Designing robotic assistance devices for manipulation tasks is challenging. This work is concerned with improving accuracy and usability of semi-autonomous robots, such as human operated manipulators or exoskeletons. The key insight is to…

Robotics · Computer Science 2019-07-18 Claudio Zito , Tomasz Deregowski , Rustam Stolkin

In this work, the problem of human-robot collaborative object transfer to unknown target poses is addressed. The desired pattern of the end-effector pose trajectory to a known target pose is encoded using DMPs (Dynamic Movement Primitives).…

Robotics · Computer Science 2021-10-28 Antonis Sidiropoulos , Yiannis Karayiannidis , Zoe Doulgeri

With the recently increasing capabilities of modern vehicles, novel approaches for interaction emerged that go beyond traditional touch-based and voice command approaches. Therefore, hand gestures, head pose, eye gaze, and speech have been…

Human-Computer Interaction · Computer Science 2022-11-08 Amr Gomaa

In collaborative human-robot manipulation, a robot must predict human intents and adapt its actions accordingly to smoothly execute tasks. However, the human's intent in turn depends on actions the robot takes, creating a chicken-or-egg…

Robotics · Computer Science 2024-06-04 Kushal Kedia , Atiksh Bhardwaj , Prithwish Dan , Sanjiban Choudhury

We consider the problem of learning good trajectories for manipulation tasks. This is challenging because the criterion defining a good trajectory varies with users, tasks and environments. In this paper, we propose a co-active online…

Robotics · Computer Science 2015-01-30 Ashesh Jain , Brian Wojcik , Thorsten Joachims , Ashutosh Saxena

Pointing gestures are a common interaction method used in Human-Robot Collaboration for various tasks, ranging from selecting targets to guiding industrial processes. This study introduces a method for localizing pointed targets within a…

Robotics · Computer Science 2025-06-30 Noora Sassali , Roel Pieters