English
Related papers

Related papers: HOI4ABOT: Human-Object Interaction Anticipation fo…

200 papers

Understanding human intentions is key to enabling effective and efficient human-robot interaction (HRI) in collaborative settings. To enable developments and evaluation of the ability of artificial intelligence (AI) systems to infer human…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Jiafei Duan , Samson Yu , Nicholas Tan , Yi Ru Wang , Cheston Tan

Intuitive and efficient physical human-robot collaboration relies on the mutual observability of the human and the robot, i.e. the two entities being able to interpret each other's intentions and actions. This is remedied by a myriad of…

Robotics · Computer Science 2022-03-03 Yiming Liu , Raz Leib , William Dudley , Ali Shafti , A. Aldo Faisal , David W. Franklin

We propose CG-HOI, the first method to address the task of generating dynamic 3D human-object interactions (HOIs) from text. We model the motion of both human and object in an interdependent fashion, as semantically rich human motion rarely…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Christian Diller , Angela Dai

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets. Despite the challenges posed by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yichao Cao , Qingfei Tang , Feng Yang , Xiu Su , Shan You , Xiaobo Lu , Chang Xu

Complex tasks require human collaboration since robots do not have enough dexterity. However, robots are still used as instruments and not as collaborative systems. We are introducing a framework to ensure safety in a human-robot…

We present a method for learning a human-robot collaboration policy from human-human collaboration demonstrations. An effective robot assistant must learn to handle diverse human behaviors shown in the demonstrations and be robust when the…

Robotics · Computer Science 2023-09-21 Chen Wang , Claudia Pérez-D'Arpino , Danfei Xu , Li Fei-Fei , C. Karen Liu , Silvio Savarese

Recently, human-robot interaction (HRI) is an extensive research topic and theme which gained importance and significance. HRI aims at the complementary combination between the robot capabilities and human skills. The robots assist humans…

Robotics · Computer Science 2021-02-02 Abdel-Nasser Sharkawy

Real-world scenes often feature multiple humans interacting with multiple objects in ways that are causal, goal-oriented, or cooperative. Yet existing 3D human-object interaction (HOI) benchmarks consider only a fraction of these complex…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Kaen Kogashi , Anoop Cherian , Meng-Yu Jennifer Kuo

As technology advances, the need for safe, efficient, and collaborative human-robot-teams has become increasingly important. One of the most fundamental collaborative tasks in any setting is the object handover. Human-to-robot handovers can…

Robotics · Computer Science 2024-02-21 Andrew Choi , Mohammad Khalid Jawed , Jungseock Joo

Shared dynamics models are important for capturing the complexity and variability inherent in Human-Robot Interaction (HRI). Therefore, learning such shared dynamics models can enhance coordination and adaptability to enable successful…

Generating human-object interactions (HOIs) is critical with the tremendous advances of digital avatars. Existing datasets are typically limited to humans interacting with a single object while neglecting the ubiquitous manipulation of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Xintao Lv , Liang Xu , Yichao Yan , Xin Jin , Congsheng Xu , Shuwen Wu , Yifan Liu , Lincheng Li , Mengxiao Bi , Wenjun Zeng , Xiaokang Yang

This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most existing research on HOI synthesis lacks comprehensive whole-body interactions with dynamic objects, e.g., often limited to manipulating small or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Sirui Xu , Zhengyuan Li , Yu-Xiong Wang , Liang-Yan Gui

Detecting human-object interactions (HOIs) is an intricate challenge in the field of computer vision. Existing methods for HOI detection heavily rely on appearance-based features, but these may not fully capture all the essential…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Lijing Zhu , Qizhen Lan , Alvaro Velasquez , Houbing Song , Acharya Kamal , Qing Tian , Shuteng Niu

This paper develops a methodology for collaborative human-robot exploration that leverages implicit coordination. Most autonomous single- and multi-robot exploration systems require a remote operator to provide explicit guidance to the…

Robotics · Computer Science 2023-04-20 Yves Georgy Daoud , Kshitij Goel , Nathan Michael , Wennie Tabib

Humans possess the innate ability to extract latent visuo-lingual cues to infer context through human interaction. During collaboration, this enables proactive prediction of the underlying intention of a series of tasks. In contrast,…

Robotics · Computer Science 2023-10-05 Pranay Mathur

Human-Object Interaction (HOI) detection is an important problem to understand how humans interact with objects. In this paper, we explore interactiveness knowledge which indicates whether a human and an object interact with each other or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Xijie Huang , Liang Xu , Cewu Lu

This paper explores a cross-modality synthesis task that infers 3D human-object interactions (HOIs) from a given text-based instruction. Existing text-to-HOI synthesis methods mainly deploy a direct mapping from texts to object-specific 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xuehao Gao , Yang Yang , Shaoyi Du , Yang Wu , Yebin Liu , Guo-Jun Qi

In this paper, we propose a new instance-level human-object interaction detection task on videos called ST-HOID, which aims to distinguish fine-grained human-object interactions (HOIs) and the trajectories of subjects and objects. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xu Sun , Yunqing He , Tongwei Ren , Gangshan Wu

Robot-to-human object handover is an important step in many human robot collaboration tasks. A successful handover requires the robot to maintain a stable grasp on the object while making sure the human receives the object in a natural and…

Robotics · Computer Science 2024-10-01 Zixi Wang , Zeyi Liu , Nicolas Ouporov , Shuran Song

As the use of Augmented Reality (AR) to enhance interactions between human agents and robotic systems in a work environment continues to grow, robots must communicate their intents in informative yet straightforward ways. This improves the…

Robotics · Computer Science 2023-03-13 Chrisantus Eze , Christopher Crick