English
Related papers

Related papers: Contact-Aware Amodal Completion for Human-Object I…

200 papers

We propose CG-HOI, the first method to address the task of generating dynamic 3D human-object interactions (HOIs) from text. We model the motion of both human and object in an interdependent fashion, as semantically rich human motion rarely…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Christian Diller , Angela Dai

Reconstructing 3D human-object interaction (HOI) from single-view RGB images is challenging due to the absence of depth information and potential occlusions. Existing methods simply predict the body poses merely rely on network training on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuhang Chen , Chenxing Wang

Understanding the inherent human knowledge in interacting with a given environment (e.g., affordance) is essential for improving AI to better assist humans. While existing approaches primarily focus on human-object contacts during…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Hyeonwoo Kim , Sookwan Han , Patrick Kwon , Hanbyul Joo

Human-Object Interaction (HOI) detection plays a core role in activity understanding. Though recent two/one-stage methods have achieved impressive results, as an essential step, discovering interactive human-object pairs remains…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Xinpeng Liu , Yong-Lu Li , Xiaoqian Wu , Yu-Wing Tai , Cewu Lu , Chi-Keung Tang

Human-object interaction detection (HOID) refers to localizing interactive human-object pairs in images and identifying the interactions. Since there could be an exponential number of object-action combinations, labeled data is limited -…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Sandipan Sarma , Agney Talwarr , Arijit Sur

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets. Despite the challenges posed by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yichao Cao , Qingfei Tang , Feng Yang , Xiu Su , Shan You , Xiaobo Lu , Chang Xu

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Chaoyi Ai

Human-object interaction (HOI) detection aims to detect interactions between humans and objects in images. While recent advances have improved performance on existing benchmarks, their evaluations mainly focus on overall prediction accuracy…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Lemeng Wang , Qinqian Lei , Vidhi Bakshi , Daniel Yi , Yifan Liu , Jiacheng Hou , Asher Seng Hao , Zheda Mai , Wei-Lun Chao , Robby T. Tan , Bo Wang

Human-object contact (HOT) is designed to accurately identify the areas where humans and objects come into contact. Current methods frequently fail to account for scenarios where objects are frequently blocking the view, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxiao Wang , Wenpeng Neng , Zhenao Wei , Yu Lei , Weiying Xue , Nan Zhuang , Yanwu Xu , Xinyu Jiang , Qi Liu

Amodal segmentation aims to predict segmentation masks for both the visible and occluded regions of an object. Most existing works formulate this as a supervised learning problem, requiring manually annotated amodal masks or synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jae Joong Lee , Bedrich Benes , Raymond A. Yeh

Understanding and synthesizing realistic 3D hand-object interactions (HOI) is critical for applications ranging from immersive AR/VR to dexterous robotics. Existing methods struggle with generalization, performing well on closed-set objects…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhenhao Zhang , Ye Shi , Lingxiao Yang , Suting Ni , Qi Ye , Jingya Wang

Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics. However, acquiring 3D HOI data is challenging due to its complexity and high cost, limiting existing methods to the…

Graphics · Computer Science 2025-03-27 Yuke Lou , Yiming Wang , Zhen Wu , Rui Zhao , Wenjia Wang , Mingyi Shi , Taku Komura

Detecting human-object interactions (HOIs) is an intricate challenge in the field of computer vision. Existing methods for HOI detection heavily rely on appearance-based features, but these may not fully capture all the essential…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Lijing Zhu , Qizhen Lan , Alvaro Velasquez , Houbing Song , Acharya Kamal , Qing Tian , Shuteng Niu

We propose HOI Transformer to tackle human object interaction (HOI) detection in an end-to-end manner. Current approaches either decouple HOI task into separated stages of object detection and interaction classification or introduce…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Cheng Zou , Bohan Wang , Yue Hu , Junqi Liu , Qian Wu , Yu Zhao , Boxun Li , Chenguang Zhang , Chi Zhang , Yichen Wei , Jian Sun

This paper presents InteractEdit, a novel framework for zero-shot Human-Object Interaction (HOI) editing, addressing the challenging task of transforming an existing interaction in an image into a new, desired interaction while preserving…

Graphics · Computer Science 2025-03-13 Jiun Tian Hoe , Weipeng Hu , Wei Zhou , Chao Xie , Ziwei Wang , Chee Seng Chan , Xudong Jiang , Yap-Peng Tan

Understanding humans from LiDAR point clouds is one of the most critical tasks in autonomous driving due to its close relationships with pedestrian safety, yet it remains challenging in the presence of diverse human-object interactions and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Daniel Sungho Jung , Dohee Cho , Kyoung Mu Lee

We address the challenging task of text-driven 3D human-object interaction (HOI) motion generation. Existing methods primarily rely on a direct text-to-HOI mapping, which suffers from three key limitations due to the significant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yin Wang , Ziyao Zhang , Zhiying Leng , Haitian Liu , Frederick W. B. Li , Mu Li , Xiaohui Liang

Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Hao-Shu Fang , Yichen Xie , Dian Shao , Cewu Lu

Recent advances in 3D human-aware generation have made significant progress. However, existing methods still struggle with generating novel Human Object Interaction (HOI) from text, particularly for open-set objects. We identify three main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jinlu Zhang , Yixin Chen , Zan Wang , Jie Yang , Yizhou Wang , Siyuan Huang

In open-world environments, human-object interactions (HOIs) evolve continuously, challenging conventional closed-world HOI detection models. Inspired by humans' ability to progressively acquire knowledge, we explore incremental HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yana Wei , Zeen Chi , Chongyu Wang , Yu Wu , Shipeng Yan , Yongfei Liu , Xuming He