English
Related papers

Related papers: Zero-Shot Human-Object Interaction Synthesis with …

200 papers

Reconstructing 3D human-object interaction (HOI) from single-view RGB images is challenging due to the absence of depth information and potential occlusions. Existing methods simply predict the body poses merely rely on network training on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuhang Chen , Chenxing Wang

Fine-grained capturing of 3D HOI boosts human activity understanding and facilitates downstream visual tasks, including action recognition, holistic scene reconstruction, and human motion synthesis. Despite its significance, existing works…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nan Jiang , Tengyu Liu , Zhexuan Cao , Jieming Cui , Zhiyuan zhang , Yixin Chen , He Wang , Yixin Zhu , Siyuan Huang

Generating realistic 3D hand-object interactions (HOI) is a fundamental challenge in computer vision and robotics, requiring both temporal coherence and high-fidelity physical plausibility. Existing methods remain limited in their ability…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Jiankang Deng , Cordelia Schmid , Stefanos Zafeiriou

Human-object interaction (HOI) synthesis is crucial for creating immersive and realistic experiences for applications such as virtual reality. Existing methods often rely on simplified object representations, such as the object's centroid…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Mengqing Xue , Yifei Liu , Ling Guo , Shaoli Huang , Changxing Ding

Hand-Object Interaction (HOI) generation has significant application potential. However, current 3D HOI motion generation approaches heavily rely on predefined 3D object models and lab-captured motion data, limiting generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Lingwei Dang , Ruizhi Shao , Hongwen Zhang , Wei Min , Yebin Liu , Qingyao Wu

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Yizhuo Li , Cewu Lu

Humans naturally interact with both others and the surrounding multiple objects, engaging in various social activities. However, recent advances in modeling human-object interactions mostly focus on perceiving isolated individuals and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juze Zhang , Jingyan Zhang , Zining Song , Zhanhe Shi , Chengfeng Zhao , Ye Shi , Jingyi Yu , Lan Xu , Jingya Wang

Generating realistic 3D Human-Object Interactions (HOI) is a fundamental task for applications ranging from embodied AI to virtual content creation, which requires harmonizing high-level semantic intent with strict low-level physical…

Robotics · Computer Science 2026-05-08 Hao Wang , Shiqi Wang , Qi Liu

Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these methods frequently focus…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jihao Dong , Renjie Pan , Hua Yang

Zero-shot human-object interaction (HOI) detection remains a challenging task, particularly in generalizing to unseen actions. Existing methods address this challenge by tapping Vision-Language Models (VLMs) to access knowledge beyond the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Qinqian Lei , Bo Wang , Robby T. Tan

Human-Object Interaction (HOI) recognition in videos is important for analyzing human activity. Most existing work focusing on visual features usually suffer from occlusion in the real-world scenarios. Such a problem will be further…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Tanqiu Qiao , Qianhui Men , Frederick W. B. Li , Yoshiki Kubotani , Shigeo Morishima , Hubert P. H. Shum

Detecting human-object interactions (HOI) is an important step toward a comprehensive visual understanding of machines. While detecting non-temporal HOIs (e.g., sitting on a chair) from static images is feasible, it is unlikely even for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Meng-Jiun Chiou , Chun-Yu Liao , Li-Wei Wang , Roger Zimmermann , Jiashi Feng

We propose HOI Transformer to tackle human object interaction (HOI) detection in an end-to-end manner. Current approaches either decouple HOI task into separated stages of object detection and interaction classification or introduce…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Cheng Zou , Bohan Wang , Yue Hu , Junqi Liu , Qian Wu , Yu Zhao , Boxun Li , Chenguang Zhang , Chi Zhang , Yichen Wei , Jian Sun

In this paper, we propose a new instance-level human-object interaction detection task on videos called ST-HOID, which aims to distinguish fine-grained human-object interactions (HOIs) and the trajectories of subjects and objects. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xu Sun , Yunqing He , Tongwei Ren , Gangshan Wu

Detecting human-object interaction (HOI) has long been limited by the amount of supervised data available. Recent approaches address this issue by pre-training according to pseudo-labels, which align object regions with HOI triplets parsed…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zhuolong Li , Xingao Li , Changxing Ding , Xiangmin Xu

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human motion guided by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaman Li , Alexander Clegg , Roozbeh Mottaghi , Jiajun Wu , Xavier Puig , C. Karen Liu

Human-Object Interaction (HOI) detection is a longstanding computer vision problem concerned with predicting the interaction between humans and objects. Current HOI models rely on a vocabulary of interactions at training and inference time,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Francesco Tonini , Alessandro Conti , Lorenzo Vaquero , Cigdem Beyan , Elisa Ricci

Existing 3D human object interaction (HOI) datasets and models simply align global descriptions with the long HOI sequence, while lacking a detailed understanding of intermediate states and the transitions between states. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jie Yang , Xuesong Niu , Nan Jiang , Ruimao Zhang , Siyuan Huang

A comprehensive understanding of human-object interaction (HOI) requires detecting not only a small portion of predefined HOI concepts (or categories) but also other reasonable HOI concepts, while current approaches usually fail to explore…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhi Hou , Baosheng Yu , Dacheng Tao

In this work, we are dedicated to a new task, i.e., hand-object interaction image generation, which aims to conditionally generate the hand-object image under the given hand, object and their interaction status. This task is challenging and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Hezhen Hu , Weilun Wang , Wengang Zhou , Houqiang Li