English
Related papers

Related papers: Disentangled Pre-training for Human-Object Interac…

200 papers

Human-Object Interaction (HOI) detection, inferring the relationships between human and objects from images/videos, is a fundamental task for high-level scene understanding. However, HOI detection usually suffers from the open long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Human-Object Interaction (HOI) detection has seen substantial advances in recent years. However, existing works focus on the standard setting with ideal images and natural distribution, far from practical scenarios with inevitable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chi Xie , Shuang Liang , Jie Li , Feng Zhu , Rui Zhao , Yichen Wei , Shengjie Zhao

Resolving real-world human-object interactions in images is a many-to-many challenge, in which disentangling fine-grained concurrent physical contact is particularly difficult. Existing semantic contact estimation methods are either limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Sravan Chittupalli , Ayush Jain , Dong Huang

Detecting Human-Object Interaction (HOI) in images is an important step towards high-level visual comprehension. Existing work often shed light on improving either human and object detection, or interaction recognition. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Guangzhi Wang , Yangyang Guo , Yongkang Wong , Mohan Kankanhalli

Human-Object Interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, conventional HOI detection methods often struggle to fully capture the contextual information needed to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu-Wei Zhan , Fan Liu , Xin Luo , Xin-Shun Xu , Liqiang Nie , Mohan Kankanhalli

Human-object interaction (HOI) detectors with popular query-transformer architecture have achieved promising performance. However, accurately identifying uncommon visual patterns and distinguishing between ambiguous HOIs continue to be…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Mingda Jia , Liming Zhao , Ge Li , Yun Zheng

Accurately modeling detailed interactions between human/hand and object is an appealing yet challenging task. Current multi-view capture systems are only capable of reconstructing multiple subjects into a single, unified mesh, which fails…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jiajun Zhang , Yuxiang Zhang , Hongwen Zhang , Xiao Zhou , Boyao Zhou , Ruizhi Shao , Zonghai Hu , Yebin Liu

We have witnessed significant progress in human-object interaction (HOI) detection. The reliance on mAP (mean Average Precision) scores as a summary metric, however, does not provide sufficient insight into the nuances of model performance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Fangrui Zhu , Yiming Xie , Weidi Xie , Huaizu Jiang

Existing Human-Object Interaction (HOI) Detection approaches have achieved great progress on nonrare classes while rare HOI classes are still not well-detected. In this paper, we intend to apply human prior knowledge into the existing work.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Shenyu Zhang , Zichen Zhu , Qingquan Bao

Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided…

Robotics · Computer Science 2026-03-03 Yuhang Lin , Jiyuan Shi , Dewei Wang , Jipeng Kong , Yong Liu , Chenjia Bai , Xuelong Li

Livestreaming often involves interactions between streamers and objects, which is critical for understanding and regulating web content. While human-object interaction (HOI) detection has made some progress in general-purpose video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Menghui Zhang , Jing Zhang , Lin Chen , Li Zhuo

In scene understanding, robotics benefit from not only detecting individual scene instances but also from learning their possible interactions. Human-Object Interaction (HOI) Detection infers the action predicate on a <human, predicate,…

Machine Learning · Computer Science 2021-03-09 Zhijun Liang , Juan Rojas , Junfa Liu , Yisheng Guan

In open-world environments, human-object interactions (HOIs) evolve continuously, challenging conventional closed-world HOI detection models. Inspired by humans' ability to progressively acquire knowledge, we explore incremental HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yana Wei , Zeen Chi , Chongyu Wang , Yu Wu , Shipeng Yan , Yongfei Liu , Xuming He

Open vocabulary Human-Object Interaction (HOI) detection is a challenging task that detects all <human, verb, object> triplets of interest in an image, even those that are not pre-defined in the training set. Existing approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yupeng Hu , Changxing Ding , Chang Sun , Shaoli Huang , Xiangmin Xu

In light of the mounting imperative for public security, the necessity for automated threat detection in high-risk scenarios is becoming increasingly pressing. However, existing methods generally suffer from the problems of uninterpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yuhan Wang , Cheng Liu , Daou Zhang , Zihan Zhao , Jinyang Chen , Purui Dong , Zuyuan Yu , Ziru Wang , Weichao Wu

Human-object interaction(HOI) detection is a critical task in scene understanding. The goal is to infer the triplet <subject, predicate, object> in a scene. In this work, we note that the human pose itself as well as the relative spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Zhijun Liang , Junfa Liu , Yisheng Guan , Juan Rojas

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Synthesizing realistic human-object interaction (HOI) is essential for 3D computer vision and robotics, underpinning animation and embodied control. Existing approaches often require manually specified intermediate waypoints and place all…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Hwanhee Jung , Seunggwan Lee , Jeongyoon Yoon , SeungHyeon Kim , Giljoo Nam , Qixing Huang , Sangpil Kim

Existing 3D human object interaction (HOI) datasets and models simply align global descriptions with the long HOI sequence, while lacking a detailed understanding of intermediate states and the transitions between states. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jie Yang , Xuesong Niu , Nan Jiang , Ruimao Zhang , Siyuan Huang

Recent state-of-the-art methods for HOI detection typically build on transformer architectures with two decoder branches, one for human-object pair detection and the other for interaction classification. Such disentangled transformers,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Sanghyun Kim , Deunsol Jung , Minsu Cho