English
Related papers

Related papers: Is Object Detection Necessary for Human-Object Int…

200 papers

Detection transformers have been applied to human-object interaction (HOI) detection, enhancing the localization and recognition of human-action-object triplets in images. Despite remarkable progress, this study identifies a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Bin Yang , Yulin Zhang , Hong-Yu Zhou , Sibei Yang

Understanding humans from LiDAR point clouds is one of the most critical tasks in autonomous driving due to its close relationships with pedestrian safety, yet it remains challenging in the presence of diverse human-object interactions and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Daniel Sungho Jung , Dohee Cho , Kyoung Mu Lee

Human-Object Interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, conventional HOI detection methods often struggle to fully capture the contextual information needed to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu-Wei Zhan , Fan Liu , Xin Luo , Xin-Shun Xu , Liqiang Nie , Mohan Kankanhalli

Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which aims to predict the HOI triplet in the form of <human, object, action>. Existing methods mainly extract multi-modal features (e.g., appearance, object…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Weibo Jiang , Weihong Ren , Jiandong Tian , Liangqiong Qu , Zhiyong Wang , Honghai Liu

The human-object interaction (HOI) detection task refers to localizing humans, localizing objects, and predicting the interactions between each human-object pair. HOI is considered one of the fundamental steps in truly understanding complex…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 A S M Iftekhar , Satish Kumar , R. Austin McEver , Suya You , B. S. Manjunath

Humans constantly contact objects to move and perform tasks. Thus, detecting human-object contact is important for building human-centered artificial intelligence. However, there exists no robust method to detect contact between the body…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Yixin Chen , Sai Kumar Dwivedi , Michael J. Black , Dimitrios Tzionas

Human-Object Interaction Detection (HOI-DET) aims to localize human-object pairs and identify their interactive relationships. To aggregate contextual cues, existing methods typically propagate information across all detected entities via…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jiajun Hong , Jianan Wei , Wenguan Wang

Human-Object Interaction (HOI) detection is a task to localize humans and objects in an image and predict the interactions in human-object pairs. In real-world scenarios, HOI detection models need systematic generalization, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Kentaro Takemoto , Moyuru Yamada , Tomotake Sasaki , Hisanao Akima

We propose a simple, intuitive yet powerful method for human-object interaction (HOI) detection. HOIs are so diverse in spatial distribution in an image that existing CNN-based methods face the following three major drawbacks; they cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Masato Tamura , Hiroki Ohashi , Tomoaki Yoshinaga

Objects recognition in image is one of the most difficult problems in computer vision. It is also an important step for the implementation of several existing applications that require high-level image interpretation. Therefore, there is a…

Robotics · Computer Science 2015-01-12 M. Kachouane , S. Sahki , M. Lakrouf , N. Ouadah

Human-Object Interaction (HOI) recognition in videos is important for analyzing human activity. Most existing work focusing on visual features usually suffer from occlusion in the real-world scenarios. Such a problem will be further…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Tanqiu Qiao , Qianhui Men , Frederick W. B. Li , Yoshiki Kubotani , Shigeo Morishima , Hubert P. H. Shum

Human-object interactions (HOI) detection aims at capturing human-object pairs in images and corresponding actions. It is an important step toward high-level visual reasoning and scene understanding. However, due to the natural bias from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Lijun Zhang , Wei Suo , Peng Wang , Yanning Zhang

Human-Object Interaction Detection tackles the problem of joint localization and classification of human object interactions. Existing HOI transformers either adopt a single decoder for triplet prediction, or utilize two parallel decoders…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Desen Zhou , Zhichao Liu , Jian Wang , Leshan Wang , Tao Hu , Errui Ding , Jingdong Wang

Human-object interaction(HOI) detection is a critical task in scene understanding. The goal is to infer the triplet <subject, predicate, object> in a scene. In this work, we note that the human pose itself as well as the relative spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Zhijun Liang , Junfa Liu , Yisheng Guan , Juan Rojas

This paper presents a new vision Transformer, named Iwin Transformer, which is specifically designed for human-object interaction (HOI) detection, a detailed scene understanding task involving a sequential process of human/object detection…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Danyang Tu , Xiongkuo Min , Huiyu Duan , Guodong Guo , Guangtao Zhai , Wei Shen

We introduce YOLO-pose, a novel heatmap-free approach for joint detection, and 2D multi-person pose estimation in an image based on the popular YOLO object detection framework. Existing heatmap based two-stage approaches are sub-optimal as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Debapriya Maji , Soyeb Nagori , Manu Mathew , Deepak Poddar

Current LiDAR-based 3D object detectors for autonomous driving are almost entirely trained on human-annotated data collected in specific geographical domains with specific sensor setups, making it difficult to adapt to a different domain.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Jenny Xu , Steven L. Waslander

In human-object interactions (HOI) recognition, conventional methods consider the human body as a whole and pay a uniform attention to the entire body region. They ignore the fact that normally, human interacts with an object by using some…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Hao-Shu Fang , Jinkun Cao , Yu-Wing Tai , Cewu Lu

Human-object interaction detection is a relatively new task in the world of computer vision and visual semantic information extraction. With the goal of machines identifying interactions that humans perform on objects, there are many…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Trevor Bergstrom , Humphrey Shi

Detecting human-object interactions is essential for comprehensive understanding of visual scenes. In particular, spatial connections between humans and objects are important cues for reasoning interactions. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Manli Zhu , Edmond S. L. Ho , Hubert P. H. Shum