English
Related papers

Related papers: A Review of Human-Object Interaction Detection

200 papers

Robots are becoming increasingly integrated into our lives, assisting us in various tasks. To ensure effective collaboration between humans and robots, it is essential that they understand our intentions and anticipate our actions. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Esteve Valls Mascaro , Daniel Sliwowski , Dongheui Lee

Open vocabulary Human-Object Interaction (HOI) detection is a challenging task that detects all <human, verb, object> triplets of interest in an image, even those that are not pre-defined in the training set. Existing approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yupeng Hu , Changxing Ding , Chang Sun , Shaoli Huang , Xiangmin Xu

Humans naturally interact with both others and the surrounding multiple objects, engaging in various social activities. However, recent advances in modeling human-object interactions mostly focus on perceiving isolated individuals and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juze Zhang , Jingyan Zhang , Zining Song , Zhanhe Shi , Chengfeng Zhao , Ye Shi , Jingyi Yu , Lan Xu , Jingya Wang

Human-Object interaction (HOI) detection aims to localize and infer relationships between human and objects in an image. It is challenging because an enormous number of possible combinations of objects and verbs types forms a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zhi Hou , Xiaojiang Peng , Yu Qiao , Dacheng Tao

Open Vocabulary Human-Object Interaction (HOI) detection aims to detect interactions between humans and objects while generalizing to novel interaction classes beyond the training set. Current methods often rely on Vision and Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Ting Lei , Shaofeng Yin , Qingchao Chen , Yuxin Peng , Yang Liu

Video-based Human-Object Interaction (HOI) recognition explores the intricate dynamics between humans and objects, which are essential for a comprehensive understanding of human behavior and intentions. While previous work has made…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Tanqiu Qiao , Ruochen Li , Frederick W. B. Li , Hubert P. H. Shum

Detecting Human-Object Interaction (HOI) in images is an important step towards high-level visual comprehension. Existing work often shed light on improving either human and object detection, or interaction recognition. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Guangzhi Wang , Yangyang Guo , Yongkang Wong , Mohan Kankanhalli

The key of Human-Object Interaction(HOI) recognition is to infer the relationship between human and objects. Recently, the image's Human-Object Interaction(HOI) detection has made significant progress. However, there is still room for…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Hongsheng Li , Guangming Zhu , Wu Zhen , Lan Ni , Peiyi Shen , Liang Zhang , Ning Wang , Cong Hua

Human-Object Interaction (HOI) detection is an essential task to understand human-centric images from a fine-grained perspective. Although end-to-end HOI detection models thrive, their paradigm of parallel human/object detection and verb…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Hangjie Yuan , Mang Wang , Dong Ni , Liangpeng Xu

In scene understanding, robotics benefit from not only detecting individual scene instances but also from learning their possible interactions. Human-Object Interaction (HOI) Detection infers the action predicate on a <human, predicate,…

Machine Learning · Computer Science 2021-03-09 Zhijun Liang , Juan Rojas , Junfa Liu , Yisheng Guan

Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Xubin Zhong , Changxing Ding , Xian Qu , Dacheng Tao

Spatio-temporal Human-Object Interaction (ST-HOI) understanding aims at detecting HOIs from videos, which is crucial for activity understanding. However, existing whole-body-object interaction video benchmarks overlook the truth that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xiaoyang Liu , Boran Wen , Xinpeng Liu , Zizheng Zhou , Hongwei Fan , Cewu Lu , Lizhuang Ma , Yulong Chen , Yong-Lu Li

Human-object interaction (HOI) detection for capturing relationships between humans and objects is an important task in the semantic understanding of images. When processing human and object keypoints extracted from an image using a graph…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yoshiki Ito

Human-Object Interaction (HOI) detection is the task of identifying a set of <human, object, interaction> triplets from an image. Recent work proposed transformer encoder-decoder architectures that successfully eliminated the need for many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Bumsoo Kim , Jonghwan Mun , Kyoung-Woon On , Minchul Shin , Junhyun Lee , Eun-Sol Kim

In open-world environments, human-object interactions (HOIs) evolve continuously, challenging conventional closed-world HOI detection models. Inspired by humans' ability to progressively acquire knowledge, we explore incremental HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yana Wei , Zeen Chi , Chongyu Wang , Yu Wu , Shipeng Yan , Yongfei Liu , Xuming He

Livestreaming often involves interactions between streamers and objects, which is critical for understanding and regulating web content. While human-object interaction (HOI) detection has made some progress in general-purpose video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Menghui Zhang , Jing Zhang , Lin Chen , Li Zhuo

Recently, the DETR framework has emerged as the dominant approach for human--object interaction (HOI) research. In particular, two-stage transformer-based HOI detectors are amongst the most performant and training-efficient approaches.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Frederic Z. Zhang , Yuhui Yuan , Dylan Campbell , Zhuoyao Zhong , Stephen Gould

Egocentric human-object interaction (Ego-HOI) detection is crucial for intelligent agents to understand and assist human activities from a first-person perspective. However, progress has been hindered by the lack of benchmarks and methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kunyuan Deng , Yi Wang , Lap-Pui Chau

Reconstructing dynamic scenes with complex human-object interactions is a fundamental challenge in computer vision and graphics. Existing Gaussian Splatting methods either rely on human pose priors while neglecting dynamic objects, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Taewoo Kim , Suwoong Yeom , Jaehyun Pyun , Geonho Cha , Dongyoon Wee , Joonsik Nam , Yun-Seong Jeong , Kyeongbo Kong , Suk-Ju Kang

Understanding human interaction with objects is an important research topic for embodied Artificial Intelligence and identifying the objects that humans are interacting with is a primary problem for interaction understanding. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yanyan Shao , Qi Ye , Wenhan Luo , Kaihao Zhang , Jiming Chen