English
Related papers

Related papers: Detecting Human-Object Interactions with Object-Gu…

200 papers

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Yizhuo Li , Cewu Lu

Human-Object Interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, conventional HOI detection methods often struggle to fully capture the contextual information needed to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu-Wei Zhan , Fan Liu , Xin Luo , Xin-Shun Xu , Liqiang Nie , Mohan Kankanhalli

Human-object interaction (HOI) detection aims to detect interactions between humans and objects in images. While recent advances have improved performance on existing benchmarks, their evaluations mainly focus on overall prediction accuracy…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Lemeng Wang , Qinqian Lei , Vidhi Bakshi , Daniel Yi , Yifan Liu , Jiacheng Hou , Asher Seng Hao , Zheda Mai , Wei-Lun Chao , Robby T. Tan , Bo Wang

Human object interaction (HOI) detection is an important task in image understanding and reasoning. It is in a form of HOI triplet <human; verb; object>, requiring bounding boxes for human and object, and action between them for the task…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Suresh Kirthi Kumaraswamy , Miaojing Shi , Ewa Kijak

Human-centered dynamic scene understanding plays a pivotal role in enhancing the capability of robotic and autonomous systems, in which Video-based Human-Object Interaction (V-HOI) detection is a crucial task in semantic scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hang Zhang , Wenxiao Zhang , Haoxuan Qu , Jun Liu

We propose HOI Transformer to tackle human object interaction (HOI) detection in an end-to-end manner. Current approaches either decouple HOI task into separated stages of object detection and interaction classification or introduce…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Cheng Zou , Bohan Wang , Yue Hu , Junqi Liu , Qian Wu , Yu Zhao , Boxun Li , Chenguang Zhang , Chi Zhang , Yichen Wei , Jian Sun

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects via inferring triplets of < human, verb, object >. However, recent HOI detection methods mostly rely on additional annotations (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Dongming Yang , Yuexian Zou

In scene understanding, robotics benefit from not only detecting individual scene instances but also from learning their possible interactions. Human-Object Interaction (HOI) Detection infers the action predicate on a <human, predicate,…

Machine Learning · Computer Science 2021-03-09 Zhijun Liang , Juan Rojas , Junfa Liu , Yisheng Guan

Recently, the DETR framework has emerged as the dominant approach for human--object interaction (HOI) research. In particular, two-stage transformer-based HOI detectors are amongst the most performant and training-efficient approaches.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Frederic Z. Zhang , Yuhui Yuan , Dylan Campbell , Zhuoyao Zhong , Stephen Gould

Detecting human-object interaction (HOI) has long been limited by the amount of supervised data available. Recent approaches address this issue by pre-training according to pseudo-labels, which align object regions with HOI triplets parsed…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zhuolong Li , Xingao Li , Changxing Ding , Xiangmin Xu

A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Human Object Interaction (HOI) detection is a challenging task that requires to distinguish the interaction between a human-object pair. Attention based relation parsing is a popular and effective strategy utilized in HOI. However, current…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jingjia Huang , Baixiang Yang

Human-Object Interaction detection is a holistic visual recognition task that entails object detection as well as interaction classification. Previous works of HOI detection has been addressed by the various compositions of subset…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jihwan Park , SeungJun Lee , Hwan Heo , Hyeong Kyu Choi , Hyunwoo J. Kim

Zero-shot Human-Object Interaction (HOI) detection has emerged as a frontier topic due to its capability to detect HOIs beyond a predefined set of categories. This task entails not only identifying the interactiveness of human-object pairs…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ting Lei , Shaofeng Yin , Yuxin Peng , Yang Liu

Human-Object Interaction (HOI) detection aims to identify humans and objects within images and interpret their interactions. Existing HOI methods rely heavily on large datasets with manual annotations to learn interactions from visual cues.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Francesco Tonini , Lorenzo Vaquero , Alessandro Conti , Cigdem Beyan , Elisa Ricci

In this paper, we investigate the task of zero-shot human-object interaction (HOI) detection, a novel paradigm for identifying HOIs without the need for task-specific annotations. To address this challenging task, we employ CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Bo Wan , Tinne Tuytelaars

The relative spatial layout of a human and an object is an important cue for determining how they interact. However, until now, spatial layout has been used just as side-information for detecting human-object interactions (HOIs). In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Most existing Human-Object Interaction~(HOI) Detection methods rely heavily on full annotations with predefined HOI categories, which is limited in diversity and costly to scale further. We aim at advancing zero-shot HOI detection to detect…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Mingrui Wu , Jiaxin Gu , Yunhang Shen , Mingbao Lin , Chao Chen , Xiaoshuai Sun

This paper focuses on Human-Object Interaction (HOI) detection, addressing the challenge of identifying and understanding the interactions between humans and objects within a given image or video frame. Spearheaded by Detection Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Mu Chen , Minghan Chen , Yi Yang

The goal of this paper is Human-object Interaction (HO-I) detection. HO-I detection aims to find interacting human-objects regions and classify their interaction from an image. Researchers obtain significant improvement in recent years by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Mert Kilickaya , Arnold Smeulders