English
Related papers

Related papers: Human-Object Interaction Detection via Disentangle…

200 papers

Human-object interaction (HOI) detection plays a key role in high-level visual understanding, facilitating a deep comprehension of human activities. Specifically, HOI detection aims to locate the humans and objects involved in interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yuxiao Wang , Yu Lei , Li Cui , Weiying Xue , Qi Liu , Zhenao Wei

We tackle the challenging problem of human-object interaction (HOI) detection. Existing methods either recognize the interaction of each human-object pair in isolation or perform joint inference based on complex appearance-based features.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Chen Gao , Jiarui Xu , Yuliang Zou , Jia-Bin Huang

The human-object interaction (HOI) detection task refers to localizing humans, localizing objects, and predicting the interactions between each human-object pair. HOI is considered one of the fundamental steps in truly understanding complex…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 A S M Iftekhar , Satish Kumar , R. Austin McEver , Suya You , B. S. Manjunath

The task of Human-Object Interaction~(HOI) detection could be divided into two core problems, i.e., human-object association and interaction understanding. In this paper, we reveal and address the disadvantages of the conventional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yue Liao , Aixi Zhang , Miao Lu , Yongliang Wang , Xiaobo Li , Si Liu

We study the problem of detecting human-object interactions (HOI) in static images, defined as predicting a human and an object bounding box with an interaction class label that connects them. HOI detection is a fundamental problem in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Yu-Wei Chao , Yunfan Liu , Xieyang Liu , Huayi Zeng , Jia Deng

Human-Object Interaction (HOI) detection aims to simultaneously localize human-object pairs and recognize their interactions. While recent two-stage approaches have made significant progress, they still face challenges due to incomplete…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Zhehao Li , Yucheng Qian , Chong Wang , Yinghao Lu , Zhihao Yang , Jiafei Wu

While Human-Object Interaction(HOI) Detection has achieved tremendous advances in recent, it still remains challenging due to complex interactions with multiple humans and objects occurring in images, which would inevitably lead to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Kunlun Xu , Zhimin Li , Zhijun Zhang , Leizhen Dong , Wenhui Xu , Luxin Yan , Sheng Zhong , Xu Zou

Recent state-of-the-art methods for HOI detection typically build on transformer architectures with two decoder branches, one for human-object pair detection and the other for interaction classification. Such disentangled transformers,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Sanghyun Kim , Deunsol Jung , Minsu Cho

Video-based human-object interaction (HOI) understanding requires both detecting ongoing interactions and anticipating their future evolution. However, existing methods usually treat anticipation as a downstream forecasting task built on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuanhao Luo , Di Wen , Kunyu Peng , Ruiping Liu , Junwei Zheng , Yufan Chen , Jiale Wei , Rainer Stiefelhage

Human-Object Interaction (HOI) detection focuses on localizing human-object pairs and recognizing their interactions. Recently, the DETR-based framework has been widely adopted in HOI detection. In DETR-based HOI models, queries with clear…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zhehao Li , Chong Wang , Yi Chen , Yinghao Lu , Jiangbo Qian , Jiong Wang , Jiafei Wu

Scene graph generation (SGG) and human-object interaction (HOI) detection are two important visual tasks aiming at localising and recognising relationships between objects, and interactions between humans and objects, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

The goal of this paper is Human-object Interaction (HO-I) detection. HO-I detection aims to find interacting human-objects regions and classify their interaction from an image. Researchers obtain significant improvement in recent years by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Mert Kilickaya , Arnold Smeulders

To understand the visual world, a machine must not only recognize individual object instances but also how they interact. Humans are often at the center of such interactions and detecting human-object interactions is an important practical…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Georgia Gkioxari , Ross Girshick , Piotr Dollár , Kaiming He

Human-Object Interaction (HOI) detection is a longstanding computer vision problem concerned with predicting the interaction between humans and objects. Current HOI models rely on a vocabulary of interactions at training and inference time,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Francesco Tonini , Alessandro Conti , Lorenzo Vaquero , Cigdem Beyan , Elisa Ricci

Human-Object Interaction (HOI) detection aims to learn how human interacts with surrounding objects. Previous HOI detection frameworks simultaneously detect human, objects and their corresponding interactions by using a predictor. Using…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Huan Peng , Fenggang Liu , Yangguang Li , Bin Huang , Jing Shao , Nong Sang , Changxin Gao

Human-object interaction (HOI) detection as a downstream of object detection tasks requires localizing pairs of humans and objects and extracting the semantic relationships between humans and objects from an image. Recently, one-stage…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Junwen Chen , Keiji Yanai

We propose a novel one-stage Transformer-based semantic and spatial refined transformer (SSRT) to solve the Human-Object Interaction detection task, which requires to localize humans and objects, and predicts their interactions. Differently…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 A S M Iftekhar , Hao Chen , Kaustav Kundu , Xinyu Li , Joseph Tighe , Davide Modolo

Human-Object Interactions (HOI) detection, which aims to localize a human and a relevant object while recognizing their interaction, is crucial for understanding a still image. Recently, transformer-based models have significantly advanced…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Leizhen Dong , Zhimin Li , Kunlun Xu , Zhijun Zhang , Luxin Yan , Sheng Zhong , Xu Zou

Human-object interaction (HOI) detection aims to detect interactions between humans and objects in images. While recent advances have improved performance on existing benchmarks, their evaluations mainly focus on overall prediction accuracy…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Lemeng Wang , Qinqian Lei , Vidhi Bakshi , Daniel Yi , Yifan Liu , Jiacheng Hou , Asher Seng Hao , Zheda Mai , Wei-Lun Chao , Robby T. Tan , Bo Wang

A common problem in human-object interaction (HOI) detection task is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can lead to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon