English
Related papers

Related papers: ACP++: Action Co-occurrence Priors for Human-Objec…

200 papers

Rapid progress has been witnessed for human-object interaction (HOI) recognition, but most existing models are confined to single-stage reasoning pipelines. Considering the intrinsic complexity of the task, we introduce a cascade…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Tianfei Zhou , Wenguan Wang , Siyuan Qi , Haibin Ling , Jianbing Shen

Human-Object Interaction (HOI) detection is a longstanding computer vision problem concerned with predicting the interaction between humans and objects. Current HOI models rely on a vocabulary of interactions at training and inference time,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Francesco Tonini , Alessandro Conti , Lorenzo Vaquero , Cigdem Beyan , Elisa Ricci

Reasoning the human-object interactions (HOI) is essential for deeper scene understanding, while object affordances (or functionalities) are of great importance for human to discover unseen HOIs with novel objects. Inspired by this, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

This paper revisits human-object interaction (HOI) recognition at image level without using supervisions of object location and human pose. We name it detection-free HOI recognition, in contrast to the existing detection-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Zicheng Liu , Jenq-Neng Hwang

The relative spatial layout of a human and an object is an important cue for determining how they interact. However, until now, spatial layout has been used just as side-information for detecting human-object interactions (HOIs). In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Human-Object Interaction Detection tackles the problem of joint localization and classification of human object interactions. Existing HOI transformers either adopt a single decoder for triplet prediction, or utilize two parallel decoders…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Desen Zhou , Zhichao Liu , Jian Wang , Leshan Wang , Tao Hu , Errui Ding , Jingdong Wang

Human-Object Interaction (HOI) detection, inferring the relationships between human and objects from images/videos, is a fundamental task for high-level scene understanding. However, HOI detection usually suffers from the open long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Human-object interaction(HOI) detection is a critical task in scene understanding. The goal is to infer the triplet <subject, predicate, object> in a scene. In this work, we note that the human pose itself as well as the relative spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Zhijun Liang , Junfa Liu , Yisheng Guan , Juan Rojas

Human-Object Interactions (HOI) detection, which aims to localize a human and a relevant object while recognizing their interaction, is crucial for understanding a still image. Recently, transformer-based models have significantly advanced…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Leizhen Dong , Zhimin Li , Kunlun Xu , Zhijun Zhang , Luxin Yan , Sheng Zhong , Xu Zou

The recent advances in instance-level detection tasks lay strong foundation for genuine comprehension of the visual scenes. However, the ability to fully comprehend a social scene is still in its preliminary stage. In this work, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Bingjie Xu , Junnan Li , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Robots are becoming increasingly integrated into our lives, assisting us in various tasks. To ensure effective collaboration between humans and robots, it is essential that they understand our intentions and anticipate our actions. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Esteve Valls Mascaro , Daniel Sliwowski , Dongheui Lee

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Yizhuo Li , Cewu Lu

We tackle the challenging problem of human-object interaction (HOI) detection. Existing methods either recognize the interaction of each human-object pair in isolation or perform joint inference based on complex appearance-based features.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Chen Gao , Jiarui Xu , Yuliang Zou , Jia-Bin Huang

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects. Latest end-to-end HOI detectors are short of relation reasoning, which leads to inability to learn HOI-specific interactive semantics…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Dongming Yang , Yuexian Zou , Can Zhang , Meng Cao , Jie Chen

Human-Object Interaction (HOI) detection is a fundamental visual task aiming at localizing and recognizing interactions between humans and objects. Existing works focus on the visual and linguistic features of humans and objects. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets. Despite the challenges posed by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yichao Cao , Qingfei Tang , Feng Yang , Xiu Su , Shan You , Xiaobo Lu , Chang Xu

This paper addresses the task of detecting and recognizing human-object interactions (HOI) in images and videos. We introduce the Graph Parsing Neural Network (GPNN), a framework that incorporates structural knowledge while being…

Computer Vision and Pattern Recognition · Computer Science 2018-08-27 Siyuan Qi , Wenguan Wang , Baoxiong Jia , Jianbing Shen , Song-Chun Zhu

Human-object interaction (HOI) detection aims to localize human-object pairs and the interactions between them. Existing methods operate under a closed-world assumption, treating the task as a classification problem over a small, predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Zhaolin Cai , Huiyu Duan , Zitong Xu , Fan Li , Zhi Liu , Jing Liu , Wei Shen , Xiongkuo Min , Guangtao Zhai

Existing Human-Object Interaction (HOI) Detection approaches have achieved great progress on nonrare classes while rare HOI classes are still not well-detected. In this paper, we intend to apply human prior knowledge into the existing work.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Shenyu Zhang , Zichen Zhu , Qingquan Bao

In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Panqi Yang , Haodong Jing , Nanning Zheng , Yongqiang Ma