English

Parallel Reasoning Network for Human-Object Interaction Detection

Computer Vision and Pattern Recognition 2023-01-10 v1

Abstract

Human-Object Interaction (HOI) detection aims to learn how human interacts with surrounding objects. Previous HOI detection frameworks simultaneously detect human, objects and their corresponding interactions by using a predictor. Using only one shared predictor cannot differentiate the attentive field of instance-level prediction and relation-level prediction. To solve this problem, we propose a new transformer-based method named Parallel Reasoning Network(PR-Net), which constructs two independent predictors for instance-level localization and relation-level understanding. The former predictor concentrates on instance-level localization by perceiving instances' extremity regions. The latter broadens the scope of relation region to reach a better relation-level semantic understanding. Extensive experiments and analysis on HICO-DET benchmark exhibit that our PR-Net effectively alleviated this problem. Our PR-Net has achieved competitive results on HICO-DET and V-COCO benchmarks.

Keywords

Cite

@article{arxiv.2301.03510,
  title  = {Parallel Reasoning Network for Human-Object Interaction Detection},
  author = {Huan Peng and Fenggang Liu and Yangguang Li and Bin Huang and Jing Shao and Nong Sang and Changxin Gao},
  journal= {arXiv preprint arXiv:2301.03510},
  year   = {2023}
}
R2 v1 2026-06-28T08:07:48.112Z