English
Related papers

Related papers: Re-mine, Learn and Reason: Exploring the Cross-mod…

200 papers

The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications. Prior work has demonstrated the benefits of effective…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Hangjie Yuan , Jianwen Jiang , Samuel Albanie , Tao Feng , Ziyuan Huang , Dong Ni , Mingqian Tang

We study the problem of detecting human-object interactions (HOI) in static images, defined as predicting a human and an object bounding box with an interaction class label that connects them. HOI detection is a fundamental problem in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Yu-Wei Chao , Yunfan Liu , Xieyang Liu , Huayi Zeng , Jia Deng

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

Human-Object Interaction (HOI) detection is a fundamental task in high-level human-centric scene understanding. We propose PhraseHOI, containing a HOI branch and a novel phrase branch, to leverage language prior and improve relation…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Zhimin Li , Cheng Zou , Yu Zhao , Boxun Li , Sheng Zhong

Recent state-of-the-art methods for HOI detection typically build on transformer architectures with two decoder branches, one for human-object pair detection and the other for interaction classification. Such disentangled transformers,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Sanghyun Kim , Deunsol Jung , Minsu Cho

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Yizhuo Li , Cewu Lu

Zero-shot Human-object interaction (HOI) detection aims to locate humans and objects in images and recognize their interactions. While advances in open-vocabulary object detection provide promising solutions for object localization,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Shiyu Xuan , Dongkai Wang , Zechao Li , Jinhui Tang

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human object interaction (HOI) detection plays a crucial role in human-centric scene understanding and serves as a fundamental building-block for many vision tasks. One generalizable and scalable strategy for HOI detection is to use weak…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Bo Wan , Yongfei Liu , Desen Zhou , Tinne Tuytelaars , Xuming He

Open-vocabulary human-object interaction (HOI) detection, which is concerned with the problem of detecting novel HOIs guided by natural language, is crucial for understanding human-centric scenes. However, prior zero-shot HOI detectors…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Ting Lei , Shaofeng Yin , Yang Liu

Human-Object Interaction (HOI) detection aims to detect visual relations between human and objects in images. One significant problem of HOI detection is that non-interactive human-object pair can be easily mis-grouped and misclassified as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lu Liu , Robby T. Tan

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Recently, Contrastive Language-Image Pre-training (CLIP) has shown great potential in providing interaction prior for HOI…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Shan Ning , Longtian Qiu , Yongfei Liu , Xuming He

Open Vocabulary Human-Object Interaction (HOI) detection aims to detect interactions between humans and objects while generalizing to novel interaction classes beyond the training set. Current methods often rely on Vision and Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Ting Lei , Shaofeng Yin , Qingchao Chen , Yuxin Peng , Yang Liu

Human-Object Interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, conventional HOI detection methods often struggle to fully capture the contextual information needed to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu-Wei Zhan , Fan Liu , Xin Luo , Xin-Shun Xu , Liqiang Nie , Mohan Kankanhalli

Human-object interaction (HOI) detection aims to locate human-object pairs and identify their interaction categories in images. Most existing methods primarily focus on supervised learning, which relies on extensive manual HOI annotations.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Weiying Xue , Qi Liu , Qiwei Xiong , Yuxiao Wang , Zhenao Wei , Xiaofen Xing , Xiangmin Xu

Human-object interaction (HOI) synthesis is crucial for applications in animation, simulation, and robotics. However, existing approaches either rely on expensive motion capture data or require manual reward engineering, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zekai Deng , Ye Shi , Kaiyang Ji , Lan Xu , Shaoli Huang , Jingya Wang

Human-object interaction (HOI) detection is a core task in computer vision. The goal is to localize all human-object pairs and recognize their interactions. An interaction defined by a <verb, noun> tuple leads to a long-tailed visual…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Mert Kilickaya , Arnold Smeulders

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

Human-object interaction (HOI) detection aims to detect interactions between humans and objects in images. While recent advances have improved performance on existing benchmarks, their evaluations mainly focus on overall prediction accuracy…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Lemeng Wang , Qinqian Lei , Vidhi Bakshi , Daniel Yi , Yifan Liu , Jiacheng Hou , Asher Seng Hao , Zheda Mai , Wei-Lun Chao , Robby T. Tan , Bo Wang