English
Related papers

Related papers: Knowledge Guided Bidirectional Attention Network f…

200 papers

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu

Human-Object Interaction (HOI) detection is a fundamental visual task aiming at localizing and recognizing interactions between humans and objects. Existing works focus on the visual and linguistic features of humans and objects. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Yichen Xie , Hao-Shu Fang , Dian Shao , Yong-Lu Li , Cewu Lu

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects via inferring triplets of < human, verb, object >. However, recent HOI detection methods mostly rely on additional annotations (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Dongming Yang , Yuexian Zou

Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction; however, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Xubin Zhong , Changxing Ding , Yupeng Hu , Dacheng Tao

Prevalent human-object interaction (HOI) detection approaches typically leverage large-scale visual-linguistic models to help recognize events involving humans and objects. Though promising, models trained via contrastive learning on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Liulei Li , Wenguan Wang , Yi Yang

Human-object interaction (HOI) detection aims to localize human-object pairs and the interactions between them. Existing methods operate under a closed-world assumption, treating the task as a classification problem over a small, predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Zhaolin Cai , Huiyu Duan , Zitong Xu , Fan Li , Zhi Liu , Jing Liu , Wei Shen , Xiongkuo Min , Guangtao Zhai

Human-object interaction (HOI) detection as a downstream of object detection tasks requires localizing pairs of humans and objects and extracting the semantic relationships between humans and objects from an image. Recently, one-stage…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Junwen Chen , Keiji Yanai

Human-Object Interaction (HOI) detection is a task to localize humans and objects in an image and predict the interactions in human-object pairs. In real-world scenarios, HOI detection models need systematic generalization, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Kentaro Takemoto , Moyuru Yamada , Tomotake Sasaki , Hisanao Akima

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Deep robot vision models are widely used for recognizing objects from camera images, but shows poor performance when detecting objects at untrained positions. Although such problem can be alleviated by training with large datasets, the…

Robotics · Computer Science 2022-10-26 Hyogo Hiruma , Hiroki Mori , Hiroshi Ito , Tetsuya Ogata

Human-Object Interaction (HOI) detection is a fundamental task in high-level human-centric scene understanding. We propose PhraseHOI, containing a HOI branch and a novel phrase branch, to leverage language prior and improve relation…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Zhimin Li , Cheng Zou , Yu Zhao , Boxun Li , Sheng Zhong

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Chaoyi Ai

Human-object interaction (HOI) detection is essential for accurately localizing and characterizing interactions between humans and objects, providing a comprehensive understanding of complex visual scenes across various domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Quan Bi Pay , Vishnu Monn Baskaran , Junn Yong Loo , KokSheik Wong , Simon See

Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these methods frequently focus…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jihao Dong , Renjie Pan , Hua Yang

Human-Object Interaction (HOI) detection focuses on localizing human-object pairs and recognizing their interactions. Recently, the DETR-based framework has been widely adopted in HOI detection. In DETR-based HOI models, queries with clear…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zhehao Li , Chong Wang , Yi Chen , Yinghao Lu , Jiangbo Qian , Jiong Wang , Jiafei Wu

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

Most existing Human-Object Interaction~(HOI) Detection methods rely heavily on full annotations with predefined HOI categories, which is limited in diversity and costly to scale further. We aim at advancing zero-shot HOI detection to detect…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Mingrui Wu , Jiaxin Gu , Yunhang Shen , Mingbao Lin , Chao Chen , Xiaoshuai Sun

Cameras are essential vision instruments to capture images for pattern detection and measurement. Human-object interaction (HOI) detection is one of the most popular pattern detection approaches for captured human-centric visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Manli Zhu , Edmond S. L. Ho , Shuang Chen , Longzhi Yang , Hubert P. H. Shum