English
Related papers

Related papers: Towards Unconstrained Human-Object Interaction

200 papers

Human-Object Interaction (HOI) detection aims to localize human-object pairs and classify their interactions from a single image, a task that demands strong visual understanding and nuanced contextual reasoning. Recent approaches have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Soo Won Seo , KyungChae Lee , Hyungchan Cho , Taein Son , Nam Ik Cho , Jun Won Choi

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects via inferring triplets of < human, verb, object >. However, recent HOI detection methods mostly rely on additional annotations (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Dongming Yang , Yuexian Zou

Open vocabulary Human-Object Interaction (HOI) detection is a challenging task that detects all <human, verb, object> triplets of interest in an image, even those that are not pre-defined in the training set. Existing approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yupeng Hu , Changxing Ding , Chang Sun , Shaoli Huang , Xiangmin Xu

Understanding and synthesizing realistic 3D hand-object interactions (HOI) is critical for applications ranging from immersive AR/VR to dexterous robotics. Existing methods struggle with generalization, performing well on closed-set objects…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhenhao Zhang , Ye Shi , Lingxiao Yang , Suting Ni , Qi Ye , Jingya Wang

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Yizhuo Li , Cewu Lu

Detecting human-object interactions (HOIs) is an intricate challenge in the field of computer vision. Existing methods for HOI detection heavily rely on appearance-based features, but these may not fully capture all the essential…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Lijing Zhu , Qizhen Lan , Alvaro Velasquez , Houbing Song , Acharya Kamal , Qing Tian , Shuteng Niu

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Chaoyi Ai

In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Panqi Yang , Haodong Jing , Nanning Zheng , Yongqiang Ma

Human-object interaction (HOI) detection aims to locate human-object pairs and identify their interaction categories in images. Most existing methods primarily focus on supervised learning, which relies on extensive manual HOI annotations.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Weiying Xue , Qi Liu , Qiwei Xiong , Yuxiao Wang , Zhenao Wei , Xiaofen Xing , Xiangmin Xu

Detecting human-object interaction (HOI) has long been limited by the amount of supervised data available. Recent approaches address this issue by pre-training according to pseudo-labels, which align object regions with HOI triplets parsed…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zhuolong Li , Xingao Li , Changxing Ding , Xiangmin Xu

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Bumsoo Kim , Junhyun Lee , Jaewoo Kang , Eun-Sol Kim , Hyunwoo J. Kim

A comprehensive understanding of human-object interaction (HOI) requires detecting not only a small portion of predefined HOI concepts (or categories) but also other reasonable HOI concepts, while current approaches usually fail to explore…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhi Hou , Baosheng Yu , Dacheng Tao

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects. Latest end-to-end HOI detectors are short of relation reasoning, which leads to inability to learn HOI-specific interactive semantics…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Dongming Yang , Yuexian Zou , Can Zhang , Meng Cao , Jie Chen

Human-object interaction detection (HOID) refers to localizing interactive human-object pairs in images and identifying the interactions. Since there could be an exponential number of object-action combinations, labeled data is limited -…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Sandipan Sarma , Agney Talwarr , Arijit Sur

While Human-Object Interaction(HOI) Detection has achieved tremendous advances in recent, it still remains challenging due to complex interactions with multiple humans and objects occurring in images, which would inevitably lead to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Kunlun Xu , Zhimin Li , Zhijun Zhang , Leizhen Dong , Wenhui Xu , Luxin Yan , Sheng Zhong , Xu Zou

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

Prevalent human-object interaction (HOI) detection approaches typically leverage large-scale visual-linguistic models to help recognize events involving humans and objects. Though promising, models trained via contrastive learning on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Liulei Li , Wenguan Wang , Yi Yang

Human-Object Interaction (HOI) Detection is an important problem to understand how humans interact with objects. In this paper, we explore Interactiveness Knowledge which indicates whether human and object interact with each other or not.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Yong-Lu Li , Siyuan Zhou , Xijie Huang , Liang Xu , Ze Ma , Hao-Shu Fang , Yan-Feng Wang , Cewu Lu

Human-Object Interaction (HOI) detection aims to simultaneously localize human-object pairs and recognize their interactions. While recent two-stage approaches have made significant progress, they still face challenges due to incomplete…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Zhehao Li , Yucheng Qian , Chong Wang , Yinghao Lu , Zhihao Yang , Jiafei Wu

The task of Human-Object Interaction (HOI) detection is to detect humans and their interactions with surrounding objects, where transformer-based methods show dominant advances currently. However, these methods ignore the relationship among…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shuman Fang , Zhiwen Lin , Ke Yan , Jie Li , Xianming Lin , Rongrong Ji