English
Related papers

Related papers: Streamlined Open-Vocabulary Human-Object Interacti…

200 papers

Human-Object Interaction (HOI) detection aims to detect visual relations between human and objects in images. One significant problem of HOI detection is that non-interactive human-object pair can be easily mis-grouped and misclassified as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lu Liu , Robby T. Tan

Rapid progress has been witnessed for human-object interaction (HOI) recognition, but most existing models are confined to single-stage reasoning pipelines. Considering the intrinsic complexity of the task, we introduce a cascade…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Tianfei Zhou , Wenguan Wang , Siyuan Qi , Haibin Ling , Jianbing Shen

Human-Object interaction (HOI) detection aims to localize and infer relationships between human and objects in an image. It is challenging because an enormous number of possible combinations of objects and verbs types forms a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zhi Hou , Xiaojiang Peng , Yu Qiao , Dacheng Tao

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects. Latest end-to-end HOI detectors are short of relation reasoning, which leads to inability to learn HOI-specific interactive semantics…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Dongming Yang , Yuexian Zou , Can Zhang , Meng Cao , Jie Chen

Determining which image regions to concentrate on is critical for Human-Object Interaction (HOI) detection. Conventional HOI detectors focus on either detected human and object pairs or pre-defined interaction locations, which limits…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Mingfei Chen , Yue Liao , Si Liu , Zhiyuan Chen , Fei Wang , Chen Qian

Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Xubin Zhong , Changxing Ding , Xian Qu , Dacheng Tao

Human-object interaction (HOI) detection is an important part of understanding human activities and visual scenes. The long-tailed distribution of labeled instances is a primary challenge in HOI detection, promoting research in few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Zikun Zhuang , Ruihao Qian , Chi Xie , Shuang Liang

Human-Object Interaction (HOI) detection, inferring the relationships between human and objects from images/videos, is a fundamental task for high-level scene understanding. However, HOI detection usually suffers from the open long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics. However, acquiring 3D HOI data is challenging due to its complexity and high cost, limiting existing methods to the…

Graphics · Computer Science 2025-03-27 Yuke Lou , Yiming Wang , Zhen Wu , Rui Zhao , Wenjia Wang , Mingyi Shi , Taku Komura

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu

Reconstructing human-object interactions (HOI) from single images is fundamental in computer vision. Existing methods are primarily trained and tested on indoor scenes due to the lack of 3D data, particularly constrained by the object…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Boran Wen , Dingbang Huang , Zichen Zhang , Jiahong Zhou , Jianbin Deng , Jingyu Gong , Yulong Chen , Lizhuang Ma , Yong-Lu Li

Cameras are essential vision instruments to capture images for pattern detection and measurement. Human-object interaction (HOI) detection is one of the most popular pattern detection approaches for captured human-centric visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Manli Zhu , Edmond S. L. Ho , Shuang Chen , Longzhi Yang , Hubert P. H. Shum

Human-Object Interaction (HOI) Detection is an important problem to understand how humans interact with objects. In this paper, we explore Interactiveness Knowledge which indicates whether human and object interact with each other or not.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Yong-Lu Li , Siyuan Zhou , Xijie Huang , Liang Xu , Ze Ma , Hao-Shu Fang , Yan-Feng Wang , Cewu Lu

Detecting Human-Object Interactions (HOI) in zero-shot settings, where models must handle unseen classes, poses significant challenges. Existing methods that rely on aligning visual encoders with large Vision-Language Models (VLMs) to tap…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Qinqian Lei , Bo Wang , Robby T. Tan

The task of Human-Object Interaction (HOI) detection is to detect humans and their interactions with surrounding objects, where transformer-based methods show dominant advances currently. However, these methods ignore the relationship among…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shuman Fang , Zhiwen Lin , Ke Yan , Jie Li , Xianming Lin , Rongrong Ji

Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Hao-Shu Fang , Yichen Xie , Dian Shao , Cewu Lu

We have witnessed significant progress in human-object interaction (HOI) detection. The reliance on mAP (mean Average Precision) scores as a summary metric, however, does not provide sufficient insight into the nuances of model performance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Fangrui Zhu , Yiming Xie , Weidi Xie , Huaizu Jiang

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Bumsoo Kim , Junhyun Lee , Jaewoo Kang , Eun-Sol Kim , Hyunwoo J. Kim

The task of Human-Object Interaction~(HOI) detection could be divided into two core problems, i.e., human-object association and interaction understanding. In this paper, we reveal and address the disadvantages of the conventional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yue Liao , Aixi Zhang , Miao Lu , Yongliang Wang , Xiaobo Li , Si Liu

In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Panqi Yang , Haodong Jing , Nanning Zheng , Yongqiang Ma