English
Related papers

Related papers: Detecting Human-Object Interaction via Fabricated …

200 papers

Human-Object Interaction Detection tackles the problem of joint localization and classification of human object interactions. Existing HOI transformers either adopt a single decoder for triplet prediction, or utilize two parallel decoders…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Desen Zhou , Zhichao Liu , Jian Wang , Leshan Wang , Tao Hu , Errui Ding , Jingdong Wang

Human-Object Interaction (HOI) detection is an important problem to understand how humans interact with objects. In this paper, we explore interactiveness knowledge which indicates whether a human and an object interact with each other or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Xijie Huang , Liang Xu , Cewu Lu

While existing image-guided composition methods may help insert a foreground object onto a user-specified region of a background image, achieving natural blending inside the region with the rest of the image unchanged, we observe that these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Dong Liang , Jinyuan Jia , Yuhao Liu , Rynson W. H. Lau

In this paper, we investigate the task of zero-shot human-object interaction (HOI) detection, a novel paradigm for identifying HOIs without the need for task-specific annotations. To address this challenging task, we employ CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Bo Wan , Tinne Tuytelaars

Human-Object Interaction (HOI) Detection is an important problem to understand how humans interact with objects. In this paper, we explore Interactiveness Knowledge which indicates whether human and object interact with each other or not.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Yong-Lu Li , Siyuan Zhou , Xijie Huang , Liang Xu , Ze Ma , Hao-Shu Fang , Yan-Feng Wang , Cewu Lu

Human-Object Interaction Detection (HOI-DET) aims to localize human-object pairs and identify their interactive relationships. To aggregate contextual cues, existing methods typically propagate information across all detected entities via…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jiajun Hong , Jianan Wei , Wenguan Wang

We consider the problem of Human-Object Interaction (HOI) Detection, which aims to locate and recognize HOI instances in the form of <human, action, object> in images. Most existing works treat HOIs as individual interaction categories,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ye Liu , Junsong Yuan , Chang Wen Chen

Human-object interaction (HOI) detection for capturing relationships between humans and objects is an important task in the semantic understanding of images. When processing human and object keypoints extracted from an image using a graph…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yoshiki Ito

We study in this paper the problem of novel human-object interaction (HOI) detection, aiming at improving the generalization ability of the model to unseen scenarios. The challenge mainly stems from the large compositional space of objects…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Yuhang Song , Wenbo Li , Lei Zhang , Jianwei Yang , Emre Kiciman , Hamid Palangi , Jianfeng Gao , C. -C. Jay Kuo , Pengchuan Zhang

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects via inferring triplets of < human, verb, object >. However, recent HOI detection methods mostly rely on additional annotations (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Dongming Yang , Yuexian Zou

Human-Object Interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, conventional HOI detection methods often struggle to fully capture the contextual information needed to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu-Wei Zhan , Fan Liu , Xin Luo , Xin-Shun Xu , Liqiang Nie , Mohan Kankanhalli

Human-Object Interaction (HOI) detection has received considerable attention in the context of scene understanding. Despite the growing progress on benchmarks, we realize that existing methods often perform unsatisfactorily on distant…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Guangzhi Wang , Yangyang Guo , Yongkang Wong , Mohan Kankanhalli

Human-object interactions (HOI) detection aims at capturing human-object pairs in images and corresponding actions. It is an important step toward high-level visual reasoning and scene understanding. However, due to the natural bias from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Lijun Zhang , Wei Suo , Peng Wang , Yanning Zhang

The task of Human-Object Interaction~(HOI) detection could be divided into two core problems, i.e., human-object association and interaction understanding. In this paper, we reveal and address the disadvantages of the conventional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yue Liao , Aixi Zhang , Miao Lu , Yongliang Wang , Xiaobo Li , Si Liu

In this paper, we propose a new instance-level human-object interaction detection task on videos called ST-HOID, which aims to distinguish fine-grained human-object interactions (HOIs) and the trajectories of subjects and objects. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xu Sun , Yunqing He , Tongwei Ren , Gangshan Wu

Open-vocabulary human-object interaction (HOI) detection requires recognizing interaction phrases that may not appear as annotated categories during training. Recent vision-language HOI detectors improve semantic transfer by matching…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Minh Anh Nguyen , Quang Huy Tran , Bao Ngoc Le , SuiYang Guang , Tuan Kiet Pham , Linh Chi Vo

Spatio-temporal Human-Object Interaction (ST-HOI) detection aims at detecting HOIs from videos, which is crucial for activity understanding. In daily HOIs, humans often interact with a variety of objects, e.g., holding and touching dozens…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Yong-Lu Li , Hongwei Fan , Zuoyu Qiu , Yiming Dou , Liang Xu , Hao-Shu Fang , Peiyang Guo , Haisheng Su , Dongliang Wang , Wei Wu , Cewu Lu

Human-Object Interaction (HOI) detection is a fundamental visual task aiming at localizing and recognizing interactions between humans and objects. Existing works focus on the visual and linguistic features of humans and objects. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

The interaction decoder utilized in prevalent Transformer-based HOI detectors typically accepts pre-composed human-object pairs as inputs. Though achieving remarkable performance, such paradigm lacks feasibility and cannot explore novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Liulei Li , Jianan Wei , Wenguan Wang , Yi Yang

Recent advances in 3D human-aware generation have made significant progress. However, existing methods still struggle with generating novel Human Object Interaction (HOI) from text, particularly for open-set objects. We identify three main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jinlu Zhang , Yixin Chen , Zan Wang , Jie Yang , Yizhou Wang , Siyuan Huang