English
Related papers

Related papers: Compositional Learning in Transformer-Based Human-…

200 papers

Reasoning the human-object interactions (HOI) is essential for deeper scene understanding, while object affordances (or functionalities) are of great importance for human to discover unseen HOIs with novel objects. Inspired by this, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Detecting human-object interaction (HOI) has long been limited by the amount of supervised data available. Recent approaches address this issue by pre-training according to pseudo-labels, which align object regions with HOI triplets parsed…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zhuolong Li , Xingao Li , Changxing Ding , Xiangmin Xu

Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics. However, acquiring 3D HOI data is challenging due to its complexity and high cost, limiting existing methods to the…

Graphics · Computer Science 2025-03-27 Yuke Lou , Yiming Wang , Zhen Wu , Rui Zhao , Wenjia Wang , Mingyi Shi , Taku Komura

The human-object interaction (HOI) detection task refers to localizing humans, localizing objects, and predicting the interactions between each human-object pair. HOI is considered one of the fundamental steps in truly understanding complex…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 A S M Iftekhar , Satish Kumar , R. Austin McEver , Suya You , B. S. Manjunath

Human-Object Interaction (HOI) detection aims to detect visual relations between human and objects in images. One significant problem of HOI detection is that non-interactive human-object pair can be easily mis-grouped and misclassified as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lu Liu , Robby T. Tan

The goal of this paper is Human-object Interaction (HO-I) detection. HO-I detection aims to find interacting human-objects regions and classify their interaction from an image. Researchers obtain significant improvement in recent years by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Mert Kilickaya , Arnold Smeulders

We study in this paper the problem of novel human-object interaction (HOI) detection, aiming at improving the generalization ability of the model to unseen scenarios. The challenge mainly stems from the large compositional space of objects…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Yuhang Song , Wenbo Li , Lei Zhang , Jianwei Yang , Emre Kiciman , Hamid Palangi , Jianfeng Gao , C. -C. Jay Kuo , Pengchuan Zhang

Human Object Interaction (HOI) detection aims to localize and infer the relationships between a human and an object. Arguably, training supervised models for this task from scratch presents challenges due to the performance drop over rare…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Ting Lei , Fabian Caba , Qingchao Chen , Hailin Jin , Yuxin Peng , Yang Liu

Recognition and generation are two fundamental tasks in computer vision, which are often investigated separately in the exiting literature. However, these two tasks are highly correlated in essence as they both require understanding the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yisen Wang , Yao Teng , Limin Wang

Human-object interactions (HOI) recognition and pose estimation are two closely related tasks. Human pose is an essential cue for recognizing actions and localizing the interacted objects. Meanwhile, human action and their interacted…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Wei Feng , Wentao Liu , Tong Li , Jing Peng , Chen Qian , Xiaolin Hu

Scene graph generation (SGG) and human-object interaction (HOI) detection are two important visual tasks aiming at localising and recognising relationships between objects, and interactions between humans and objects, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

This paper presents a new vision Transformer, named Iwin Transformer, which is specifically designed for human-object interaction (HOI) detection, a detailed scene understanding task involving a sequential process of human/object detection…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Danyang Tu , Xiongkuo Min , Huiyu Duan , Guodong Guo , Guangtao Zhai , Wei Shen

Human-object interaction (HOI) detection is a core task in computer vision. The goal is to localize all human-object pairs and recognize their interactions. An interaction defined by a <verb, noun> tuple leads to a long-tailed visual…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Mert Kilickaya , Arnold Smeulders

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets. Despite the challenges posed by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yichao Cao , Qingfei Tang , Feng Yang , Xiu Su , Shan You , Xiaobo Lu , Chang Xu

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

Human-Object Interaction Detection (HOI-DET) aims to localize human-object pairs and identify their interactive relationships. To aggregate contextual cues, existing methods typically propagate information across all detected entities via…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jiajun Hong , Jianan Wei , Wenguan Wang

A common problem in human-object interaction (HOI) detection task is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can lead to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu

The way humans interact with each other, including interpersonal distances, spatial configuration, and motion, varies significantly across different situations. To enable machines to understand such complex, context-dependent behaviors, it…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Jeonghyeon Na , Sangwon Baik , Inhee Lee , Junyoung Lee , Hanbyul Joo

In open-world environments, human-object interactions (HOIs) evolve continuously, challenging conventional closed-world HOI detection models. Inspired by humans' ability to progressively acquire knowledge, we explore incremental HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yana Wei , Zeen Chi , Chongyu Wang , Yu Wu , Shipeng Yan , Yongfei Liu , Xuming He