中文
相关论文

相关论文: Disentangled Pre-training for Human-Object Interac…

200 篇论文

Understanding interactions between humans and objects is one of the fundamental problems in visual classification and an essential step towards detailed scene understanding. Human-object interaction (HOI) detection strives to localize both…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Tiancai Wang , Tong Yang , Martin Danelljan , Fahad Shahbaz Khan , Xiangyu Zhang , Jian Sun

Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these methods frequently focus…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Jihao Dong , Renjie Pan , Hua Yang

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

We propose HOI Transformer to tackle human object interaction (HOI) detection in an end-to-end manner. Current approaches either decouple HOI task into separated stages of object detection and interaction classification or introduce…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Cheng Zou , Bohan Wang , Yue Hu , Junqi Liu , Qian Wu , Yu Zhao , Boxun Li , Chenguang Zhang , Chi Zhang , Yichen Wei , Jian Sun

A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can…

计算机视觉与模式识别 · 计算机科学 2021-11-24 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Two-stage methods have dominated Human-Object Interaction (HOI) detection for several years. Recently, one-stage HOI detection methods have become popular. In this paper, we aim to explore the essential pros and cons of two-stage and…

计算机视觉与模式识别 · 计算机科学 2021-10-14 Aixi Zhang , Yue Liao , Si Liu , Miao Lu , Yongliang Wang , Chen Gao , Xiaobo Li

Human Object Interaction (HOI) detection aims to localize and infer the relationships between a human and an object. Arguably, training supervised models for this task from scratch presents challenges due to the performance drop over rare…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Ting Lei , Fabian Caba , Qingchao Chen , Hailin Jin , Yuxin Peng , Yang Liu

Human-object interaction detection (HOID) refers to localizing interactive human-object pairs in images and identifying the interactions. Since there could be an exponential number of object-action combinations, labeled data is limited -…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Sandipan Sarma , Agney Talwarr , Arijit Sur

We study the problem of detecting human-object interactions (HOI) in static images, defined as predicting a human and an object bounding box with an interaction class label that connects them. HOI detection is a fundamental problem in…

计算机视觉与模式识别 · 计算机科学 2018-03-02 Yu-Wei Chao , Yunfan Liu , Xieyang Liu , Huayi Zeng , Jia Deng

Human-object interaction (HOI) detection aims to comprehend the intricate relationships between humans and objects, predicting $<human, action, object>$ triplets, and serving as the foundation for numerous computer vision tasks. The…

计算机视觉与模式识别 · 计算机科学 2023-11-08 Yichao Cao , Qingfei Tang , Xiu Su , Chen Song , Shan You , Xiaobo Lu , Chang Xu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

This paper investigates the problem of the current HOI detection methods and introduces DiffHOI, a novel HOI detection scheme grounded on a pre-trained text-image diffusion model, which enhances the detector's performance via improved data…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Jie Yang , Bingliang Li , Fengyu Yang , Ailing Zeng , Lei Zhang , Ruimao Zhang

Open Vocabulary Human-Object Interaction (HOI) detection aims to detect interactions between humans and objects while generalizing to novel interaction classes beyond the training set. Current methods often rely on Vision and Language…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Ting Lei , Shaofeng Yin , Qingchao Chen , Yuxin Peng , Yang Liu

Human-object interactions (HOI) recognition and pose estimation are two closely related tasks. Human pose is an essential cue for recognizing actions and localizing the interacted objects. Meanwhile, human action and their interacted…

计算机视觉与模式识别 · 计算机科学 2019-03-18 Wei Feng , Wentao Liu , Tong Li , Jing Peng , Chen Qian , Xiaolin Hu

The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications. Prior work has demonstrated the benefits of effective…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Hangjie Yuan , Jianwen Jiang , Samuel Albanie , Tao Feng , Ziyuan Huang , Dong Ni , Mingqian Tang

A comprehensive understanding of human-object interaction (HOI) requires detecting not only a small portion of predefined HOI concepts (or categories) but also other reasonable HOI concepts, while current approaches usually fail to explore…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Zhi Hou , Baosheng Yu , Dacheng Tao

Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the…

计算机视觉与模式识别 · 计算机科学 2021-03-25 Xubin Zhong , Changxing Ding , Xian Qu , Dacheng Tao

Prevalent human-object interaction (HOI) detection approaches typically leverage large-scale visual-linguistic models to help recognize events involving humans and objects. Though promising, models trained via contrastive learning on…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Liulei Li , Wenguan Wang , Yi Yang

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu