中文
相关论文

相关论文: Compositional Learning in Transformer-Based Human-…

200 篇论文

Two-stage methods have dominated Human-Object Interaction (HOI) detection for several years. Recently, one-stage HOI detection methods have become popular. In this paper, we aim to explore the essential pros and cons of two-stage and…

计算机视觉与模式识别 · 计算机科学 2021-10-14 Aixi Zhang , Yue Liao , Si Liu , Miao Lu , Yongliang Wang , Chen Gao , Xiaobo Li

In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Panqi Yang , Haodong Jing , Nanning Zheng , Yongqiang Ma

Human-Object Interactions (HOI) detection, which aims to localize a human and a relevant object while recognizing their interaction, is crucial for understanding a still image. Recently, transformer-based models have significantly advanced…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Leizhen Dong , Zhimin Li , Kunlun Xu , Zhijun Zhang , Luxin Yan , Sheng Zhong , Xu Zou

Human-Object Interaction (HOI) detection is a longstanding computer vision problem concerned with predicting the interaction between humans and objects. Current HOI models rely on a vocabulary of interactions at training and inference time,…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Francesco Tonini , Alessandro Conti , Lorenzo Vaquero , Cigdem Beyan , Elisa Ricci

In this work, we introduce Segmentation to Human-Object Interaction (\textit{\textbf{Seg2HOI}}) approach, a novel framework that integrates segmentation-based vision foundation models with the human-object interaction task, distinguished…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Juhan Park , Kyungjae Lee , Hyung Jin Chang , Jungchan Cho

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions in images. Although DETR-based methods have recently emerged as the mainstream framework for HOI detection, they still suffer from…

计算机视觉与模式识别 · 计算机科学 2025-08-13 Yuxiao Wang , Wolin Liang , Yu Lei , Weiying Xue , Nan Zhuang , Qi Liu

Enabling humanoid robots to clean rooms has long been a pursued dream within humanoid research communities. However, many tasks require multi-humanoid collaboration, such as carrying large and heavy furniture together. Given the scarcity of…

机器人学 · 计算机科学 2024-10-31 Jiawei Gao , Ziqin Wang , Zeqi Xiao , Jingbo Wang , Tai Wang , Jinkun Cao , Xiaolin Hu , Si Liu , Jifeng Dai , Jiangmiao Pang

We study the problem of detecting human-object interactions (HOI) in static images, defined as predicting a human and an object bounding box with an interaction class label that connects them. HOI detection is a fundamental problem in…

计算机视觉与模式识别 · 计算机科学 2018-03-02 Yu-Wei Chao , Yunfan Liu , Xieyang Liu , Huayi Zeng , Jia Deng

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data,…

计算机视觉与模式识别 · 计算机科学 2020-09-03 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Human Object Interaction (HOI) detection is a challenging task that requires to distinguish the interaction between a human-object pair. Attention based relation parsing is a popular and effective strategy utilized in HOI. However, current…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Jingjia Huang , Baixiang Yang

Zero-shot Human-object interaction (HOI) detection aims to locate humans and objects in images and recognize their interactions. While advances in open-vocabulary object detection provide promising solutions for object localization,…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Shiyu Xuan , Dongkai Wang , Zechao Li , Jinhui Tang

Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction; however, the…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Xubin Zhong , Changxing Ding , Yupeng Hu , Dacheng Tao

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Recently, Contrastive Language-Image Pre-training (CLIP) has shown great potential in providing interaction prior for HOI…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Shan Ning , Longtian Qiu , Yongfei Liu , Xuming He

Detecting human-object interactions (HOIs) is an intricate challenge in the field of computer vision. Existing methods for HOI detection heavily rely on appearance-based features, but these may not fully capture all the essential…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Lijing Zhu , Qizhen Lan , Alvaro Velasquez , Houbing Song , Acharya Kamal , Qing Tian , Shuteng Niu

Recent years have witnessed rapid progress in detecting and recognizing individual object instances. To understand the situation in a scene, however, computers need to recognize how humans interact with surrounding objects. In this paper,…

计算机视觉与模式识别 · 计算机科学 2018-08-31 Chen Gao , Yuliang Zou , Jia-Bin Huang

Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which aims to predict the HOI triplet in the form of <human, object, action>. Existing methods mainly extract multi-modal features (e.g., appearance, object…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Weibo Jiang , Weihong Ren , Jiandong Tian , Liangqiong Qu , Zhiyong Wang , Honghai Liu

Human-object interaction (HOI) detectors with popular query-transformer architecture have achieved promising performance. However, accurately identifying uncommon visual patterns and distinguishing between ambiguous HOIs continue to be…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Mingda Jia , Liming Zhao , Ge Li , Yun Zheng

Language-enabled robots have been widely studied over the past years to enable natural human-robot interaction and teaming in various real-world applications. Language-enabled robots must be able to comprehend referring expressions to…

机器人学 · 计算机科学 2023-12-22 Peng Gao , Ahmed Jaafar , Brian Reily , Christopher Reardon , Hao Zhang

Rapid progress has been witnessed for human-object interaction (HOI) recognition, but most existing models are confined to single-stage reasoning pipelines. Considering the intrinsic complexity of the task, we introduce a cascade…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Tianfei Zhou , Wenguan Wang , Siyuan Qi , Haibin Ling , Jianbing Shen

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects via inferring triplets of < human, verb, object >. However, recent HOI detection methods mostly rely on additional annotations (e.g.,…

计算机视觉与模式识别 · 计算机科学 2020-07-15 Dongming Yang , Yuexian Zou