English
Related papers

Related papers: QAHOI: Query-Based Anchors for Human-Object Intera…

200 papers

Recent high-performing Human-Object Interaction (HOI) detection techniques have been highly influenced by Transformer-based object detector (i.e., DETR). Nevertheless, most of them directly map parametric interaction queries into a set of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Yong Zhang , Yingwei Pan , Ting Yao , Rui Huang , Tao Mei , Chang-Wen Chen

In this paper, we propose a new instance-level human-object interaction detection task on videos called ST-HOID, which aims to distinguish fine-grained human-object interactions (HOIs) and the trajectories of subjects and objects. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xu Sun , Yunqing He , Tongwei Ren , Gangshan Wu

Human-Object Interaction (HOI) detection focuses on localizing human-object pairs and recognizing their interactions. Recently, the DETR-based framework has been widely adopted in HOI detection. In DETR-based HOI models, queries with clear…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zhehao Li , Chong Wang , Yi Chen , Yinghao Lu , Jiangbo Qian , Jiong Wang , Jiafei Wu

Human-Object Interaction (HOI) detection is an important problem to understand how humans interact with objects. In this paper, we explore interactiveness knowledge which indicates whether a human and an object interact with each other or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Xijie Huang , Liang Xu , Cewu Lu

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) detection is crucial for robot-human assistance, enabling context-aware support. However, models trained on clean datasets degrade in real-world conditions due to unforeseen corruptions, leading to inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Di Wen , Kunyu Peng , Kailun Yang , Yufan Chen , Ruiping Liu , Junwei Zheng , Alina Roitberg , Danda Pani Paudel , Luc Van Gool , Rainer Stiefelhagen

Human-object interaction (HOI) detection is a core task in computer vision. The goal is to localize all human-object pairs and recognize their interactions. An interaction defined by a <verb, noun> tuple leads to a long-tailed visual…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Mert Kilickaya , Arnold Smeulders

The interaction decoder utilized in prevalent Transformer-based HOI detectors typically accepts pre-composed human-object pairs as inputs. Though achieving remarkable performance, such paradigm lacks feasibility and cannot explore novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Liulei Li , Jianan Wei , Wenguan Wang , Yi Yang

Detecting human-object interactions is essential for comprehensive understanding of visual scenes. In particular, spatial connections between humans and objects are important cues for reasoning interactions. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Manli Zhu , Edmond S. L. Ho , Hubert P. H. Shum

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu

Human object interaction (HOI) detection plays a crucial role in human-centric scene understanding and serves as a fundamental building-block for many vision tasks. One generalizable and scalable strategy for HOI detection is to use weak…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Bo Wan , Yongfei Liu , Desen Zhou , Tinne Tuytelaars , Xuming He

Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Yichen Xie , Hao-Shu Fang , Dian Shao , Yong-Lu Li , Cewu Lu

Video-based human-object interaction (HOI) understanding requires both detecting ongoing interactions and anticipating their future evolution. However, existing methods usually treat anticipation as a downstream forecasting task built on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuanhao Luo , Di Wen , Kunyu Peng , Ruiping Liu , Junwei Zheng , Yufan Chen , Jiale Wei , Rainer Stiefelhage

Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction; however, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Xubin Zhong , Changxing Ding , Yupeng Hu , Dacheng Tao

Recent advances in deep neural networks have achieved significant progress in detecting individual objects from an image. However, object detection is not sufficient to fully understand a visual scene. Towards a deeper visual understanding,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Bumsoo Kim , Taeho Choi , Jaewoo Kang , Hyunwoo J. Kim

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Chaoyi Ai

Open-vocabulary human-object interaction (HOI) detection requires recognizing interaction phrases that may not appear as annotated categories during training. Recent vision-language HOI detectors improve semantic transfer by matching…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Minh Anh Nguyen , Quang Huy Tran , Bao Ngoc Le , SuiYang Guang , Tuan Kiet Pham , Linh Chi Vo

Recent years have witnessed rapid progress in detecting and recognizing individual object instances. To understand the situation in a scene, however, computers need to recognize how humans interact with surrounding objects. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-31 Chen Gao , Yuliang Zou , Jia-Bin Huang