English
Related papers

Related papers: Towards Zero-shot Human-Object Interaction Detecti…

200 papers

Zero-shot human-object interaction (HOI) detector is capable of generalizing to HOI categories even not encountered during training. Inspired by the impressive zero-shot capabilities offered by CLIP, latest methods strive to leverage CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yixin Guo , Yu Liu , Jianghao Li , Weimin Wang , Qi Jia

Human-Object Interaction (HOI) detection is the task of identifying a set of <human, object, interaction> triplets from an image. Recent work proposed transformer encoder-decoder architectures that successfully eliminated the need for many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Bumsoo Kim , Jonghwan Mun , Kyoung-Woon On , Minchul Shin , Junhyun Lee , Eun-Sol Kim

Generating realistic 3D human-object interactions (HOIs) remains a challenging task due to the difficulty of modeling detailed interaction dynamics. Existing methods treat human and object motions independently, resulting in physically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Lin Wu , Zhixiang Chen , Jianglin Lan

The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications. Prior work has demonstrated the benefits of effective…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Hangjie Yuan , Jianwen Jiang , Samuel Albanie , Tao Feng , Ziyuan Huang , Dong Ni , Mingqian Tang

The key of Human-Object Interaction(HOI) recognition is to infer the relationship between human and objects. Recently, the image's Human-Object Interaction(HOI) detection has made significant progress. However, there is still room for…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Hongsheng Li , Guangming Zhu , Wu Zhen , Lan Ni , Peiyi Shen , Liang Zhang , Ning Wang , Cong Hua

3D human-object interaction (HOI) anticipation aims to predict the future motion of humans and their manipulated objects, conditioned on the historical context. Generally, the articulated humans and rigid objects exhibit different motion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiaotong Lin , Tianming Liang , Jian-Fang Hu , Kun-Yu Lin , Yulei Kang , Chunwei Tian , Jianhuang Lai , Wei-Shi Zheng

While diffusion models and large-scale motion datasets have advanced text-driven human motion synthesis, extending these advances to 4D human-object interaction (HOI) remains challenging, mainly due to the limited availability of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Shujia Li , Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Yutong Ban

We propose a new approach for Zero-Shot Human-Object Interaction Recognition in the challenging setting that involves interactions with unseen actions (as opposed to just unseen combinations of seen actions and objects). Our approach makes…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Alessio Sarullo , Tingting Mu

Human-Object Interaction (HOI) detection, which localizes and infers relationships between human and objects, plays an important role in scene understanding. Although two-stage HOI detectors have advantages of high efficiency in training…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jeeseung Park , Jin-Woo Park , Jong-Seok Lee

Synthesizing human--object interaction (HOI) videos has broad practical value in e-commerce, digital advertising, and virtual marketing. However, current diffusion models, despite their photorealistic rendering capability, still frequently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xiangyang Luo , Xiaozhe Xin , Tao Feng , Xu Guo , Meiguang Jin , Junfeng Ma

Human-Object Interaction detection is a holistic visual recognition task that entails object detection as well as interaction classification. Previous works of HOI detection has been addressed by the various compositions of subset…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jihwan Park , SeungJun Lee , Hwan Heo , Hyeong Kyu Choi , Hyunwoo J. Kim

Human-Object Interaction (HOI), as an important problem in computer vision, requires locating the human-object pair and identifying the interactive relationships between them. The HOI instance has a greater span in spatial, scale, and task…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Shuailei Ma , Yuefeng Wang , Shanze Wang , Ying Wei

Amodal completion, which is the process of inferring the full appearance of objects despite partial occlusions, is crucial for understanding complex human-object interactions (HOI) in computer vision and robotics. Existing methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Seunggeun Chi , Enna Sachdeva , Pin-Hao Huang , Kwonjoon Lee

Open-vocabulary human-object interaction (HOI) detection is a step towards building scalable systems that generalize to unseen interactions in real-world scenarios and support grounded multimodal systems that reason about human-object…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Maja Noack , Qinqian Lei , Taipeng Tian , Bihan Dong , Robby T. Tan , Yixin Chen , John Young , Saijun Zhang , Bo Wang

We propose ChainHOI, a novel approach for text-driven human-object interaction (HOI) generation that explicitly models interactions at both the joint and kinetic chain levels. Unlike existing methods that implicitly model interactions using…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ling-An Zeng , Guohong Huang , Yi-Lin Wei , Shengbo Gu , Yu-Ming Tang , Jingke Meng , Wei-Shi Zheng

Zero-shot scene understanding in real-world settings presents major challenges due to the complexity and variability of natural scenes, where models must recognize new objects, actions, and contexts without prior labeled examples. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Manjunath Prasad Holenarasipura Rajiv , B. M. Vidyavathi

We propose a simple, intuitive yet powerful method for human-object interaction (HOI) detection. HOIs are so diverse in spatial distribution in an image that existing CNN-based methods face the following three major drawbacks; they cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Masato Tamura , Hiroki Ohashi , Tomoaki Yoshinaga

Recovering 3D Human-Object Interaction (HOI) from single color images is challenging due to depth ambiguities, occlusions, and the huge variation in object shape and appearance. Thus, past work requires controlled settings such as known…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Alpár Cseke , Shashank Tripathi , Sai Kumar Dwivedi , Arjun Lakshmipathy , Agniv Chatterjee , Michael J. Black , Dimitrios Tzionas

Accurately modeling detailed interactions between human/hand and object is an appealing yet challenging task. Current multi-view capture systems are only capable of reconstructing multiple subjects into a single, unified mesh, which fails…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jiajun Zhang , Yuxiang Zhang , Hongwen Zhang , Xiao Zhou , Boyao Zhou , Ruizhi Shao , Zonghai Hu , Yebin Liu

Comprehensive visual understanding requires detection frameworks that can effectively learn and utilize object interactions while analyzing objects individually. This is the main objective in Human-Object Interaction (HOI) detection task.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Oytun Ulutan , A S M Iftekhar , B. S. Manjunath