English
Related papers

Related papers: Learning Human-Object Interaction as Groups

200 papers

Human-Object Interaction (HOI) detection, inferring the relationships between human and objects from images/videos, is a fundamental task for high-level scene understanding. However, HOI detection usually suffers from the open long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Generating realistic 3D human-object interactions (HOIs) from text descriptions is a active research topic with potential applications in virtual and augmented reality, robotics, and animation. However, creating high-quality 3D HOIs remains…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yixuan Zhang , Hui Yang , Chuanchen Luo , Junran Peng , Yuxi Wang , Zhaoxiang Zhang

Humans interact with objects all the time. Enabling a humanoid to learn human-object interaction (HOI) is a key step for future smart animation and intelligent robotics systems. However, recent progress in physics-based HOI requires…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yinhuai Wang , Jing Lin , Ailing Zeng , Zhengyi Luo , Jian Zhang , Lei Zhang

This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most existing research on HOI synthesis lacks comprehensive whole-body interactions with dynamic objects, e.g., often limited to manipulating small or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Sirui Xu , Zhengyuan Li , Yu-Xiong Wang , Liang-Yan Gui

Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Hao-Shu Fang , Yichen Xie , Dian Shao , Cewu Lu

Detecting Human-Object Interaction (HOI) in images is an important step towards high-level visual comprehension. Existing work often shed light on improving either human and object detection, or interaction recognition. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Guangzhi Wang , Yangyang Guo , Yongkang Wong , Mohan Kankanhalli

This work addresses a new challenge of understanding human nonverbal interaction in social contexts. Nonverbal signals pervade virtually every communicative act. Our gestures, facial expressions, postures, gaze, even physical appearance all…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jianan Wei , Tianfei Zhou , Yi Yang , Wenguan Wang

Since detecting and recognizing individual human or object are not adequate to understand the visual world, learning how humans interact with surrounding objects becomes a core technology. However, convolution operations are weak in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Dongming Yang , YueXian Zou , Jian Zhang , Ge Li

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Joint reconstruction of human-object interaction marks a significant milestone in comprehending the intricate interrelations between humans and their surrounding environment. Nevertheless, previous optimization methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Ao Li , Jinpeng Liu , Yixuan Zhu , Yansong Tang

Modeling 3D human-object interaction (HOI) is a problem of great interest for computer vision and a key enabler for virtual and mixed-reality applications. Existing methods work in a one-way direction: some recover plausible human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ilya A. Petrov , Riccardo Marin , Julian Chibane , Gerard Pons-Moll

The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications. Prior work has demonstrated the benefits of effective…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Hangjie Yuan , Jianwen Jiang , Samuel Albanie , Tao Feng , Ziyuan Huang , Dong Ni , Mingqian Tang

In this paper, we tackle the problem of Egocentric Human-Object Interaction (EHOI) detection in an industrial setting. To overcome the lack of public datasets in this context, we propose a pipeline and a tool for generating synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Rosario Leonardi , Francesco Ragusa , Antonino Furnari , Giovanni Maria Farinella

Egocentric human-object interaction (Ego-HOI) detection is crucial for intelligent agents to understand and assist human activities from a first-person perspective. However, progress has been hindered by the lack of benchmarks and methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kunyuan Deng , Yi Wang , Lap-Pui Chau

The task of Human-Object conTact (HOT) detection involves identifying the specific areas of the human body that are touching objects. Nevertheless, current models are restricted to just one type of image, often leading to too much…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yuxiao Wang , Yu Lei , Zhenao Wei , Weiying Xue , Xinyu Jiang , Nan Zhuang , Qi Liu

Resolving real-world human-object interactions in images is a many-to-many challenge, in which disentangling fine-grained concurrent physical contact is particularly difficult. Existing semantic contact estimation methods are either limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Sravan Chittupalli , Ayush Jain , Dong Huang

Generating realistic and physically plausible 3D Human-Object Interactions (HOI) remains a key challenge in motion generation. One primary reason is that describing these physical constraints with words alone is difficult. To address this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Songjin Cai , Linjie Zhong , Ling Guo , Changxing Ding

Large-scale text-to-image (T2I) diffusion models have showcased incredible capabilities in generating coherent images based on textual descriptions, enabling vast applications in content generation. While recent advancements have introduced…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jiun Tian Hoe , Xudong Jiang , Chee Seng Chan , Yap-Peng Tan , Weipeng Hu

Hand-Object Interaction (HOI) remains a core challenge in digital human video synthesis, where models must generate physically plausible contact and preserve object identity across frames. Although recent HOI reenactment approaches have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xuan Huang , Mochu Xiang , Zhelun Shen , Jinbo Wu , Chenming Wu , Chen Zhao , Kaisiyuan Wang , Hang Zhou , Shanshan Liu , Haocheng Feng , Wei He , Jingdong Wang