English
Related papers

Related papers: DreamHOI: Subject-Driven Generation of 3D Human-Ob…

200 papers

Human-Object Interaction (HOI) detection aims to detect visual relations between human and objects in images. One significant problem of HOI detection is that non-interactive human-object pair can be easily mis-grouped and misclassified as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lu Liu , Robby T. Tan

Human-Object Interaction (HOI) detection aims to understand the interactions between humans and objects, which plays a curtail role in high-level semantic understanding tasks. However, most works pursue designing better architectures to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Shuman Fang , Shuai Liu , Jie Li , Guannan Jiang , Xianming Lin , Rongrong Ji

While large-scale human motion capture datasets have advanced human motion generation, modeling and generating dynamic 3D human-object interactions (HOIs) remain challenging due to dataset limitations. Existing datasets often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Sirui Xu , Dongting Li , Yucheng Zhang , Xiyan Xu , Qi Long , Ziyin Wang , Yunzhi Lu , Shuchang Dong , Hezi Jiang , Akshat Gupta , Yu-Xiong Wang , Liang-Yan Gui

Amodal completion, which is the process of inferring the full appearance of objects despite partial occlusions, is crucial for understanding complex human-object interactions (HOI) in computer vision and robotics. Existing methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Seunggeun Chi , Enna Sachdeva , Pin-Hao Huang , Kwonjoon Lee

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Yizhuo Li , Cewu Lu

We present the HOH (Human-Object-Human) Handover Dataset, a large object count dataset with 136 objects, to accelerate data-driven research on handover studies, human-robot handover implementation, and artificial intelligence (AI) on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Noah Wiederhold , Ava Megyeri , DiMaggio Paris , Sean Banerjee , Natasha Kholgade Banerjee

Digital human motion synthesis is a vibrant research field with applications in movies, AR/VR, and video games. Whereas methods were proposed to generate natural and realistic human motions, most only focus on modeling humans and largely…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Quanzhou Li , Jingbo Wang , Chen Change Loy , Bo Dai

Human-object interaction (HOI) detection aims to comprehend the intricate relationships between humans and objects, predicting $<human, action, object>$ triplets, and serving as the foundation for numerous computer vision tasks. The…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Yichao Cao , Qingfei Tang , Xiu Su , Chen Song , Shan You , Xiaobo Lu , Chang Xu

We are living in a world surrounded by diverse and "smart" devices with rich modalities of sensing ability. Conveniently capturing the interactions between us humans and these objects remains far-reaching. In this paper, we present I'm-HOI,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chengfeng Zhao , Juze Zhang , Jiashen Du , Ziwei Shan , Junye Wang , Jingyi Yu , Jingya Wang , Lan Xu

Can we synthesize 3D humans interacting with scenes without learning from any 3D human-scene interaction data? We propose GenZI, the first zero-shot approach to generating 3D human-scene interactions. Key to GenZI is our distillation of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Lei Li , Angela Dai

We address the problem of generating realistic 3D motions of humans interacting with objects in a scene. Our key idea is to create a neural interaction field attached to a specific object, which outputs the distance to the valid interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Nilesh Kulkarni , Davis Rempe , Kyle Genova , Abhijit Kundu , Justin Johnson , David Fouhey , Leonidas Guibas

Reconstructing human-object interaction in 3D from a single RGB image is a challenging task and existing data driven methods do not generalize beyond the objects present in the carefully curated 3D interaction datasets. Capturing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Xianghui Xie , Bharat Lal Bhatnagar , Jan Eric Lenssen , Gerard Pons-Moll

Human-object interaction (HOI) video generation has garnered increasing attention due to its promising applications in digital humans, e-commerce, advertising, and robotics imitation learning. However, existing methods face two critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Bangya Liu , Xinyu Gong , Zelin Zhao , Ziyang Song , Yulei Lu , Suhui Wu , Jun Zhang , Suman Banerjee , Hao Zhang

In this paper, we present a diffusion model-based framework for animating people from a single image for a given target 3D motion sequence. Our approach has two core components: a) learning priors about invisible parts of the human body and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Boyi Li , Junming Chen , Jathushan Rajasegaran , Yossi Gandelsman , Alexei A. Efros , Jitendra Malik

Detecting human-object interactions (HOI) is an important step toward a comprehensive visual understanding of machines. While detecting non-temporal HOIs (e.g., sitting on a chair) from static images is feasible, it is unlikely even for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Meng-Jiun Chiou , Chun-Yu Liao , Li-Wei Wang , Roger Zimmermann , Jiashi Feng

Achieving realistic simulations of humans interacting with a wide range of objects has long been a fundamental goal. Extending physics-based motion imitation to complex human-object interactions (HOIs) is challenging due to intricate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Sirui Xu , Hung Yu Ling , Yu-Xiong Wang , Liang-Yan Gui

In this paper, we tackle the problem of Egocentric Human-Object Interaction (EHOI) detection in an industrial setting. To overcome the lack of public datasets in this context, we propose a pipeline and a tool for generating synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Rosario Leonardi , Francesco Ragusa , Antonino Furnari , Giovanni Maria Farinella

Scene graph generation (SGG) and human-object interaction (HOI) detection are two important visual tasks aiming at localising and recognising relationships between objects, and interactions between humans and objects, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided…

Robotics · Computer Science 2026-03-03 Yuhang Lin , Jiyuan Shi , Dewei Wang , Jipeng Kong , Yong Liu , Chenjia Bai , Xuelong Li