English
Related papers

Related papers: Compositional 3D Human-Object Neural Animation

200 papers

Zero-shot Human-Object Interaction (HOI) detection has emerged as a frontier topic due to its capability to detect HOIs beyond a predefined set of categories. This task entails not only identifying the interactiveness of human-object pairs…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ting Lei , Shaofeng Yin , Yuxin Peng , Yang Liu

Human-Object Interaction (HOI) detection is a fundamental visual task aiming at localizing and recognizing interactions between humans and objects. Existing works focus on the visual and linguistic features of humans and objects. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Human-Object Interaction (HOI) detection plays a crucial role in activity understanding. Though significant progress has been made, interactiveness learning remains a challenging problem in HOI detection: existing methods usually generate…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Xiaoqian Wu , Yong-Lu Li , Xinpeng Liu , Junyi Zhang , Yuzhe Wu , Cewu Lu

Human-object interaction(HOI) detection is an important task for understanding human activity. Graph structure is appropriate to denote the HOIs in the scene. Since there is an subordination between human and object---human play subjective…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Hai Wang , Wei-Shi Zheng , Ling Yingbiao

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Recently, Contrastive Language-Image Pre-training (CLIP) has shown great potential in providing interaction prior for HOI…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Shan Ning , Longtian Qiu , Yongfei Liu , Xuming He

We consider the problem of Human-Object Interaction (HOI) Detection, which aims to locate and recognize HOI instances in the form of <human, action, object> in images. Most existing works treat HOIs as individual interaction categories,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ye Liu , Junsong Yuan , Chang Wen Chen

Deep generative models have been recently extended to synthesizing 3D digital humans. However, previous approaches treat clothed humans as a single chunk of geometry without considering the compositionality of clothing and accessories. As a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Taeksoo Kim , Shunsuke Saito , Hanbyul Joo

Generating realistic 3D hand-object interactions (HOI) is a fundamental challenge in computer vision and robotics, requiring both temporal coherence and high-fidelity physical plausibility. Existing methods remain limited in their ability…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Jiankang Deng , Cordelia Schmid , Stefanos Zafeiriou

Analyzing the interactions between humans and objects from a video includes identification of the relationships between humans and the objects present in the video. It can be thought of as a specialized version of Visual Relationship…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Sai Praneeth Reddy Sunkesula , Rishabh Dabral , Ganesh Ramakrishnan

In human-object interactions (HOI) recognition, conventional methods consider the human body as a whole and pay a uniform attention to the entire body region. They ignore the fact that normally, human interacts with an object by using some…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Hao-Shu Fang , Jinkun Cao , Yu-Wing Tai , Cewu Lu

4D modeling of human-object interactions is critical for numerous applications. However, efficient volumetric capture and rendering of complex interaction scenarios, especially from sparse inputs, remain challenging. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yuheng Jiang , Suyi Jiang , Guoxing Sun , Zhuo Su , Kaiwen Guo , Minye Wu , Jingyi Yu , Lan Xu

Humans are in constant contact with the world as they move through it and interact with it. This contact is a vital source of information for understanding 3D humans, 3D scenes, and the interactions between them. In fact, we demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Hongwei Yi , Chun-Hao P. Huang , Dimitrios Tzionas , Muhammed Kocabas , Mohamed Hassan , Siyu Tang , Justus Thies , Michael J. Black

Embedding Human and Articulated Object Interaction (HAOI) in 3D is an important direction for a deeper human activity understanding. Different from previous works that use parametric and CAD models to represent humans and objects, in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Siqi Liu , Yong-Lu Li , Zhou Fang , Xinpeng Liu , Yang You , Cewu Lu

Human-Object Interaction Detection (HOI-DET) aims to localize human-object pairs and identify their interactive relationships. To aggregate contextual cues, existing methods typically propagate information across all detected entities via…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jiajun Hong , Jianan Wei , Wenguan Wang

Human-Object Interaction (HOI) detection plays a core role in activity understanding. Though recent two/one-stage methods have achieved impressive results, as an essential step, discovering interactive human-object pairs remains…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Xinpeng Liu , Yong-Lu Li , Xiaoqian Wu , Yu-Wing Tai , Cewu Lu , Chi-Keung Tang

Complex scenes present significant challenges for predicting human behaviour due to the abundance of interaction information, such as human-human and humanenvironment interactions. These factors complicate the analysis and understanding of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Caiyi Sun , Yujing Sun , Xiao Han , Zemin Yang , Jiawei Liu , Xinge Zhu , Siu Ming Yiu , Yuexin Ma

We study the problem of precisely swapping objects in videos, with a focus on those interacted with by hands, given one user-provided reference object image. Despite the great advancements that diffusion models have made in video editing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Zihui Xue , Mi Luo , Changan Chen , Kristen Grauman

This paper introduces Motion-oriented Compositional Neural Radiance Fields (MoCo-NeRF), a framework designed to perform free-viewpoint rendering of monocular human videos via novel non-rigid motion modeling approach. In the context of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jaehyeok Kim , Dongyoon Wee , Dan Xu

Generating realistic and physically plausible 3D Human-Object Interactions (HOI) remains a key challenge in motion generation. One primary reason is that describing these physical constraints with words alone is difficult. To address this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Songjin Cai , Linjie Zhong , Ling Guo , Changxing Ding

Current digital human studies focusing on lip-syncing and body movement are no longer sufficient to meet the growing industrial demand, while human video generation techniques that support interacting with real-world environments (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yingying Fan , Quanwei Yang , Kaisiyuan Wang , Hang Zhou , Yingying Li , Haocheng Feng , Errui Ding , Yu Wu , Jingdong Wang