English
Related papers

Related papers: Decoupled Generative Modeling for Human-Object Int…

200 papers

We address the problem of generating realistic 3D human-object interactions (HOIs) driven by textual prompts. To this end, we take a modular design and decompose the complex task into simpler sub-tasks. We first develop a dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xiaogang Peng , Yiming Xie , Zizhao Wu , Varun Jampani , Deqing Sun , Huaizu Jiang

Recent advances in video generative models enable the synthesis of realistic human-object interaction videos across a wide range of scenarios and object categories, including complex dexterous manipulations that are difficult to capture…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Hyeonwoo Kim , Jeonghwan Kim , Kyungwon Cho , Hanbyul Joo

Human-object interaction (HOI) detection aims to localize human-object pairs and the interactions between them. Existing methods operate under a closed-world assumption, treating the task as a classification problem over a small, predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Zhaolin Cai , Huiyu Duan , Zitong Xu , Fan Li , Zhi Liu , Jing Liu , Wei Shen , Xiongkuo Min , Guangtao Zhai

Generating realistic 3D human-object interactions (HOIs) from text descriptions is a active research topic with potential applications in virtual and augmented reality, robotics, and animation. However, creating high-quality 3D HOIs remains…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yixuan Zhang , Hui Yang , Chuanchen Luo , Junran Peng , Yuxi Wang , Zhaoxiang Zhang

Recent advances in 3D human-aware generation have made significant progress. However, existing methods still struggle with generating novel Human Object Interaction (HOI) from text, particularly for open-set objects. We identify three main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jinlu Zhang , Yixin Chen , Zan Wang , Jie Yang , Yizhou Wang , Siyuan Huang

Hand-object interaction(HOI) is the fundamental link between human and environment, yet its dexterous and complex pose significantly challenges for gesture control. Despite significant advances in AI and robotics, enabling machines to…

Robotics · Computer Science 2025-07-11 Yongqi Tian , Xueyu Sun , Haoyuan He , Linji Hao , Ning Ding , Caigui Jiang

Scene graph generation (SGG) and human-object interaction (HOI) detection are two important visual tasks aiming at localising and recognising relationships between objects, and interactions between humans and objects, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Generating realistic 3D hand-object interactions (HOI) is a fundamental challenge in computer vision and robotics, requiring both temporal coherence and high-fidelity physical plausibility. Existing methods remain limited in their ability…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Jiankang Deng , Cordelia Schmid , Stefanos Zafeiriou

Hand-Object Interaction (HOI) generation plays a critical role in advancing applications across animation and robotics. Current video-based methods are predominantly single-view, which impedes comprehensive 3D geometry perception and often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Lingwei Dang , Zonghan Li , Juntong Li , Hongwen Zhang , Liang An , Yebin Liu , Qingyao Wu

Synthesizing human--object interaction (HOI) videos has broad practical value in e-commerce, digital advertising, and virtual marketing. However, current diffusion models, despite their photorealistic rendering capability, still frequently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xiangyang Luo , Xiaozhe Xin , Tao Feng , Xu Guo , Meiguang Jin , Junfeng Ma

Digital human motion synthesis is a vibrant research field with applications in movies, AR/VR, and video games. Whereas methods were proposed to generate natural and realistic human motions, most only focus on modeling humans and largely…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Quanzhou Li , Jingbo Wang , Chen Change Loy , Bo Dai

Human-object interaction (HOI) synthesis is crucial for creating immersive and realistic experiences for applications such as virtual reality. Existing methods often rely on simplified object representations, such as the object's centroid…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Mengqing Xue , Yifei Liu , Ling Guo , Shaoli Huang , Changxing Ding

Human-Object Interaction (HOI) video reenactment with realistic motion remains a frontier in expressive digital human creation. Existing approaches primarily handle simple image-plane motion (e.g., in-plane translations), struggling with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jinguang Tong , Jinbo Wu , Kaisiyuan Wang , Zhelun Shen , Xuan Huang , Mochu Xiang , Xuesong Li , Yingying Li , Haocheng Feng , Chen Zhao , Hang Zhou , Wei He , Chuong Nguyen , Jingdong Wang , Hongdong Li

Generating realistic 3D human-object interactions (HOIs) remains a challenging task due to the difficulty of modeling detailed interaction dynamics. Existing methods treat human and object motions independently, resulting in physically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Lin Wu , Zhixiang Chen , Jianglin Lan

In this study, we tackle the complex task of generating 3D human-object interactions (HOI) from textual descriptions in a zero-shot text-to-3D manner. We identify and address two key challenges: the unsatisfactory outcomes of direct…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Sisi Dai , Wenhao Li , Haowen Sun , Haibin Huang , Chongyang Ma , Hui Huang , Kai Xu , Ruizhen Hu

Video-based human-object interaction (HOI) understanding requires both detecting ongoing interactions and anticipating their future evolution. However, existing methods usually treat anticipation as a downstream forecasting task built on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuanhao Luo , Di Wen , Kunyu Peng , Ruiping Liu , Junwei Zheng , Yufan Chen , Jiale Wei , Rainer Stiefelhage

Generating realistic hand-object interactions (HOI) videos is a significant challenge due to the difficulty of modeling physical constraints (e.g., contact and occlusion between hands and manipulated objects). Current methods utilize HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Haodong Yan , Hang Yu , Zhide Zhong , Weilin Yuan , Xin Gong , Zehang Luo , Chengxi Heyu , Junfeng Li , Wenxuan Song , Shunbo Zhou , Haoang Li

This paper presents a novel approach to generating the 3D motion of a human interacting with a target object, with a focus on solving the challenge of synthesizing long-range and diverse motions, which could not be fulfilled by existing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Huaijin Pi , Sida Peng , Minghui Yang , Xiaowei Zhou , Hujun Bao

In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Panqi Yang , Haodong Jing , Nanning Zheng , Yongqiang Ma

Compositional Customized Image Generation aims to customize multiple target concepts within generation content, which has gained attention for its wild application. Existing approaches mainly concentrate on the target entity's appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhu Xu , Zhaowen Wang , Yuxin Peng , Yang Liu