中文
相关论文

相关论文: OOD-HOI: Text-Driven 3D Whole-Body Human-Object In…

200 篇论文

Rendering realistic human-object interactions (HOIs) from sparse-view inputs is a challenging yet crucial task for various real-world applications. Existing methods often struggle to simultaneously achieve high rendering quality, physical…

图形学 · 计算机科学 2026-04-10 Weiquan Wang , Jun Xiao , Yi Yang , Yueting Zhuang , Long Chen

We address the task of generating physically accurate and visually faithful 4D Human-Object Interaction (HOI). Given a static 3D human and target object represented as 3D Gaussian Splats (3DGS), our goal is to synthesize dynamic scenes…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Omer Benishu , Gal Fiebelman , Sagie Benaim

We introduce D3D-HOI: a dataset of monocular videos with ground truth annotations of 3D object pose, shape and part motion during human-object interactions. Our dataset consists of several common articulated objects captured from diverse…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Xiang Xu , Hanbyul Joo , Greg Mori , Manolis Savva

Generating natural hand-object interactions in 3D is challenging as the resulting hand and object motions are expected to be physically plausible and semantically meaningful. Furthermore, generalization to unseen objects is hindered by the…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Sammy Christen , Shreyas Hampali , Fadime Sener , Edoardo Remelli , Tomas Hodan , Eric Sauser , Shugao Ma , Bugra Tekin

Synthesizing realistic human-object interaction (HOI) is essential for 3D computer vision and robotics, underpinning animation and embodied control. Existing approaches often require manually specified intermediate waypoints and place all…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Hwanhee Jung , Seunggwan Lee , Jeongyoon Yoon , SeungHyeon Kim , Giljoo Nam , Qixing Huang , Sangpil Kim

While large-scale human motion capture datasets have advanced human motion generation, modeling and generating dynamic 3D human-object interactions (HOIs) remain challenging due to dataset limitations. Existing datasets often lack…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Sirui Xu , Dongting Li , Yucheng Zhang , Xiyan Xu , Qi Long , Ziyin Wang , Yunzhi Lu , Shuchang Dong , Hezi Jiang , Akshat Gupta , Yu-Xiong Wang , Liang-Yan Gui

Synthesizing realistic human-object interactions (HOI) in video is challenging due to the complex, instance-specific interaction dynamics of both humans and objects. Incorporating controllability in video generation further adds to the…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Wanyue Zhang , Lin Geng Foo , Thabo Beeler , Rishabh Dabral , Christian Theobalt

Fine-grained capturing of 3D HOI boosts human activity understanding and facilitates downstream visual tasks, including action recognition, holistic scene reconstruction, and human motion synthesis. Despite its significance, existing works…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Nan Jiang , Tengyu Liu , Zhexuan Cao , Jieming Cui , Zhiyuan zhang , Yixin Chen , He Wang , Yixin Zhu , Siyuan Huang

When humans grasp an object, they naturally form trajectories in their minds to manipulate it for specific tasks. Modeling hand-object interaction priors holds significant potential to advance robotic and embodied AI systems in learning to…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Alexey Gavryushin , Alexandros Delitzas , Luc Van Gool , Marc Pollefeys , Kaichun Mo , Xi Wang

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu

We present HOI-PAGE, a new approach that prioritizes part-level affordance reasoning to generate high-fidelity 4D human-object interactions (HOIs) from text prompts in a zero-shot fashion. In contrast to prior works that focus on global,…

图形学 · 计算机科学 2026-05-20 Lei Li , Angela Dai

Humans interact with objects all the time. Enabling a humanoid to learn human-object interaction (HOI) is a key step for future smart animation and intelligent robotics systems. However, recent progress in physics-based HOI requires…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Yinhuai Wang , Jing Lin , Ailing Zeng , Zhengyi Luo , Jian Zhang , Lei Zhang

Synthesizing physically plausible articulated human-object interactions (HOI) without 3D/4D supervision remains a fundamental challenge. While recent zero-shot approaches leverage video diffusion models to synthesize human-object…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Zihao Huang , Tianqi Liu , Zhaoxi Chen , Shaocong Xu , Saining Zhang , Lixing Xiao , Zhiguo Cao , Wei Li , Hao Zhao , Ziwei Liu

Human-centric video generation has advanced rapidly, yet existing methods struggle to produce controllable and physically consistent Human-Object Interaction (HOI) videos. Existing works rely on dense control signals, template videos, or…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Jiazhi Guan , Quanwei Yang , Luying Huang , Junhao Liang , Borong Liang , Haocheng Feng , Wei He , Kaisiyuan Wang , Hang Zhou , Jingdong Wang

Hand-Object Interaction (HOI) generation has significant application potential. However, current 3D HOI motion generation approaches heavily rely on predefined 3D object models and lab-captured motion data, limiting generalization…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Lingwei Dang , Ruizhi Shao , Hongwen Zhang , Wei Min , Yebin Liu , Qingyao Wu

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human motion guided by…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jiaman Li , Alexander Clegg , Roozbeh Mottaghi , Jiajun Wu , Xavier Puig , C. Karen Liu

Recent vision-language-action (VLA) models can generate plausible end-effector motions, yet they often fail in long-horizon, contact-rich tasks because the underlying hand-object interaction (HOI) structure is not explicitly represented. An…

机器人学 · 计算机科学 2026-02-17 Huajian Zeng , Lingyun Chen , Jiaqi Yang , Yuantai Zhang , Fan Shi , Peidong Liu , Xingxing Zuo

The Human-Object Interaction (HOI) task explores the dynamic interactions between humans and objects in physical environments, providing essential biomechanical and cognitive-behavioral foundations for fields such as robotics, virtual…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Ruiyan Wang , Lin Zuo , Zonghao Lin , Qiang Wang , Zhengxue Cheng , Rong Xie , Jun Ling , Li Song

We propose a novel task of text-controlled human object interaction generation in 3D scenes with movable objects. Existing human-scene interaction datasets suffer from insufficient interaction categories and typically only consider…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Xinhao Cai , Minghang Zheng , Xin Jin , Yang Liu

Human-Object Interaction (HOI) video reenactment with realistic motion remains a frontier in expressive digital human creation. Existing approaches primarily handle simple image-plane motion (e.g., in-plane translations), struggling with…