中文
相关论文

相关论文: SimGenHOI: Physically Realistic Whole-Body Humanoi…

200 篇论文

Hand-Object Interaction (HOI) generation has significant application potential. However, current 3D HOI motion generation approaches heavily rely on predefined 3D object models and lab-captured motion data, limiting generalization…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Lingwei Dang , Ruizhi Shao , Hongwen Zhang , Wei Min , Yebin Liu , Qingyao Wu

Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided…

机器人学 · 计算机科学 2026-03-03 Yuhang Lin , Jiyuan Shi , Dewei Wang , Jipeng Kong , Yong Liu , Chenjia Bai , Xuelong Li

This paper introduces the first text-guided work for generating the sequence of hand-object interaction in 3D. The main challenge arises from the lack of labeled data where existing ground-truth datasets are nowhere near generalizable in…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Junuk Cha , Jihyeon Kim , Jae Shin Yoon , Seungryul Baek

Human-Object Interaction (HOI) video reenactment with realistic motion remains a frontier in expressive digital human creation. Existing approaches primarily handle simple image-plane motion (e.g., in-plane translations), struggling with…

Whole-body Humanoid-Object Interaction (HOI) is bottlenecked by the scarcity of high-fidelity 3D data. While video generative priors offer a promising alternative, existing methods suffer from \textit{Representation Misalignment} due to…

Digital human video generation is gaining traction in fields like education and e-commerce, driven by advancements in head-body animation and lip-syncing technologies. However, realistic Hand-Object Interaction (HOI) - the complex dynamics…

Hand-object interaction (HOI) is fundamental for humans to express intent. Existing HOI generation research is predominantly confined to fixed grasping patterns, where control is tied to physical priors such as force closure or generic…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Guangyi Han , Wei Zhai , Yuhang Yang , Yang Cao , Zheng-Jun Zha

We address the problem of generating realistic 3D human-object interactions (HOIs) driven by textual prompts. To this end, we take a modular design and decompose the complex task into simpler sub-tasks. We first develop a dual-branch…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Xiaogang Peng , Yiming Xie , Zizhao Wu , Varun Jampani , Deqing Sun , Huaizu Jiang

Generating realistic 3D hand-object interactions (HOI) is a fundamental challenge in computer vision and robotics, requiring both temporal coherence and high-fidelity physical plausibility. Existing methods remain limited in their ability…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Jiankang Deng , Cordelia Schmid , Stefanos Zafeiriou

Text-driven Human-Object Interaction (Text-to-HOI) generation is an emerging field with applications in animation, video games, virtual reality, and robotics. A key challenge in HOI generation is maintaining interaction consistency in long…

图形学 · 计算机科学 2025-03-24 Zichen Geng , Zeeshan Hayder , Wei Liu , Ajmal Saeed Mian

Generating human-object interactions (HOIs) is critical with the tremendous advances of digital avatars. Existing datasets are typically limited to humans interacting with a single object while neglecting the ubiquitous manipulation of…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Xintao Lv , Liang Xu , Yichao Yan , Xin Jin , Congsheng Xu , Shuwen Wu , Yifan Liu , Lincheng Li , Mengxiao Bi , Wenjun Zeng , Xiaokang Yang

We present HOIDiNi, a text-driven diffusion framework for synthesizing realistic and plausible human-object interaction (HOI). HOI generation is extremely challenging since it induces strict contact accuracies alongside a diverse motion…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Roey Ron , Guy Tevet , Haim Sawdayee , Amit H. Bermano

Synthesizing human--object interaction (HOI) videos has broad practical value in e-commerce, digital advertising, and virtual marketing. However, current diffusion models, despite their photorealistic rendering capability, still frequently…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Xiangyang Luo , Xiaozhe Xin , Tao Feng , Xu Guo , Meiguang Jin , Junfeng Ma

Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics. However, acquiring 3D HOI data is challenging due to its complexity and high cost, limiting existing methods to the…

图形学 · 计算机科学 2025-03-27 Yuke Lou , Yiming Wang , Zhen Wu , Rui Zhao , Wenjia Wang , Mingyi Shi , Taku Komura

Detecting human-object interactions (HOIs) is an intricate challenge in the field of computer vision. Existing methods for HOI detection heavily rely on appearance-based features, but these may not fully capture all the essential…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Lijing Zhu , Qizhen Lan , Alvaro Velasquez , Houbing Song , Acharya Kamal , Qing Tian , Shuteng Niu

Achieving realistic simulations of humans interacting with a wide range of objects has long been a fundamental goal. Extending physics-based motion imitation to complex human-object interactions (HOIs) is challenging due to intricate…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Sirui Xu , Hung Yu Ling , Yu-Xiong Wang , Liang-Yan Gui

This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most existing research on HOI synthesis lacks comprehensive whole-body interactions with dynamic objects, e.g., often limited to manipulating small or…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Sirui Xu , Zhengyuan Li , Yu-Xiong Wang , Liang-Yan Gui

Synthesizing physically plausible articulated human-object interactions (HOI) without 3D/4D supervision remains a fundamental challenge. While recent zero-shot approaches leverage video diffusion models to synthesize human-object…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Zihao Huang , Tianqi Liu , Zhaoxi Chen , Shaocong Xu , Saining Zhang , Lixing Xiao , Zhiguo Cao , Wei Li , Hao Zhao , Ziwei Liu

Prevalent human-object interaction (HOI) detection approaches typically leverage large-scale visual-linguistic models to help recognize events involving humans and objects. Though promising, models trained via contrastive learning on…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Liulei Li , Wenguan Wang , Yi Yang

Real-world scenes often feature multiple humans interacting with multiple objects in ways that are causal, goal-oriented, or cooperative. Yet existing 3D human-object interaction (HOI) benchmarks consider only a fraction of these complex…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Kaen Kogashi , Anoop Cherian , Meng-Yu Jennifer Kuo