English
Related papers

Related papers: Human-Object Interaction via Automatically Designe…

200 papers

Text-conditioned human motion generation has experienced significant advancements with diffusion models trained on extensive motion capture data and corresponding textual annotations. However, extending such success to 3D dynamic…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Sirui Xu , Ziyin Wang , Yu-Xiong Wang , Liang-Yan Gui

Humanoid robots that autonomously interact with physical environments over extended horizons represent a central goal of embodied intelligence. Existing approaches rely on reference motions or task-specific rewards, tightly coupling…

Robotics · Computer Science 2026-02-26 Yutang Lin , Jieming Cui , Yixuan Li , Baoxiong Jia , Yixin Zhu , Siyuan Huang

Human-Object Interaction (HOI) recognition in videos is important for analyzing human activity. Most existing work focusing on visual features usually suffer from occlusion in the real-world scenarios. Such a problem will be further…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Tanqiu Qiao , Qianhui Men , Frederick W. B. Li , Yoshiki Kubotani , Shigeo Morishima , Hubert P. H. Shum

Humans interact with objects all the time. Enabling a humanoid to learn human-object interaction (HOI) is a key step for future smart animation and intelligent robotics systems. However, recent progress in physics-based HOI requires…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yinhuai Wang , Jing Lin , Ailing Zeng , Zhengyi Luo , Jian Zhang , Lei Zhang

Real-time synthesis of physically plausible human interactions remains a critical challenge for immersive VR/AR systems and humanoid robotics. While existing methods demonstrate progress in kinematic motion generation, they often fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kaiyang Ji , Ye Shi , Zichen Jin , Kangyi Chen , Lan Xu , Yuexin Ma , Jingyi Yu , Jingya Wang

Current digital human studies focusing on lip-syncing and body movement are no longer sufficient to meet the growing industrial demand, while human video generation techniques that support interacting with real-world environments (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yingying Fan , Quanwei Yang , Kaisiyuan Wang , Hang Zhou , Yingying Li , Haocheng Feng , Errui Ding , Yu Wu , Jingdong Wang

This paper uses the capabilities of latent diffusion models (LDMs) to generate realistic RGB human-object interaction scenes to guide humanoid loco-manipulation planning. To do so, we extract from the generated images both the contact…

Robotics · Computer Science 2025-04-24 Ilyass Taouil , Haizhou Zhao , Angela Dai , Majid Khadiv

Human-Object Interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, conventional HOI detection methods often struggle to fully capture the contextual information needed to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu-Wei Zhan , Fan Liu , Xin Luo , Xin-Shun Xu , Liqiang Nie , Mohan Kankanhalli

Human-centric video generation has advanced rapidly, yet existing methods struggle to produce controllable and physically consistent Human-Object Interaction (HOI) videos. Existing works rely on dense control signals, template videos, or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Jiazhi Guan , Quanwei Yang , Luying Huang , Junhao Liang , Borong Liang , Haocheng Feng , Wei He , Kaisiyuan Wang , Hang Zhou , Jingdong Wang

Human-Object Interaction (HOI) recognition in videos requires understanding both visual patterns and geometric relationships as they evolve over time. Visual and geometric features offer complementary strengths. Visual features capture…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Tanqiu Qiao , Ruochen Li , Frederick W. B. Li , Yoshiki Kubotani , Shigeo Morishima , Hubert P. H. Shum

The Human-Object Interaction (HOI) task explores the dynamic interactions between humans and objects in physical environments, providing essential biomechanical and cognitive-behavioral foundations for fields such as robotics, virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ruiyan Wang , Lin Zuo , Zonghao Lin , Qiang Wang , Zhengxue Cheng , Rong Xie , Jun Ling , Li Song

Human-Object Interaction (HOI) detection aims to simultaneously localize human-object pairs and recognize their interactions. While recent two-stage approaches have made significant progress, they still face challenges due to incomplete…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Zhehao Li , Yucheng Qian , Chong Wang , Yinghao Lu , Zhihao Yang , Jiafei Wu

We present HOI-PAGE, a new approach that prioritizes part-level affordance reasoning to generate high-fidelity 4D human-object interactions (HOIs) from text prompts in a zero-shot fashion. In contrast to prior works that focus on global,…

Graphics · Computer Science 2026-05-20 Lei Li , Angela Dai

Recent advancements in diffusion models have led to significant improvements in the generation and animation of 4D full-body human-object interactions (HOI). Nevertheless, existing methods primarily focus on SMPL-based motion generation,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yukang Cao , Liang Pan , Kai Han , Kwan-Yee K. Wong , Ziwei Liu

The task of Human-Object Interaction (HOI) detection is to detect humans and their interactions with surrounding objects, where transformer-based methods show dominant advances currently. However, these methods ignore the relationship among…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shuman Fang , Zhiwen Lin , Ke Yan , Jie Li , Xianming Lin , Rongrong Ji

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

Human-object interaction (HOI) video generation has garnered increasing attention due to its promising applications in digital humans, e-commerce, advertising, and robotics imitation learning. However, existing methods face two critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Bangya Liu , Xinyu Gong , Zelin Zhao , Ziyang Song , Yulei Lu , Suhui Wu , Jun Zhang , Suman Banerjee , Hao Zhang

Humans frequently grasp, manipulate, and move objects. Interactive systems assist humans in these tasks, enabling applications in Embodied AI, human-robot interaction, and virtual reality. However, current methods in hand-object synthesis…

Robotics · Computer Science 2025-03-10 Sammy Christen

Humanoid robotics has strong potential to transform daily service and caregiving applications. Although recent advances in general motion tracking within physics engines (GMT) have enabled virtual characters and humanoid robots to reproduce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuto Shibata , Kashu Yamazaki , Lalit Jayanti , Yoshimitsu Aoki , Mariko Isogawa , Katerina Fragkiadaki

Physical Human-Scene Interaction (HSI) plays a crucial role in numerous applications. However, existing HSI techniques are limited to specific object dynamics and privileged information, which prevents the development of more comprehensive…

Robotics · Computer Science 2024-11-14 Xinyu Xu , Yizheng Zhang , Yong-Lu Li , Lei Han , Cewu Lu