中文
相关论文

相关论文: InfBaGel: Human-Object-Scene Interaction Generatio…

200 篇论文

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu

Digital human video generation is gaining traction in fields like education and e-commerce, driven by advancements in head-body animation and lip-syncing technologies. However, realistic Hand-Object Interaction (HOI) - the complex dynamics…

Human-object interactions (HOIs) are crucial for human-centric scene understanding applications such as human-centric visual generation, AR/VR, and robotics. Since existing methods mainly explore capturing HOIs, rendering HOI remains less…

计算机视觉与模式识别 · 计算机科学 2023-04-28 Zhi Hou , Baosheng Yu , Dacheng Tao

Human-object interaction (HOI) detection aims to detect interactions between humans and objects in images. While recent advances have improved performance on existing benchmarks, their evaluations mainly focus on overall prediction accuracy…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Lemeng Wang , Qinqian Lei , Vidhi Bakshi , Daniel Yi , Yifan Liu , Jiacheng Hou , Asher Seng Hao , Zheda Mai , Wei-Lun Chao , Robby T. Tan , Bo Wang

This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most existing research on HOI synthesis lacks comprehensive whole-body interactions with dynamic objects, e.g., often limited to manipulating small or…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Sirui Xu , Zhengyuan Li , Yu-Xiong Wang , Liang-Yan Gui

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human motion guided by…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jiaman Li , Alexander Clegg , Roozbeh Mottaghi , Jiajun Wu , Xavier Puig , C. Karen Liu

Human-Object Interaction (HOI) detection, inferring the relationships between human and objects from images/videos, is a fundamental task for high-level scene understanding. However, HOI detection usually suffers from the open long-tailed…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Reasoning the human-object interactions (HOI) is essential for deeper scene understanding, while object affordances (or functionalities) are of great importance for human to discover unseen HOIs with novel objects. Inspired by this, we…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Hand-Object Interaction (HOI) remains a core challenge in digital human video synthesis, where models must generate physically plausible contact and preserve object identity across frames. Although recent HOI reenactment approaches have…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Xuan Huang , Mochu Xiang , Zhelun Shen , Jinbo Wu , Chenming Wu , Chen Zhao , Kaisiyuan Wang , Hang Zhou , Shanshan Liu , Haocheng Feng , Wei He , Jingdong Wang

Determining which image regions to concentrate on is critical for Human-Object Interaction (HOI) detection. Conventional HOI detectors focus on either detected human and object pairs or pre-defined interaction locations, which limits…

计算机视觉与模式识别 · 计算机科学 2021-05-07 Mingfei Chen , Yue Liao , Si Liu , Zhiyuan Chen , Fei Wang , Chen Qian

Generating human-object interactions (HOIs) is critical with the tremendous advances of digital avatars. Existing datasets are typically limited to humans interacting with a single object while neglecting the ubiquitous manipulation of…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Xintao Lv , Liang Xu , Yichao Yan , Xin Jin , Congsheng Xu , Shuwen Wu , Yifan Liu , Lincheng Li , Mengxiao Bi , Wenjun Zeng , Xiaokang Yang

In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Panqi Yang , Haodong Jing , Nanning Zheng , Yongqiang Ma

Hand-object interaction (HOI) is fundamental for humans to express intent. Existing HOI generation research is predominantly confined to fixed grasping patterns, where control is tied to physical priors such as force closure or generic…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Guangyi Han , Wei Zhai , Yuhang Yang , Yang Cao , Zheng-Jun Zha

Human-Object Interaction (HOI), as an important problem in computer vision, requires locating the human-object pair and identifying the interactive relationships between them. The HOI instance has a greater span in spatial, scale, and task…

计算机视觉与模式识别 · 计算机科学 2023-01-11 Shuailei Ma , Yuefeng Wang , Shanze Wang , Ying Wei

Text-conditioned human motion generation has experienced significant advancements with diffusion models trained on extensive motion capture data and corresponding textual annotations. However, extending such success to 3D dynamic…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Sirui Xu , Ziyin Wang , Yu-Xiong Wang , Liang-Yan Gui

We propose a novel task of text-controlled human object interaction generation in 3D scenes with movable objects. Existing human-scene interaction datasets suffer from insufficient interaction categories and typically only consider…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Xinhao Cai , Minghang Zheng , Xin Jin , Yang Liu

Human-Object Interaction (HOI) detection is a fundamental task in high-level human-centric scene understanding. We propose PhraseHOI, containing a HOI branch and a novel phrase branch, to leverage language prior and improve relation…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Zhimin Li , Cheng Zou , Yu Zhao , Boxun Li , Sheng Zhong

Human object interaction (HOI) detection is an important task in image understanding and reasoning. It is in a form of HOI triplet <human; verb; object>, requiring bounding boxes for human and object, and action between them for the task…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Suresh Kirthi Kumaraswamy , Miaojing Shi , Ewa Kijak

3D hand-object interaction data is scarce due to the hardware constraints in scaling up the data collection process. In this paper, we propose HOIDiffusion for generating realistic and diverse 3D hand-object interaction data. Our model is a…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Mengqi Zhang , Yang Fu , Zheng Ding , Sifei Liu , Zhuowen Tu , Xiaolong Wang

Human-Object Interaction (HOI) modelling captures how humans act upon and relate to objects, typically expressed as <person, action, object> triplets. Existing approaches split into two disjoint families: HOI generation synthesises scenes…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Jiun Tian Hoe , Weipeng Hu , Xudong Jiang , Yap-Peng Tan , Chee Seng Chan