中文
相关论文

相关论文: Open-World Human-Object Interaction Detection via …

200 篇论文

The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications. Prior work has demonstrated the benefits of effective…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Hangjie Yuan , Jianwen Jiang , Samuel Albanie , Tao Feng , Ziyuan Huang , Dong Ni , Mingqian Tang

We propose ChainHOI, a novel approach for text-driven human-object interaction (HOI) generation that explicitly models interactions at both the joint and kinetic chain levels. Unlike existing methods that implicitly model interactions using…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Ling-An Zeng , Guohong Huang , Yi-Lin Wei , Shengbo Gu , Yu-Ming Tang , Jingke Meng , Wei-Shi Zheng

Hand-Object Interaction (HOI) remains a core challenge in digital human video synthesis, where models must generate physically plausible contact and preserve object identity across frames. Although recent HOI reenactment approaches have…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Xuan Huang , Mochu Xiang , Zhelun Shen , Jinbo Wu , Chenming Wu , Chen Zhao , Kaisiyuan Wang , Hang Zhou , Shanshan Liu , Haocheng Feng , Wei He , Jingdong Wang

Existing GNN-based Human-Object Interaction (HOI) detection methods rely on simple MLPs to fuse instance features and propagate information. However, this mechanism is largely empirical and lack of targeted information propagation process.…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Wenxuan Ji , Haichao Shi , Xiao-Yu Zhang

Generalized 3D hand-object pose estimation from a single RGB image remains challenging due to the large variations in object appearances and interaction patterns, especially under heavy occlusion. We propose GenHOI, a framework for…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Hui Yang , Wei Sun , Jian Liu , Jian Xiao , Tao Xie , Hossein Rahmani , Ajmal Saeed Mian , Nicu Sebe , Gim Hee Lee

This paper presents a new vision Transformer, named Iwin Transformer, which is specifically designed for human-object interaction (HOI) detection, a detailed scene understanding task involving a sequential process of human/object detection…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Danyang Tu , Xiongkuo Min , Huiyu Duan , Guodong Guo , Guangtao Zhai , Wei Shen

Human-Object Interaction (HOI) video reenactment with realistic motion remains a frontier in expressive digital human creation. Existing approaches primarily handle simple image-plane motion (e.g., in-plane translations), struggling with…

Human-centric video generation has advanced rapidly, yet existing methods struggle to produce controllable and physically consistent Human-Object Interaction (HOI) videos. Existing works rely on dense control signals, template videos, or…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Jiazhi Guan , Quanwei Yang , Luying Huang , Junhao Liang , Borong Liang , Haocheng Feng , Wei He , Kaisiyuan Wang , Hang Zhou , Jingdong Wang

Generating realistic and physically plausible 3D Human-Object Interactions (HOI) remains a key challenge in motion generation. One primary reason is that describing these physical constraints with words alone is difficult. To address this…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Songjin Cai , Linjie Zhong , Ling Guo , Changxing Ding

We present HOI-PAGE, a new approach that prioritizes part-level affordance reasoning to generate high-fidelity 4D human-object interactions (HOIs) from text prompts in a zero-shot fashion. In contrast to prior works that focus on global,…

图形学 · 计算机科学 2026-05-20 Lei Li , Angela Dai

Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction; however, the…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Xubin Zhong , Changxing Ding , Yupeng Hu , Dacheng Tao

Understanding human-to-human interactions, especially in contexts like public security surveillance, is critical for monitoring and maintaining safety. Traditional activity recognition systems are limited by fixed vocabularies, predefined…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Lala Shakti Swarup Ray , Bo Zhou , Sungho Suh , Paul Lukowicz

In this work, we introduce Segmentation to Human-Object Interaction (\textit{\textbf{Seg2HOI}}) approach, a novel framework that integrates segmentation-based vision foundation models with the human-object interaction task, distinguished…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Juhan Park , Kyungjae Lee , Hyung Jin Chang , Jungchan Cho

Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which aims to predict the HOI triplet in the form of <human, object, action>. Existing methods mainly extract multi-modal features (e.g., appearance, object…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Weibo Jiang , Weihong Ren , Jiandong Tian , Liangqiong Qu , Zhiyong Wang , Honghai Liu

In 3D hand-object interaction (HOI) tasks, estimating precise joint poses of hands and objects from monocular RGB input remains highly challenging due to the inherent geometric ambiguity of RGB images and the severe mutual occlusions that…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Yuechen Xie , Haobo Jiang , Jian Yang , Yigong Zhang , Jin Xie

Human-object interaction (HOI) detection for capturing relationships between humans and objects is an important task in the semantic understanding of images. When processing human and object keypoints extracted from an image using a graph…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Yoshiki Ito

We are living in a world surrounded by diverse and "smart" devices with rich modalities of sensing ability. Conveniently capturing the interactions between us humans and these objects remains far-reaching. In this paper, we present I'm-HOI,…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Chengfeng Zhao , Juze Zhang , Jiashen Du , Ziwei Shan , Junye Wang , Jingyi Yu , Jingya Wang , Lan Xu

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions in images. Although DETR-based methods have recently emerged as the mainstream framework for HOI detection, they still suffer from…

计算机视觉与模式识别 · 计算机科学 2025-08-13 Yuxiao Wang , Wolin Liang , Yu Lei , Weiying Xue , Nan Zhuang , Qi Liu

Reasoning the human-object interactions (HOI) is essential for deeper scene understanding, while object affordances (or functionalities) are of great importance for human to discover unseen HOIs with novel objects. Inspired by this, we…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Zhi Hou , Baosheng Yu , Yu Qiao , Xiaojiang Peng , Dacheng Tao

Text-driven Human-Object Interaction (Text-to-HOI) generation is an emerging field with applications in animation, video games, virtual reality, and robotics. A key challenge in HOI generation is maintaining interaction consistency in long…

图形学 · 计算机科学 2025-03-24 Zichen Geng , Zeeshan Hayder , Wei Liu , Ajmal Saeed Mian