中文
相关论文

相关论文: Open-World Human-Object Interaction Detection via …

200 篇论文

Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided…

机器人学 · 计算机科学 2026-03-03 Yuhang Lin , Jiyuan Shi , Dewei Wang , Jipeng Kong , Yong Liu , Chenjia Bai , Xuelong Li

Detecting Human-Object Interactions (HOI) in zero-shot settings, where models must handle unseen classes, poses significant challenges. Existing methods that rely on aligning visual encoders with large Vision-Language Models (VLMs) to tap…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Qinqian Lei , Bo Wang , Robby T. Tan

The Human-Object Interaction (HOI) task explores the dynamic interactions between humans and objects in physical environments, providing essential biomechanical and cognitive-behavioral foundations for fields such as robotics, virtual…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Ruiyan Wang , Lin Zuo , Zonghao Lin , Qiang Wang , Zhengxue Cheng , Rong Xie , Jun Ling , Li Song

Humans interact with objects all the time. Enabling a humanoid to learn human-object interaction (HOI) is a key step for future smart animation and intelligent robotics systems. However, recent progress in physics-based HOI requires…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Yinhuai Wang , Jing Lin , Ailing Zeng , Zhengyi Luo , Jian Zhang , Lei Zhang

Human-Object Interaction (HOI) detection aims to understand the interactions between humans and objects, which plays a curtail role in high-level semantic understanding tasks. However, most works pursue designing better architectures to…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Shuman Fang , Shuai Liu , Jie Li , Guannan Jiang , Xianming Lin , Rongrong Ji

A comprehensive understanding of human-object interaction (HOI) requires detecting not only a small portion of predefined HOI concepts (or categories) but also other reasonable HOI concepts, while current approaches usually fail to explore…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Zhi Hou , Baosheng Yu , Dacheng Tao

Existing 3D human object interaction (HOI) datasets and models simply align global descriptions with the long HOI sequence, while lacking a detailed understanding of intermediate states and the transitions between states. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Jie Yang , Xuesong Niu , Nan Jiang , Ruimao Zhang , Siyuan Huang

Understanding and recognizing human-object interaction (HOI) is a pivotal application in AR/VR and robotics. Recent open-vocabulary HOI detection approaches depend exclusively on large language models for richer textual prompts, neglecting…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Zhenhao Zhang , Hanqing Wang , Xiangyu Zeng , Ziyu Cheng , Jiaxin Liu , Haoyu Yan , Zhirui Liu , Kaiyang Ji , Tianxiang Gui , Ke Hu , Kangyi Chen , Yahao Fan , Mokai Pan

Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the…

计算机视觉与模式识别 · 计算机科学 2021-03-25 Xubin Zhong , Changxing Ding , Xian Qu , Dacheng Tao

Human-object interaction (HOI) detection often faces high levels of ambiguity and indeterminacy, as the same interaction can appear vastly different across different human-object pairs. Additionally, the indeterminacy can be further…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Jun Liu

Generating human-object interactions (HOIs) is critical with the tremendous advances of digital avatars. Existing datasets are typically limited to humans interacting with a single object while neglecting the ubiquitous manipulation of…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Xintao Lv , Liang Xu , Yichao Yan , Xin Jin , Congsheng Xu , Shuwen Wu , Yifan Liu , Lincheng Li , Mengxiao Bi , Wenjun Zeng , Xiaokang Yang

This paper focuses on Human-Object Interaction (HOI) detection, addressing the challenge of identifying and understanding the interactions between humans and objects within a given image or video frame. Spearheaded by Detection Transformer…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Mu Chen , Minghan Chen , Yi Yang

Modeling 4D human-object interaction (HOI) is a compelling challenge in computer vision and an essential technology powering virtual and mixed-reality applications. While existing works have achieved promising results on specific HOI…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Mengfei Zhang , Jinlu Zhang , Zhigang Tu

Understanding interactions between humans and objects is one of the fundamental problems in visual classification and an essential step towards detailed scene understanding. Human-object interaction (HOI) detection strives to localize both…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Tiancai Wang , Tong Yang , Martin Danelljan , Fahad Shahbaz Khan , Xiangyu Zhang , Jian Sun

Recent human-object interaction (HOI) detection methods depend on extensively annotated image datasets, which require a significant amount of manpower. In this paper, we propose a novel self-adaptive, language-driven HOI detection method,…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Qi Liu , Yuxiao Wang , Xinyu Jiang , Wolin Liang , Zhenao Wei , Yu Lei , Nan Zhuang , Weiying Xue

The Large Vision Language Model (VLM) has recently addressed remarkable progress in bridging two fundamental modalities. VLM, trained by a sufficiently large dataset, exhibits a comprehensive understanding of both visual and linguistic to…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Donggoo Kang , Dasol Jeong , Hyunmin Lee , Sangwoo Park , Hasil Park , Sunkyu Kwon , Yeongjoon Kim , Joonki Paik

Human-Object Interaction (HOI) detection is crucial for robot-human assistance, enabling context-aware support. However, models trained on clean datasets degrade in real-world conditions due to unforeseen corruptions, leading to inaccurate…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Di Wen , Kunyu Peng , Kailun Yang , Yufan Chen , Ruiping Liu , Junwei Zheng , Alina Roitberg , Danda Pani Paudel , Luc Van Gool , Rainer Stiefelhagen

A common problem in human-object interaction (HOI) detection task is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can lead to…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can…

计算机视觉与模式识别 · 计算机科学 2021-11-24 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon