中文
相关论文

相关论文: CycleHOI: Improving Human-Object Interaction Detec…

200 篇论文

Recent vision-language-action (VLA) models can generate plausible end-effector motions, yet they often fail in long-horizon, contact-rich tasks because the underlying hand-object interaction (HOI) structure is not explicitly represented. An…

机器人学 · 计算机科学 2026-02-17 Huajian Zeng , Lingyun Chen , Jiaqi Yang , Yuantai Zhang , Fan Shi , Peidong Liu , Xingxing Zuo

Recently, the DETR framework has emerged as the dominant approach for human--object interaction (HOI) research. In particular, two-stage transformer-based HOI detectors are amongst the most performant and training-efficient approaches.…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Frederic Z. Zhang , Yuhui Yuan , Dylan Campbell , Zhuoyao Zhong , Stephen Gould

Human-object contact (HOT) is designed to accurately identify the areas where humans and objects come into contact. Current methods frequently fail to account for scenarios where objects are frequently blocking the view, resulting in…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Yuxiao Wang , Wenpeng Neng , Zhenao Wei , Yu Lei , Weiying Xue , Nan Zhuang , Yanwu Xu , Xinyu Jiang , Qi Liu

The task of Human-Object Interaction~(HOI) detection could be divided into two core problems, i.e., human-object association and interaction understanding. In this paper, we reveal and address the disadvantages of the conventional…

计算机视觉与模式识别 · 计算机科学 2022-04-15 Yue Liao , Aixi Zhang , Miao Lu , Yongliang Wang , Xiaobo Li , Si Liu

Human-object interaction (HOI) video generation has garnered increasing attention due to its promising applications in digital humans, e-commerce, advertising, and robotics imitation learning. However, existing methods face two critical…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Bangya Liu , Xinyu Gong , Zelin Zhao , Ziyang Song , Yulei Lu , Suhui Wu , Jun Zhang , Suman Banerjee , Hao Zhang

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Synthesizing human--object interaction (HOI) videos has broad practical value in e-commerce, digital advertising, and virtual marketing. However, current diffusion models, despite their photorealistic rendering capability, still frequently…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Xiangyang Luo , Xiaozhe Xin , Tao Feng , Xu Guo , Meiguang Jin , Junfeng Ma

Human-Object Interaction Detection tackles the problem of joint localization and classification of human object interactions. Existing HOI transformers either adopt a single decoder for triplet prediction, or utilize two parallel decoders…

计算机视觉与模式识别 · 计算机科学 2022-04-21 Desen Zhou , Zhichao Liu , Jian Wang , Leshan Wang , Tao Hu , Errui Ding , Jingdong Wang

Generating realistic 3D hand-object interactions (HOI) is a fundamental challenge in computer vision and robotics, requiring both temporal coherence and high-fidelity physical plausibility. Existing methods remain limited in their ability…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Jiankang Deng , Cordelia Schmid , Stefanos Zafeiriou

We propose ChainHOI, a novel approach for text-driven human-object interaction (HOI) generation that explicitly models interactions at both the joint and kinetic chain levels. Unlike existing methods that implicitly model interactions using…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Ling-An Zeng , Guohong Huang , Yi-Lin Wei , Shengbo Gu , Yu-Ming Tang , Jingke Meng , Wei-Shi Zheng

Human-Object Interaction (HOI) detection is the task of identifying a set of <human, object, interaction> triplets from an image. Recent work proposed transformer encoder-decoder architectures that successfully eliminated the need for many…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Bumsoo Kim , Jonghwan Mun , Kyoung-Woon On , Minchul Shin , Junhyun Lee , Eun-Sol Kim

This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most existing research on HOI synthesis lacks comprehensive whole-body interactions with dynamic objects, e.g., often limited to manipulating small or…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Sirui Xu , Zhengyuan Li , Yu-Xiong Wang , Liang-Yan Gui

We tackle the challenging problem of human-object interaction (HOI) detection. Existing methods either recognize the interaction of each human-object pair in isolation or perform joint inference based on complex appearance-based features.…

计算机视觉与模式识别 · 计算机科学 2020-08-27 Chen Gao , Jiarui Xu , Yuliang Zou , Jia-Bin Huang

The goal of this paper is Human-object Interaction (HO-I) detection. HO-I detection aims to find interacting human-objects regions and classify their interaction from an image. Researchers obtain significant improvement in recent years by…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Mert Kilickaya , Arnold Smeulders

The recent advances in instance-level detection tasks lay strong foundation for genuine comprehension of the visual scenes. However, the ability to fully comprehend a social scene is still in its preliminary stage. In this work, we focus on…

计算机视觉与模式识别 · 计算机科学 2019-09-24 Bingjie Xu , Junnan Li , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the…

计算机视觉与模式识别 · 计算机科学 2021-03-25 Xubin Zhong , Changxing Ding , Xian Qu , Dacheng Tao

Recent developments in transformer models for visual data have led to significant improvements in recognition and detection tasks. In particular, using learnable queries in place of region proposals has given rise to a new class of…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Frederic Z. Zhang , Dylan Campbell , Stephen Gould

A common problem in human-object interaction (HOI) detection task is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can lead to…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data,…

计算机视觉与模式识别 · 计算机科学 2020-09-03 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa