中文
相关论文

相关论文: End-to-End Human Object Interaction Detection with…

200 篇论文

Human-Object Interaction (HOI) detection, which localizes and infers relationships between human and objects, plays an important role in scene understanding. Although two-stage HOI detectors have advantages of high efficiency in training…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jeeseung Park , Jin-Woo Park , Jong-Seok Lee

Spatio-temporal Human-Object Interaction (ST-HOI) detection aims at detecting HOIs from videos, which is crucial for activity understanding. In daily HOIs, humans often interact with a variety of objects, e.g., holding and touching dozens…

计算机视觉与模式识别 · 计算机科学 2022-11-21 Yong-Lu Li , Hongwei Fan , Zuoyu Qiu , Yiming Dou , Liang Xu , Hao-Shu Fang , Peiyang Guo , Haisheng Su , Dongliang Wang , Wei Wu , Cewu Lu

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Chaoyi Ai

Recognition and generation are two fundamental tasks in computer vision, which are often investigated separately in the exiting literature. However, these two tasks are highly correlated in essence as they both require understanding the…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Yisen Wang , Yao Teng , Limin Wang

This paper investigates the problem of the current HOI detection methods and introduces DiffHOI, a novel HOI detection scheme grounded on a pre-trained text-image diffusion model, which enhances the detector's performance via improved data…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Jie Yang , Bingliang Li , Fengyu Yang , Ailing Zeng , Lei Zhang , Ruimao Zhang

In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Panqi Yang , Haodong Jing , Nanning Zheng , Yongqiang Ma

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Spatial contexts, such as the backgrounds and surroundings, are considered critical in Human-Object Interaction (HOI) recognition, especially when the instance-centric foreground is blurred or occluded. Recent advancements in HOI detectors…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Mingda Jia , Liming Zhao , Ge Li , Yun Zheng

We propose a single-stage Human-Object Interaction (HOI) detection method that has outperformed all existing methods on HICO-DET dataset at 37 fps on a single Titan XP GPU. It is the first real-time HOI detection method. Conventional HOI…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Yue Liao , Si Liu , Fei Wang , Yanjie Chen , Chen Qian , Jiashi Feng

Unlike most previous HOI methods that focus on learning better human-object features, we propose a novel and complementary approach called category query learning. Such queries are explicitly associated to interaction categories, converted…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Chi Xie , Fangao Zeng , Yue Hu , Shuang Liang , Yichen Wei

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets. Despite the challenges posed by…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Yichao Cao , Qingfei Tang , Feng Yang , Xiu Su , Shan You , Xiaobo Lu , Chang Xu

Human-object interaction (HOI) detectors with popular query-transformer architecture have achieved promising performance. However, accurately identifying uncommon visual patterns and distinguishing between ambiguous HOIs continue to be…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Mingda Jia , Liming Zhao , Ge Li , Yun Zheng

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics. However, acquiring 3D HOI data is challenging due to its complexity and high cost, limiting existing methods to the…

图形学 · 计算机科学 2025-03-27 Yuke Lou , Yiming Wang , Zhen Wu , Rui Zhao , Wenjia Wang , Mingyi Shi , Taku Komura

Human-object interaction detection is a relatively new task in the world of computer vision and visual semantic information extraction. With the goal of machines identifying interactions that humans perform on objects, there are many…

计算机视觉与模式识别 · 计算机科学 2020-09-29 Trevor Bergstrom , Humphrey Shi

Recently, the DETR framework has emerged as the dominant approach for human--object interaction (HOI) research. In particular, two-stage transformer-based HOI detectors are amongst the most performant and training-efficient approaches.…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Frederic Z. Zhang , Yuhui Yuan , Dylan Campbell , Zhuoyao Zhong , Stephen Gould

Human-Object Interaction (HOI) detection is crucial for robot-human assistance, enabling context-aware support. However, models trained on clean datasets degrade in real-world conditions due to unforeseen corruptions, leading to inaccurate…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Di Wen , Kunyu Peng , Kailun Yang , Yufan Chen , Ruiping Liu , Junwei Zheng , Alina Roitberg , Danda Pani Paudel , Luc Van Gool , Rainer Stiefelhagen

Human-object interaction (HOI) detection is essential for accurately localizing and characterizing interactions between humans and objects, providing a comprehensive understanding of complex visual scenes across various domains. However,…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Quan Bi Pay , Vishnu Monn Baskaran , Junn Yong Loo , KokSheik Wong , Simon See

In light of the mounting imperative for public security, the necessity for automated threat detection in high-risk scenarios is becoming increasingly pressing. However, existing methods generally suffer from the problems of uninterpretable…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Yuhan Wang , Cheng Liu , Daou Zhang , Zihan Zhao , Jinyang Chen , Purui Dong , Zuyuan Yu , Ziru Wang , Weichao Wu