中文
相关论文

相关论文: Discovering A Variety of Objects in Spatio-Tempora…

200 篇论文

Most existing Human-Object Interaction~(HOI) Detection methods rely heavily on full annotations with predefined HOI categories, which is limited in diversity and costly to scale further. We aim at advancing zero-shot HOI detection to detect…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Mingrui Wu , Jiaxin Gu , Yunhang Shen , Mingbao Lin , Chao Chen , Xiaoshuai Sun

A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can…

计算机视觉与模式识别 · 计算机科学 2021-11-24 Dong-Jin Kim , Xiao Sun , Jinsoo Choi , Stephen Lin , In So Kweon

Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Yichen Xie , Hao-Shu Fang , Dian Shao , Yong-Lu Li , Cewu Lu

We tackle the challenging problem of human-object interaction (HOI) detection. Existing methods either recognize the interaction of each human-object pair in isolation or perform joint inference based on complex appearance-based features.…

计算机视觉与模式识别 · 计算机科学 2020-08-27 Chen Gao , Jiarui Xu , Yuliang Zou , Jia-Bin Huang

We propose a novel one-stage Transformer-based semantic and spatial refined transformer (SSRT) to solve the Human-Object Interaction detection task, which requires to localize humans and objects, and predicts their interactions. Differently…

计算机视觉与模式识别 · 计算机科学 2022-05-27 A S M Iftekhar , Hao Chen , Kaustav Kundu , Xinyu Li , Joseph Tighe , Davide Modolo

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection datasets is inherently…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Mesut Erhan Unal , Adriana Kovashka

Fine-grained capturing of 3D HOI boosts human activity understanding and facilitates downstream visual tasks, including action recognition, holistic scene reconstruction, and human motion synthesis. Despite its significance, existing works…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Nan Jiang , Tengyu Liu , Zhexuan Cao , Jieming Cui , Zhiyuan zhang , Yixin Chen , He Wang , Yixin Zhu , Siyuan Huang

Human-object interaction (HOI) detection as a downstream of object detection tasks requires localizing pairs of humans and objects and extracting the semantic relationships between humans and objects from an image. Recently, one-stage…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Junwen Chen , Keiji Yanai

Human-object interaction (HOI) detection is a core task in computer vision. The goal is to localize all human-object pairs and recognize their interactions. An interaction defined by a <verb, noun> tuple leads to a long-tailed visual…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Mert Kilickaya , Arnold Smeulders

Open Vocabulary Human-Object Interaction (HOI) detection aims to detect interactions between humans and objects while generalizing to novel interaction classes beyond the training set. Current methods often rely on Vision and Language…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Ting Lei , Shaofeng Yin , Qingchao Chen , Yuxin Peng , Yang Liu

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Chaoyi Ai

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Yong-Lu Li , Xinpeng Liu , Xiaoqian Wu , Yizhuo Li , Cewu Lu

Comprehensive visual understanding requires detection frameworks that can effectively learn and utilize object interactions while analyzing objects individually. This is the main objective in Human-Object Interaction (HOI) detection task.…

计算机视觉与模式识别 · 计算机科学 2020-03-13 Oytun Ulutan , A S M Iftekhar , B. S. Manjunath

Zero-shot Human-object interaction (HOI) detection aims to locate humans and objects in images and recognize their interactions. While advances in open-vocabulary object detection provide promising solutions for object localization,…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Shiyu Xuan , Dongkai Wang , Zechao Li , Jinhui Tang

We consider the problem of Human-Object Interaction (HOI) Detection, which aims to locate and recognize HOI instances in the form of <human, action, object> in images. Most existing works treat HOIs as individual interaction categories,…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Ye Liu , Junsong Yuan , Chang Wen Chen

In this paper, we investigate the task of zero-shot human-object interaction (HOI) detection, a novel paradigm for identifying HOIs without the need for task-specific annotations. To address this challenging task, we employ CLIP, a…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Bo Wan , Tinne Tuytelaars

Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which aims to predict the HOI triplet in the form of <human, object, action>. Existing methods mainly extract multi-modal features (e.g., appearance, object…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Weibo Jiang , Weihong Ren , Jiandong Tian , Liangqiong Qu , Zhiyong Wang , Honghai Liu

Generating human-object interactions (HOIs) is critical with the tremendous advances of digital avatars. Existing datasets are typically limited to humans interacting with a single object while neglecting the ubiquitous manipulation of…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Xintao Lv , Liang Xu , Yichao Yan , Xin Jin , Congsheng Xu , Shuwen Wu , Yifan Liu , Lincheng Li , Mengxiao Bi , Wenjun Zeng , Xiaokang Yang

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

The way humans interact with each other, including interpersonal distances, spatial configuration, and motion, varies significantly across different situations. To enable machines to understand such complex, context-dependent behaviors, it…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Jeonghyeon Na , Sangwon Baik , Inhee Lee , Junyoung Lee , Hanbyul Joo