English
Related papers

Related papers: Weakly-Supervised HOI Detection from Interaction L…

200 papers

Human-object interaction (HOI) detection is essential for accurately localizing and characterizing interactions between humans and objects, providing a comprehensive understanding of complex visual scenes across various domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Quan Bi Pay , Vishnu Monn Baskaran , Junn Yong Loo , KokSheik Wong , Simon See

Weakly-supervised object detection attempts to limit the amount of supervision by dispensing the need for bounding boxes, but still assumes image-level labels on the entire training set. In this work, we study the problem of training an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Zhaohui Yang , Miaojing Shi , Chao Xu , Vittorio Ferrari , Yannis Avrithis

Human-Object Interactions (HOI) detection, which aims to localize a human and a relevant object while recognizing their interaction, is crucial for understanding a still image. Recently, transformer-based models have significantly advanced…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Leizhen Dong , Zhimin Li , Kunlun Xu , Zhijun Zhang , Luxin Yan , Sheng Zhong , Xu Zou

Human-object interaction (HOI) synthesis is crucial for applications in animation, simulation, and robotics. However, existing approaches either rely on expensive motion capture data or require manual reward engineering, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zekai Deng , Ye Shi , Kaiyang Ji , Lan Xu , Shaoli Huang , Jingya Wang

Comprehensive visual understanding requires detection frameworks that can effectively learn and utilize object interactions while analyzing objects individually. This is the main objective in Human-Object Interaction (HOI) detection task.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Oytun Ulutan , A S M Iftekhar , B. S. Manjunath

Understanding and synthesizing realistic 3D hand-object interactions (HOI) is critical for applications ranging from immersive AR/VR to dexterous robotics. Existing methods struggle with generalization, performing well on closed-set objects…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhenhao Zhang , Ye Shi , Lingxiao Yang , Suting Ni , Qi Ye , Jingya Wang

Visual Language Navigation (VLN) is a fundamental task within the field of Embodied AI, focusing on the ability of agents to navigate complex environments based on natural language instructions. Despite the progress made by existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Ruoyu Wang , Tong Yu , Junda Wu , Yao Liu , Julian McAuley , Lina Yao

Human-Object Interaction (HOI) detection is a core task for high-level image understanding. Recently, Detection Transformer (DETR)-based HOI detectors have become popular due to their superior performance and efficient structure. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xubin Zhong , Changxing Ding , Zijian Li , Shaoli Huang

The recent emerged weakly supervised object localization (WSOL) methods can learn to localize an object in the image only using image-level labels. Previous works endeavor to perceive the interval objects from the small and sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Feifei Shao , Yawei Luo , Li Zhang , Lu Ye , Siliang Tang , Yi Yang , Jun Xiao

Weakly-supervised object localization (WSOL) has gained popularity over the last years for its promise to train localization models with only image-level labels. Since the seminal WSOL work of class activation mapping (CAM), the field has…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Junsuk Choe , Seong Joon Oh , Seungho Lee , Sanghyuk Chun , Zeynep Akata , Hyunjung Shim

Detecting human-object interactions (HOI) in a few-shot setting remains a challenge. Existing meta-learning methods struggle to extract representative features for classification due to the limited data, while existing few-shot HOI models…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Qinqian Lei , Bo Wang , Robby T. Tan

Pixel-level recognition of objects manipulated by the user from egocentric images enables key applications spanning assistive technologies, industrial safety, and activity monitoring. However, progress in this area is currently hindered by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Nicola Messina , Rosario Leonardi , Luca Ciampi , Fabio Carrara , Giovanni Maria Farinella , Fabrizio Falchi , Antonino Furnari

Weakly-supervised Human-Object Interaction (HOI) detection is essential for scalable scene understanding, as it learns interactions from only image-level annotations. Due to the lack of localization signals, prior works typically rely on an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jihwan Park , Chanhyeong Yang , Jinyoung Park , Taehoon Song , Hyunwoo J. Kim

To alleviate the cost of obtaining accurate bounding boxes for training today's state-of-the-art object detection models, recent weakly supervised detection work has proposed techniques to learn from image-level labels. However, requiring…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Keren Ye , Mingda Zhang , Wei Li , Danfeng Qin , Adriana Kovashka , Jesse Berent

Modeling 4D human-object interaction (HOI) is a compelling challenge in computer vision and an essential technology powering virtual and mixed-reality applications. While existing works have achieved promising results on specific HOI…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Mengfei Zhang , Jinlu Zhang , Zhigang Tu

Cameras are essential vision instruments to capture images for pattern detection and measurement. Human-object interaction (HOI) detection is one of the most popular pattern detection approaches for captured human-centric visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Manli Zhu , Edmond S. L. Ho , Shuang Chen , Longzhi Yang , Hubert P. H. Shum

Synthesizing realistic human-object interactions (HOI) in video is challenging due to the complex, instance-specific interaction dynamics of both humans and objects. Incorporating controllability in video generation further adds to the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Wanyue Zhang , Lin Geng Foo , Thabo Beeler , Rishabh Dabral , Christian Theobalt

Human-Object Interaction (HOI) detection aims to learn how human interacts with surrounding objects. Previous HOI detection frameworks simultaneously detect human, objects and their corresponding interactions by using a predictor. Using…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Huan Peng , Fenggang Liu , Yangguang Li , Bin Huang , Jing Shao , Nong Sang , Changxin Gao

In light of the mounting imperative for public security, the necessity for automated threat detection in high-risk scenarios is becoming increasingly pressing. However, existing methods generally suffer from the problems of uninterpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yuhan Wang , Cheng Liu , Daou Zhang , Zihan Zhao , Jinyang Chen , Purui Dong , Zuyuan Yu , Ziru Wang , Weichao Wu

Recent advances in deep neural networks have achieved significant progress in detecting individual objects from an image. However, object detection is not sufficient to fully understand a visual scene. Towards a deeper visual understanding,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Bumsoo Kim , Taeho Choi , Jaewoo Kang , Hyunwoo J. Kim