English
Related papers

Related papers: RoHOI: Robustness Benchmark for Human-Object Inter…

200 papers

Detecting human interactions is crucial for human behavior analysis. Many methods have been proposed to deal with Human-to-Object Interaction (HOI) detection, i.e., detecting in an image which person and object interact together and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Astrid Orcesi , Romaric Audigier , Fritz Poka Toukam , Bertrand Luvison

Human-Object Interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, conventional HOI detection methods often struggle to fully capture the contextual information needed to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu-Wei Zhan , Fan Liu , Xin Luo , Xin-Shun Xu , Liqiang Nie , Mohan Kankanhalli

Zero-shot Human-object interaction (HOI) detection aims to locate humans and objects in images and recognize their interactions. While advances in open-vocabulary object detection provide promising solutions for object localization,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Shiyu Xuan , Dongkai Wang , Zechao Li , Jinhui Tang

Human-Object Interaction (HOI) detection aims to localize human-object pairs and classify their interactions from a single image, a task that demands strong visual understanding and nuanced contextual reasoning. Recent approaches have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Soo Won Seo , KyungChae Lee , Hyungchan Cho , Taein Son , Nam Ik Cho , Jun Won Choi

A significant gap remains between today's visual pattern recognition models and human-level visual cognition especially when it comes to few-shot learning and compositional reasoning of novel concepts. We introduce Bongard-HOI, a new visual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Huaizu Jiang , Xiaojian Ma , Weili Nie , Zhiding Yu , Yuke Zhu , Song-Chun Zhu , Anima Anandkumar

This paper describes an initiation of interaction(IoI) detection framework without keywords for human-robot interaction(HRI) based on audio and vision sensor fusion in a domestic environment. In the proposed framework, the robot has its own…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Guhnoo Yun , Juhan Yoo , Kijung Kim , Dong Hwan Kim

This paper addresses the task of detecting and recognizing human-object interactions (HOI) in images and videos. We introduce the Graph Parsing Neural Network (GPNN), a framework that incorporates structural knowledge while being…

Computer Vision and Pattern Recognition · Computer Science 2018-08-27 Siyuan Qi , Wenguan Wang , Baoxiong Jia , Jianbing Shen , Song-Chun Zhu

Human-object interactions (HOI) detection aims at capturing human-object pairs in images and corresponding actions. It is an important step toward high-level visual reasoning and scene understanding. However, due to the natural bias from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Lijun Zhang , Wei Suo , Peng Wang , Yanning Zhang

While large-scale human motion capture datasets have advanced human motion generation, modeling and generating dynamic 3D human-object interactions (HOIs) remain challenging due to dataset limitations. Existing datasets often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Sirui Xu , Dongting Li , Yucheng Zhang , Xiyan Xu , Qi Long , Ziyin Wang , Yunzhi Lu , Shuchang Dong , Hezi Jiang , Akshat Gupta , Yu-Xiong Wang , Liang-Yan Gui

Synthesizing human--object interaction (HOI) videos has broad practical value in e-commerce, digital advertising, and virtual marketing. However, current diffusion models, despite their photorealistic rendering capability, still frequently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xiangyang Luo , Xiaozhe Xin , Tao Feng , Xu Guo , Meiguang Jin , Junfeng Ma

Human-object interaction detection is a relatively new task in the world of computer vision and visual semantic information extraction. With the goal of machines identifying interactions that humans perform on objects, there are many…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Trevor Bergstrom , Humphrey Shi

Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Xubin Zhong , Changxing Ding , Xian Qu , Dacheng Tao

Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Hao-Shu Fang , Yichen Xie , Dian Shao , Cewu Lu

Livestreaming often involves interactions between streamers and objects, which is critical for understanding and regulating web content. While human-object interaction (HOI) detection has made some progress in general-purpose video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Menghui Zhang , Jing Zhang , Lin Chen , Li Zhuo

Human-Object Interaction (HOI) detection aims to identify humans and objects within images and interpret their interactions. Existing HOI methods rely heavily on large datasets with manual annotations to learn interactions from visual cues.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Francesco Tonini , Lorenzo Vaquero , Alessandro Conti , Cigdem Beyan , Elisa Ricci

Temporal action detection (TAD) aims to locate action positions and recognize action categories in long-term untrimmed videos. Although many methods have achieved promising results, their robustness has not been thoroughly studied. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Runhao Zeng , Xiaoyong Chen , Jiaming Liang , Huisi Wu , Guangzhong Cao , Yong Guo

Human-Object Interaction (HOI) detection lies at the core of action understanding. Besides 2D information such as human/object appearance and locations, 3D pose is also usually utilized in HOI learning since its view-independence. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Yong-Lu Li , Xinpeng Liu , Han Lu , Shiyi Wang , Junqi Liu , Jiefeng Li , Cewu Lu

The task of Human-Object conTact (HOT) detection involves identifying the specific areas of the human body that are touching objects. Nevertheless, current models are restricted to just one type of image, often leading to too much…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yuxiao Wang , Yu Lei , Zhenao Wei , Weiying Xue , Xinyu Jiang , Nan Zhuang , Qi Liu

With the rise of deep learning, facial recognition technology has seen extensive research and rapid development. Although facial recognition is considered a mature technology, we find that existing open-source models and commercial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Caixin Kang , Yubo Chen , Shouwei Ruan , Shiji Zhao , Ruochen Zhang , Jiayi Wang , Shan Fu , Xingxing Wei

Advances in robotics have been driving the development of human-robot interaction (HRI) technologies. However, accurately perceiving human actions and achieving adaptive control remains a challenge in facilitating seamless coordination…

Robotics · Computer Science 2025-07-10 Mingqi Yuan , Huijiang Wang , Kai-Fung Chu , Fumiya Iida , Bo Li , Wenjun Zeng