English
Related papers

Related papers: DRG: Dual Relation Graph for Human-Object Interact…

200 papers

Reasoning human object interactions is a core problem in human-centric scene understanding and detecting such relations poses a unique challenge to vision systems due to large variations in human-object configurations, multiple co-occurring…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Bo Wan , Desen Zhou , Yongfei Liu , Rongjie Li , Xuming He

Human-object interaction detection is an important and relatively new class of visual relationship detection tasks, essential for deeper scene understanding. Most existing approaches decompose the problem into object localization and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Tiancai Wang , Rao Muhammad Anwer , Muhammad Haris Khan , Fahad Shahbaz Khan , Yanwei Pang , Ling Shao , Jorma Laaksonen

The key of Human-Object Interaction(HOI) recognition is to infer the relationship between human and objects. Recently, the image's Human-Object Interaction(HOI) detection has made significant progress. However, there is still room for…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Hongsheng Li , Guangming Zhu , Wu Zhen , Lan Ni , Peiyi Shen , Liang Zhang , Ning Wang , Cong Hua

Two-stage methods have dominated Human-Object Interaction (HOI) detection for several years. Recently, one-stage HOI detection methods have become popular. In this paper, we aim to explore the essential pros and cons of two-stage and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Aixi Zhang , Yue Liao , Si Liu , Miao Lu , Yongliang Wang , Chen Gao , Xiaobo Li

Understanding the human-object interactions (HOIs) from a video is essential to fully comprehend a visual scene. This line of research has been addressed by detecting HOIs from images and lately from videos. However, the video-based HOI…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Zhifan Ni , Esteve Valls Mascaró , Hyemin Ahn , Dongheui Lee

We consider the problem of Human-Object Interaction (HOI) Detection, which aims to locate and recognize HOI instances in the form of <human, action, object> in images. Most existing works treat HOIs as individual interaction categories,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ye Liu , Junsong Yuan , Chang Wen Chen

Human object interaction (HOI) detection is an important task in image understanding and reasoning. It is in a form of HOI triplet <human; verb; object>, requiring bounding boxes for human and object, and action between them for the task…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Suresh Kirthi Kumaraswamy , Miaojing Shi , Ewa Kijak

When humans and robotic agents coexist in an environment, scene understanding becomes crucial for the agents to carry out various downstream tasks like navigation and planning. Hence, an agent must be capable of localizing and identifying…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Mrunmai Vivek Phatak , Julian Lorenz , Nico Hörmann , Jörg Hähner , Rainer Lienhart

Human-object interaction (HOI) synthesis is crucial for creating immersive and realistic experiences for applications such as virtual reality. Existing methods often rely on simplified object representations, such as the object's centroid…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Mengqing Xue , Yifei Liu , Ling Guo , Shaoli Huang , Changxing Ding

Human-object interaction (HOI) detection is an important part of understanding human activities and visual scenes. The long-tailed distribution of labeled instances is a primary challenge in HOI detection, promoting research in few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Zikun Zhuang , Ruihao Qian , Chi Xie , Shuang Liang

Human-Object Interaction (HOI) aims to identify the pairs of humans and objects in images and to recognize their relationships, ultimately forming $\langle human, object, verb \rangle$ triplets. Under default settings, HOI performance is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Chaoyi Ai

Recent developments in transformer models for visual data have led to significant improvements in recognition and detection tasks. In particular, using learnable queries in place of region proposals has given rise to a new class of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Frederic Z. Zhang , Dylan Campbell , Stephen Gould

The interaction decoder utilized in prevalent Transformer-based HOI detectors typically accepts pre-composed human-object pairs as inputs. Though achieving remarkable performance, such paradigm lacks feasibility and cannot explore novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Liulei Li , Jianan Wei , Wenguan Wang , Yi Yang

Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which aims to predict the HOI triplet in the form of <human, object, action>. Existing methods mainly extract multi-modal features (e.g., appearance, object…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Weibo Jiang , Weihong Ren , Jiandong Tian , Liangqiong Qu , Zhiyong Wang , Honghai Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-Object Interaction (HOI) recognition is challenging due to two factors: (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ying Jin , Yinpeng Chen , Lijuan Wang , Jianfeng Wang , Pei Yu , Lin Liang , Jenq-Neng Hwang , Zicheng Liu

Human-object interaction detection (HOID) refers to localizing interactive human-object pairs in images and identifying the interactions. Since there could be an exponential number of object-action combinations, labeled data is limited -…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Sandipan Sarma , Agney Talwarr , Arijit Sur

Human-object interaction detection is a relatively new task in the world of computer vision and visual semantic information extraction. With the goal of machines identifying interactions that humans perform on objects, there are many…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Trevor Bergstrom , Humphrey Shi

Human-Object Interaction (HOI) detection is a core task for high-level image understanding. Recently, Detection Transformer (DETR)-based HOI detectors have become popular due to their superior performance and efficient structure. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xubin Zhong , Changxing Ding , Zijian Li , Shaoli Huang

Zero-shot Human-object interaction (HOI) detection aims to locate humans and objects in images and recognize their interactions. While advances in open-vocabulary object detection provide promising solutions for object localization,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Shiyu Xuan , Dongkai Wang , Zechao Li , Jinhui Tang