English
Related papers

Related papers: Egocentric Human-Object Interaction Detection Expl…

200 papers

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Ankan Bansal , Sai Saketh Rambhatla , Abhinav Shrivastava , Rama Chellappa

Egocentric action recognition is essential for healthcare and assistive technology that relies on egocentric cameras because it allows for the automatic and continuous monitoring of activities of daily living (ADLs) without requiring any…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Wiktor Mucha , Martin Kampel

Egocentric vision holds great promises for increasing access to visual information and improving the quality of life for people with visual impairments, with object recognition being one of the daily challenges for this population. While we…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Kyungjun Lee , Abhinav Shrivastava , Hernisa Kacorri

Cameras are essential vision instruments to capture images for pattern detection and measurement. Human-object interaction (HOI) detection is one of the most popular pattern detection approaches for captured human-centric visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Manli Zhu , Edmond S. L. Ho , Shuang Chen , Longzhi Yang , Hubert P. H. Shum

Human-object contact (HOT) is designed to accurately identify the areas where humans and objects come into contact. Current methods frequently fail to account for scenarios where objects are frequently blocking the view, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxiao Wang , Wenpeng Neng , Zhenao Wei , Yu Lei , Weiying Xue , Nan Zhuang , Yanwu Xu , Xinyu Jiang , Qi Liu

This paper focuses on Human-Object Interaction (HOI) detection, addressing the challenge of identifying and understanding the interactions between humans and objects within a given image or video frame. Spearheaded by Detection Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Mu Chen , Minghan Chen , Yi Yang

Egocentric videos are characterised by their ability to have the first person view. With the popularity of Google Glass and GoPro, use of egocentric videos is on the rise. Recognizing action of the wearer from egocentric videos is an…

Computer Vision and Pattern Recognition · Computer Science 2016-04-08 Suriya Singh , Chetan Arora , C. V. Jawahar

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Bumsoo Kim , Junhyun Lee , Jaewoo Kang , Eun-Sol Kim , Hyunwoo J. Kim

ENIGMA-51 is a new egocentric dataset acquired in an industrial scenario by 19 subjects who followed instructions to complete the repair of electrical boards using industrial tools (e.g., electric screwdriver) and equipments (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Francesco Ragusa , Rosario Leonardi , Michele Mazzamuto , Claudia Bonanno , Rosario Scavo , Antonino Furnari , Giovanni Maria Farinella

With the surge in attention to Egocentric Hand-Object Interaction (Ego-HOI), large-scale datasets such as Ego4D and EPIC-KITCHENS have been proposed. However, most current research is built on resources derived from third-person video…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yue Xu , Yong-Lu Li , Zhemin Huang , Michael Xu Liu , Cewu Lu , Yu-Wing Tai , Chi-Keung Tang

Human-Object Interaction (HOI) detection has received considerable attention in the context of scene understanding. Despite the growing progress on benchmarks, we realize that existing methods often perform unsatisfactorily on distant…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Guangzhi Wang , Yangyang Guo , Yongkang Wong , Mohan Kankanhalli

While Human-Object Interaction(HOI) Detection has achieved tremendous advances in recent, it still remains challenging due to complex interactions with multiple humans and objects occurring in images, which would inevitably lead to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Kunlun Xu , Zhimin Li , Zhijun Zhang , Leizhen Dong , Wenhui Xu , Luxin Yan , Sheng Zhong , Xu Zou

Unlike traditional third-person cameras mounted on robots, a first-person camera, captures a person's visual sensorimotor object interactions from up close. In this paper, we study the tight interplay between our momentary visual attention…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Gedas Bertasius , Hyun Soo Park , Stella X. Yu , Jianbo Shi

Imitation learning from human demonstrations offers a promising approach for robot skill acquisition, but egocentric human data introduces fundamental challenges due to the embodiment gap. During manipulation, humans actively coordinate…

Robotics · Computer Science 2026-03-11 Justin Yu , Yide Shentu , Di Wu , Pieter Abbeel , Ken Goldberg , Philipp Wu

We tackle the challenging problem of human-object interaction (HOI) detection. Existing methods either recognize the interaction of each human-object pair in isolation or perform joint inference based on complex appearance-based features.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Chen Gao , Jiarui Xu , Yuliang Zou , Jia-Bin Huang

The recent advances in instance-level detection tasks lay strong foundation for genuine comprehension of the visual scenes. However, the ability to fully comprehend a social scene is still in its preliminary stage. In this work, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Bingjie Xu , Junnan Li , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Detecting human interactions is crucial for human behavior analysis. Many methods have been proposed to deal with Human-to-Object Interaction (HOI) detection, i.e., detecting in an image which person and object interact together and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Astrid Orcesi , Romaric Audigier , Fritz Poka Toukam , Bertrand Luvison

Egocentric Interactive hand-object segmentation (EgoIHOS) requires the segmentation of hands and interacting objects in egocentric images, which is crucial for understanding human behavior in assistive systems. Previous methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Yuejiao Su , Yi Wang , Lap-Pui Chau

Although First Person Vision systems can sense the environment from the user's perspective, they are generally unable to predict his intentions and goals. Since human activities can be decomposed in terms of atomic actions and interactions…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Antonino Furnari , Sebastiano Battiato , Kristen Grauman , Giovanni Maria Farinella

Human-Object Interaction (HOI), as an important problem in computer vision, requires locating the human-object pair and identifying the interactive relationships between them. The HOI instance has a greater span in spatial, scale, and task…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Shuailei Ma , Yuefeng Wang , Shanze Wang , Ying Wei