English
Related papers

Related papers: Glance and Gaze: Inferring Action-aware Points for…

200 papers

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects. Latest end-to-end HOI detectors are short of relation reasoning, which leads to inability to learn HOI-specific interactive semantics…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Dongming Yang , Yuexian Zou , Can Zhang , Meng Cao , Jie Chen

Detecting human-object interactions is essential for comprehensive understanding of visual scenes. In particular, spatial connections between humans and objects are important cues for reasoning interactions. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Manli Zhu , Edmond S. L. Ho , Hubert P. H. Shum

The task of Human-Object Interaction (HOI) detection is to detect humans and their interactions with surrounding objects, where transformer-based methods show dominant advances currently. However, these methods ignore the relationship among…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shuman Fang , Zhiwen Lin , Ke Yan , Jie Li , Xianming Lin , Rongrong Ji

Reasoning human object interactions is a core problem in human-centric scene understanding and detecting such relations poses a unique challenge to vision systems due to large variations in human-object configurations, multiple co-occurring…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Bo Wan , Desen Zhou , Yongfei Liu , Rongjie Li , Xuming He

Human-object interaction(HOI) detection is a critical task in scene understanding. The goal is to infer the triplet <subject, predicate, object> in a scene. In this work, we note that the human pose itself as well as the relative spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Zhijun Liang , Junfa Liu , Yisheng Guan , Juan Rojas

Human-Object Interaction (HOI) detection is a fundamental task in image understanding. While deep-learning-based HOI methods provide high performance in terms of mean Average Precision (mAP), they are computationally expensive and opaque in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Tsung-Shan Yang , Yun-Cheng Wang , Chengwei Wei , Suya You , C. -C. Jay Kuo

Human-Computer Interaction(HCI) is a field that studies interactions between human users and computer systems. With the development of HCI, individuals or groups of people can use various digital technologies to achieve the optimal user…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Hoyeon Ahn

The recent advances in instance-level detection tasks lay strong foundation for genuine comprehension of the visual scenes. However, the ability to fully comprehend a social scene is still in its preliminary stage. In this work, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Bingjie Xu , Junnan Li , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Unlike traditional third-person cameras mounted on robots, a first-person camera, captures a person's visual sensorimotor object interactions from up close. In this paper, we study the tight interplay between our momentary visual attention…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Gedas Bertasius , Hyun Soo Park , Stella X. Yu , Jianbo Shi

Gait recognition is widely used in diversified practical applications. Currently, the most prevalent approach is to recognize human gait from RGB images, owing to the progress of computer vision technologies. Nevertheless, the perception…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Yanyan Huang , Yong Wang , Kun Shi , Chaojie Gu , Yu Fu , Cheng Zhuo , Zhiguo Shi

We study the problem of detecting human-object interactions (HOI) in static images, defined as predicting a human and an object bounding box with an interaction class label that connects them. HOI detection is a fundamental problem in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Yu-Wei Chao , Yunfan Liu , Xieyang Liu , Huayi Zeng , Jia Deng

Recent works on two-stage cross-domain detection have widely explored the local feature patterns to achieve more accurate adaptation results. These methods heavily rely on the region proposal mechanisms and ROI-based instance-level features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Chaoqi Chen , Zebiao Zheng , Yue Huang , Xinghao Ding , Yizhou Yu

We address the challenging task of anticipating human-object interaction in first person videos. Most existing methods ignore how the camera wearer interacts with the objects, or simply consider body motion as a separate modality. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Miao Liu , Siyu Tang , Yin Li , James Rehg

Graph convolutional networks (GCNs), which can model the human body skeletons as spatial and temporal graphs, have shown remarkable potential in skeleton-based action recognition. However, in the existing GCN-based methods, graph-structured…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Han Chen , Yifan Jiang , Hanseok Ko

We propose a single-stage Human-Object Interaction (HOI) detection method that has outperformed all existing methods on HICO-DET dataset at 37 fps on a single Titan XP GPU. It is the first real-time HOI detection method. Conventional HOI…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Yue Liao , Si Liu , Fei Wang , Yanjie Chen , Chen Qian , Jiashi Feng

Recent one-stage object detectors follow a per-pixel prediction approach that predicts both the object category scores and boundary positions from every single grid location. However, the most suitable positions for inferring different…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Li Yang , Yan Xu , Shaoru Wang , Chunfeng Yuan , Ziqi Zhang , Bing Li , Weiming Hu

Egocentric Human-Object Interaction (EHOI) analysis is crucial for industrial safety, yet the development of robust models is hindered by the scarcity of annotated domain-specific data. We address this challenge by introducing a data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Alfio Spoto , Rosario Leonardi , Francesco Ragusa , Giovanni Maria Farinella

Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these methods frequently focus…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jihao Dong , Renjie Pan , Hua Yang

Gaze plays a crucial role in revealing human attention and intention, particularly in hand-object interaction scenarios, where it guides and synchronizes complex tasks that require precise coordination between the brain, hand, and object.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jie Tian , Ran Ji , Lingxiao Yang , Suting Ni , Yuexin Ma , Lan Xu , Jingyi Yu , Ye Shi , Jingya Wang

Zero-shot action recognition can recognize samples of unseen classes that are unavailable in training by exploring common latent semantic representation in samples. However, most methods neglected the connotative relation and extensional…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Bin Sun , Dehui Kong , Shaofan Wang , Jinghua Li , Baocai Yin , Xiaonan Luo