English
Related papers

Related papers: Human-to-Human Interaction Detection

200 papers

Understanding how humans interact with each other is key to building realistic multi-human virtual reality systems. This area remains relatively unexplored due to the lack of large-scale datasets. Recent datasets focusing on this issue…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Rawal Khirodkar , Jyun-Ting Song , Jinkun Cao , Zhengyi Luo , Kris Kitani

Generating human-object interactions (HOIs) is critical with the tremendous advances of digital avatars. Existing datasets are typically limited to humans interacting with a single object while neglecting the ubiquitous manipulation of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Xintao Lv , Liang Xu , Yichao Yan , Xin Jin , Congsheng Xu , Shuwen Wu , Yifan Liu , Lincheng Li , Mengxiao Bi , Wenjun Zeng , Xiaokang Yang

Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Hao-Shu Fang , Yichen Xie , Dian Shao , Cewu Lu

Understanding human interaction with objects is an important research topic for embodied Artificial Intelligence and identifying the objects that humans are interacting with is a primary problem for interaction understanding. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yanyan Shao , Qi Ye , Wenhan Luo , Kaihao Zhang , Jiming Chen

Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction; however, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Xubin Zhong , Changxing Ding , Yupeng Hu , Dacheng Tao

Harnessing human movements to command an Unmanned Aerial Vehicle (UAV) holds the potential to revolutionize their deployment, rendering it more intuitive and user-centric. In this research, we introduce a novel methodology adept at…

Robotics · Computer Science 2024-08-20 Akash Chaudhary , Tiago Nascimento , Martin Saska

We introduce the Action Transformer model for recognizing and localizing human actions in video clips. We repurpose a Transformer-style architecture to aggregate features from the spatiotemporal context around the person whose actions we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Rohit Girdhar , João Carreira , Carl Doersch , Andrew Zisserman

Most existing video tasks related to "human" focus on the segmentation of salient humans, ignoring the unspecified others in the video. Few studies have focused on segmenting and tracking all humans in a complex video, including pedestrians…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Ran Yu , Chenyu Tian , Weihao Xia , Xinyuan Zhao , Haoqian Wang , Yujiu Yang

Human action Recognition for unknown views is a challenging task. We propose a view-invariant deep human action recognition framework, which is a novel integration of two important action cues: motion and shape temporal dynamics (STD). The…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Chhavi Dhiman , Dinesh Kumar Vishwakarma

Human-object interaction is one of the most important visual cues and we propose a novel way to represent human-object interactions for egocentric action anticipation. We propose a novel transformer variant to model interactions by…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Debaditya Roy , Ramanathan Rajendiran , Basura Fernando

Complex scenes present significant challenges for predicting human behaviour due to the abundance of interaction information, such as human-human and humanenvironment interactions. These factors complicate the analysis and understanding of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Caiyi Sun , Yujing Sun , Xiao Han , Zemin Yang , Jiawei Liu , Xinge Zhu , Siu Ming Yiu , Yuexin Ma

This paper presents a novel approach in a rarely studied area of computer vision: Human interaction recognition in still images. We explore whether the facial regions and their spatial configurations contribute to the recognition of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-18 Gokhan Tanisik , Cemil Zalluhoglu , Nazli Ikizler-Cinbis

Human-object interaction (HOI) detection aims to locate human-object pairs and identify their interaction categories in images. Most existing methods primarily focus on supervised learning, which relies on extensive manual HOI annotations.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Weiying Xue , Qi Liu , Qiwei Xiong , Yuxiao Wang , Zhenao Wei , Xiaofen Xing , Xiangmin Xu

Identifying human behaviors is a challenging research problem due to the complexity and variation of appearances and postures, the variation of camera settings, and view angles. In this paper, we try to address the problem of human behavior…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Eissa Jaber Alreshidi , Mohammad Bilal

Vision-based activity recognition is essential for security, monitoring and surveillance applications. Further, real-time analysis having low-quality video and contain less information about surrounding due to poor illumination, and…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Tej Singh , Dinesh Kumar Vishwakarma

The Human-Object Interaction (HOI) task explores the dynamic interactions between humans and objects in physical environments, providing essential biomechanical and cognitive-behavioral foundations for fields such as robotics, virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ruiyan Wang , Lin Zuo , Zonghao Lin , Qiang Wang , Zhengxue Cheng , Rong Xie , Jun Ling , Li Song

Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these methods frequently focus…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jihao Dong , Renjie Pan , Hua Yang

Human-Object Interaction (HOI) detection is the task of identifying a set of <human, object, interaction> triplets from an image. Recent work proposed transformer encoder-decoder architectures that successfully eliminated the need for many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Bumsoo Kim , Jonghwan Mun , Kyoung-Woon On , Minchul Shin , Junhyun Lee , Eun-Sol Kim

Natural Human-Robot Interaction (N-HRI) requires robots to recognize human actions at varying distances and states, regardless of whether the robot itself is in motion or stationary. This setup is more flexible and practical than…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Ziyi Wang , Peiming Li , Hong Liu , Zhichao Deng , Can Wang , Jun Liu , Junsong Yuan , Mengyuan Liu

Human-Object Interaction (HOI) detection plays a core role in activity understanding. Though recent two/one-stage methods have achieved impressive results, as an essential step, discovering interactive human-object pairs remains…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Xinpeng Liu , Yong-Lu Li , Xiaoqian Wu , Yu-Wing Tai , Cewu Lu , Chi-Keung Tang