English
Related papers

Related papers: Holistic Interaction Transformer Network for Actio…

200 papers

Human Activity Recognition (HAR) is one of the essential building blocks of so many applications like security, monitoring, the internet of things and human-robot interaction. The research community has developed various methodologies to…

Human-Computer Interaction · Computer Science 2022-06-10 Farhad Nazari , Navid Mohajer , Darius Nahavandi , Abbas Khosravi , Saeid Nahavandi

Human action understanding is a fundamental and challenging task in computer vision. Although there exists tremendous research on this area, most works focus on action recognition, while action retrieval has received less attention. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Hongsong Wang , Jianhua Zhao , Jie Gui

Many skeletal action recognition models use GCNs to represent the human body by 3D body joints connected body parts. GCNs aggregate one- or few-hop graph neighbourhoods, and ignore the dependency between not linked body joints. We propose…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Lei Wang , Piotr Koniusz

Human-centric anomaly detection (AD) has been primarily studied to specify anomalous behaviors in a single person. However, as humans by nature tend to act in a collaborative manner, behavioral anomalies can also arise from human-human…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shun Maeda , Chunzhi Gu , Koichiro Kamide , Katsuya Hotta , Shangce Gao , Chao Zhang

Human action recognition (HAR) in videos has garnered widespread attention due to the rich information in RGB videos. Nevertheless, existing methods for extracting deep features from RGB videos face challenges such as information…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mengyuan Liu , Jinfu Liu , Yongkang Jiang , Bin He

Robots are becoming increasingly integrated into our lives, assisting us in various tasks. To ensure effective collaboration between humans and robots, it is essential that they understand our intentions and anticipate our actions. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Esteve Valls Mascaro , Daniel Sliwowski , Dongheui Lee

Salient object detection (SOD) focuses on distinguishing the most conspicuous objects in the scene. However, most related works are based on RGB images, which lose massive useful information. Accordingly, with the maturity of thermal…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yuxuan Wang , Feng Dong , Jinchao Zhu

In open-world environments, human-object interactions (HOIs) evolve continuously, challenging conventional closed-world HOI detection models. Inspired by humans' ability to progressively acquire knowledge, we explore incremental HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yana Wei , Zeen Chi , Chongyu Wang , Yu Wu , Shipeng Yan , Yongfei Liu , Xuming He

Imitation Learning (IL) is an effective framework to learn visuomotor skills from offline demonstration data. However, IL methods often fail to generalize to new scene configurations not covered by training data. On the other hand, humans…

Robotics · Computer Science 2021-08-18 Chen Wang , Rui Wang , Ajay Mandlekar , Li Fei-Fei , Silvio Savarese , Danfei Xu

Human-Object Interaction (HOI) detection aims to detect visual relations between human and objects in images. One significant problem of HOI detection is that non-interactive human-object pair can be easily mis-grouped and misclassified as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lu Liu , Robby T. Tan

We study in this paper the problem of novel human-object interaction (HOI) detection, aiming at improving the generalization ability of the model to unseen scenarios. The challenge mainly stems from the large compositional space of objects…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Yuhang Song , Wenbo Li , Lei Zhang , Jianwei Yang , Emre Kiciman , Hamid Palangi , Jianfeng Gao , C. -C. Jay Kuo , Pengchuan Zhang

Human action or activity recognition in videos is a fundamental task in computer vision with applications in surveillance and monitoring, self-driving cars, sports analytics, human-robot interaction and many more. Traditional supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Sharana Dharshikgan Suresh Dass , Hrishav Bakul Barua , Ganesh Krishnasamy , Raveendran Paramesran , Raphael C. -W. Phan

This paper focuses on Human-Object Interaction (HOI) detection, addressing the challenge of identifying and understanding the interactions between humans and objects within a given image or video frame. Spearheaded by Detection Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Mu Chen , Minghan Chen , Yi Yang

This paper attempts at improving the accuracy of Human Action Recognition (HAR) by fusion of depth and inertial sensor data. Firstly, we transform the depth data into Sequential Front view Images(SFI) and fine-tune the pre-trained AlexNet…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Zeeshan Ahmad , Naimul Khan

The mainstream human activity recognition (HAR) algorithms are developed based on RGB cameras, which are easily influenced by low-quality images (e.g., low illumination, motion blur). Meanwhile, the privacy protection issue caused by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Haoxiang Yang , Chengguo Yuan , Yabin Zhu , Lan Chen , Xiao Wang , Futian Wang

Objects are entities we act upon, where the functionality of an object is determined by how we interact with it. In this work we propose a Dual Attention Network model which reasons about human-object interactions. The dual-attentional…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Tete Xiao , Quanfu Fan , Dan Gutfreund , Mathew Monfort , Aude Oliva , Bolei Zhou

We present a dual-pathway approach for recognizing fine-grained interactions from videos. We build on the success of prior dual-stream approaches, but make a distinction between the static and dynamic representations of objects and their…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Tae Soo Kim , Jonathan Jones , Gregory D. Hager

Multispectral pedestrian detection has gained significant attention in recent years, particularly in autonomous driving applications. To address the challenges posed by adversarial illumination conditions, the combination of thermal and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Arunkumar Rathinam , Leo Pauly , Abd El Rahman Shabayek , Wassim Rharbaoui , Anis Kacem , Vincent Gaudillière , Djamila Aouada

In this paper, we propose Two-Stream AMTnet, which leverages recent advances in video-based action representation[1] and incremental action tube generation[2]. Majority of the present action detectors follow a frame-based representation, a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Suman Saha , Gurkirt Singh , Fabio Cuzzolin

Human-object interaction (HOI) detection aims to detect interactions between humans and objects in images. While recent advances have improved performance on existing benchmarks, their evaluations mainly focus on overall prediction accuracy…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Lemeng Wang , Qinqian Lei , Vidhi Bakshi , Daniel Yi , Yifan Liu , Jiacheng Hou , Asher Seng Hao , Zheda Mai , Wei-Lun Chao , Robby T. Tan , Bo Wang