English
Related papers

Related papers: Human Activity Recognition using RGB-Event based S…

200 papers

This paper presents a novel multimodal human activity recognition system. It uses a two-stream decision level fusion of vision and inertial sensors. In the first stream, raw RGB frames are passed to a part affinity field-based pose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Santosh Kumar Yadav , Muhtashim Rafiqi , Egna Praneeth Gummana , Kamlesh Tiwari , Hari Mohan Pandey , Shaik Ali Akbara

Feature extraction is crucial for human activity recognition (HAR) using body-worn movement sensors. Recently, learned representations have been used successfully, offering promising alternatives to manually engineered features. Our work…

Machine Learning · Computer Science 2020-12-11 Harish Haresamudram , Irfan Essa , Thomas Ploetz

This paper proposes a hybrid fusion-based deep learning approach based on two different modalities, audio and video, to improve human activity recognition and violence detection in public places. To take advantage of audiovisual fusion,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Pooya Janani , Amirabolfazl Suratgar , Afshin Taghvaeipour

Limited access to medical infrastructure forces elderly and vulnerable patients to rely on home-based care, often leading to neglect and poor adherence to therapeutic exercises such as yoga or physiotherapy. To address this gap, we propose…

Machine Learning · Computer Science 2026-02-02 Ramakant Kumar , Pravin Kumar

Humans naturally follow distinct patterns when conducting their daily activities, which are driven by established practices and processes, such as production workflows, social norms and daily routines. Human activity recognition (HAR)…

Artificial Intelligence · Computer Science 2024-11-14 Jiawei Zheng , Petros Papapanagiotou , Jacques D. Fleuriot , Jane Hillston

Human activity recognition (HAR) based on mobile sensors plays an important role in ubiquitous computing. However, the rise of data regulatory constraints precludes collecting private and labeled signal data from personal devices at scale.…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Chenglin Li , Di Niu , Bei Jiang , Xiao Zuo , Jianming Yang

Human action recognition is a well-known computer vision and pattern recognition task of identifying which action a man is actually doing. Extracting the keypoint information of a single human with both spatial and temporal features of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Yuke , Yang

Actions are about how we interact with the environment, including other people, objects, and ourselves. In this paper, we propose a novel multi-modal Holistic Interaction Transformer Network (HIT) that leverages the largely ignored, but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Gueter Josmy Faure , Min-Hung Chen , Shang-Hong Lai

Recognizing human actions in video sequences, known as Human Action Recognition (HAR), is a challenging task in pattern recognition. While Convolutional Neural Networks (ConvNets) have shown remarkable success in image recognition, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Nguyen Huu Phong , Bernardete Ribeiro

Human activity recognition (HAR) in Internet of Things (IoT) environments must cope with heterogeneous sensor settings that vary across datasets, devices, body locations, sensing modalities, and channel compositions. This heterogeneity…

Machine Learning · Computer Science 2026-04-24 Tatsuhito Hasegawa

Human Activity Recognition (HAR) using deep neural network has become a hot topic in human-computer interaction. Machine can effectively identify human naturalistic activities by learning from a large collection of sensor data. Activity…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Jun Long , WuQing Sun , Zhan Yang , Osolo Ian Raymond

Human Activity Recognition (HAR) is a challenging, multi-label classification problem as activities may co-occur and sensor signals corresponding to the same activity may vary in different contexts (e.g., different device placements). This…

Machine Learning · Computer Science 2024-09-30 Wen Ge , Guanyi Mou , Emmanuel O. Agu , Kyumin Lee

This paper presents a comprehensive dataset intended to evaluate passive Human Activity Recognition (HAR) and localization techniques with measurements obtained from synchronized Radio-Frequency (RF) devices and vision-based sensors. The…

Transformers have excelled in natural language processing and computer vision, paving their way to sensor-based Human Activity Recognition (HAR). Previous studies show that transformers outperform their counterparts exclusively when they…

Machine Learning · Computer Science 2024-10-18 Clayton Souza Leite , Henry Mauranen , Aziza Zhanabatyrova , Yu Xiao

Using supervised machine learning approaches to recognize human activities from on-body wearable accelerometers generally requires a large amount of labelled data. When ground truth information is not available, too expensive, time…

Machine Learning · Statistics 2013-12-30 Dorra Trabelsi , Samer Mohammed , Faicel Chamroukhi , Latifa Oukhellou , Yacine Amirat

Reinforcement learning in large reasoning models enables learning from feedback on their outputs, making it particularly valuable in scenarios where fine-tuning data is limited. However, its application in multi-modal human activity…

Robotics · Computer Science 2025-08-15 Wenqi Zheng , Yutaka Arakawa

In human activity recognition (HAR), activity labels have typically been encoded in one-hot format, which has a recent shift towards using textual representations to provide contextual knowledge. Here, we argue that HAR should be anchored…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Shuheng Li , Jiayun Zhang , Xiaohan Fu , Xiyuan Zhang , Jingbo Shang , Rajesh K. Gupta

Human Activity Recognition supports applications in healthcare, manufacturing, and human-machine interaction. LiDAR point clouds offer a privacy-preserving alternative to cameras and are robust to illumination. We propose a HAR method based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sasan Sharifipour , Constantino Álvarez Casado , Le Nguyen , Tharindu Ekanayake , Manuel Lage Cañellas , Nhi Nguyen , Miguel Bordallo López

Action recognition from video data forms a cornerstone with wide-ranging applications. Single-view action recognition faces limitations due to its reliance on a single viewpoint. In contrast, multi-view approaches capture complementary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yue Gao , Jiaxuan Lu , Siqi Li , Yipeng Li , Shaoyi Du

The increasing adoption of human-robot interaction presents opportunities for technology to positively impact lives, particularly those with visual impairments, through applications such as guide-dog-like assistive robotics. We present a…

Robotics · Computer Science 2024-08-27 Adam Scicluna , Cedric Le Gentil , Sheila Sutjipto , Gavin Paul