English
Related papers

Related papers: Progressive Cross-modal Knowledge Distillation for…

200 papers

As a fundamental problem in ubiquitous computing and machine learning, sensor-based human activity recognition (HAR) has drawn extensive attention and made great progress in recent years. HAR aims to recognize human activities based on the…

Signal Processing · Electrical Eng. & Systems 2022-03-01 Yimu Wang , Kun Yu , Yan Wang , Hui Xue

Human action recognition has been widely used in many fields of life, and many human action datasets have been published at the same time. However, most of the multi-modal databases have some shortcomings in the layout and number of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Xin Chao , Zhenjie Hou , Yujian Mo

Human activity recognition (HAR) holds immense potential for transforming health and fitness monitoring, yet challenges persist in achieving personalized outcomes and sustainability for on-device continuous inferences. This work introduces…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Bidyut Saha , Riya Samanta , Soumya K Ghosh , Ram Babu Roy

To reduce a model size but retain performance, we often rely on knowledge distillation (KD) which transfers knowledge from a large "teacher" model to a smaller "student" model. However, KD on multimodal datasets such as vision-language…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Woojeong Jin , Maziar Sanjabi , Shaoliang Nie , Liang Tan , Xiang Ren , Hamed Firooz

Traditional human activity recognition (HAR) based on time series adopts sliding window analysis method. This method faces the multi-class window problem which mistakenly labels different classes of sampling points within a window as a…

Machine Learning · Computer Science 2018-09-24 Yong Zhang , Yu Zhang , Zhao Zhang , Jie Bao , Yunpeng Song

Unsupervised user adaptation aligns the feature distributions of the data from training users and the new user, so a well-trained wearable human activity recognition (WHAR) model can be well adapted to the new user. With the development of…

Signal Processing · Electrical Eng. & Systems 2022-04-28 Ling Chen , Yi Zhang , Shenghuan Miao , Sirou Zhu , Rong Hu , Liangying Peng , Mingqi Lv

In precision sports such as archery, athletes' performance depends on both biomechanical stability and psychological resilience. Traditional motion analysis systems are often expensive and intrusive, limiting their use in natural training…

Machine Learning · Computer Science 2025-11-19 Xianghe Liu , Jiajia Liu , Chuxian Xu , Minghan Wang , Hongbo Peng , Tao Sun , Jiaqi Xu

In this paper, we propose a self-supervised learning solution for human activity recognition with smartphone accelerometer data. We aim to develop a model that learns strong representations from accelerometer signals, in order to perform…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Setareh Rahimi Taghanaki , Michael Rainbow , Ali Etemad

Many deep architectures and self-supervised pre-training techniques have been proposed for human activity recognition (HAR) from wearable multimodal sensors. Scaling laws have the potential to help move towards more principled design by…

Machine Learning · Computer Science 2025-05-22 Tom Hoddes , Alex Bijamov , Saket Joshi , Daniel Roggen , Ali Etemad , Robert Harle , David Racz

Human activity recognition (HAR) based on multimodal sensors has become a rapidly growing branch of biometric recognition and artificial intelligence. However, how to fully mine multimodal time series data and effectively learn accurate…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Jialiang Wang , Haotian Wei , Yi Wang , Shu Yang , Chi Li

Multi-modal RGB and Depth (RGBD) data are predominant in many domains such as robotics, autonomous driving and remote sensing. The combination of these multi-modal data enhances environmental perception by providing 3D spatial context,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Roger Ferrod , Cássio F. Dantas , Luigi Di Caro , Dino Ienco

Human Activity Recognition (HAR) has seen significant advancements with the adoption of deep learning techniques, yet challenges remain in terms of data requirements, reliability and robustness. This paper explores a novel application of…

Machine Learning · Computer Science 2025-09-11 Matthew Nolan , Lina Yao , Robert Davidson

This paper explores the promising interplay between spiking neural networks (SNNs) and event-based cameras for privacy-preserving human action recognition (HAR). The unique feature of event cameras in capturing only the outlines of motion,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Siyuan Yang , Shilin Lu , Shizheng Wang , Meng Hwa Er , Zengwei Zheng , Alex C. Kot

Autonomous systems have advanced significantly, but challenges persist in accident-prone environments where robust decision-making is crucial. A single vehicle's limited sensor range and obstructed views increase the likelihood of…

Artificial Intelligence · Computer Science 2025-09-24 Rui Liu , Zikang Wang , Peng Gao , Yu Shen , Pratap Tokekar , Ming Lin

Wearable Human Activity Recognition (WHAR) is a prominent research area within ubiquitous computing. Multi-sensor synchronous measurement has proven to be more effective for WHAR than using a single sensor. However, existing WHAR methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Haoyu Xie , Haoxuan Li , Chunyuan Zheng , Haonan Yuan , Guorui Liao , Jun Liao , Li Liu

Various types of sensors have been considered to develop human action recognition (HAR) models. Robust HAR performance can be achieved by fusing multimodal data acquired by different sensors. In this paper, we introduce a new multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Kyoung Ok Yang , Junho Koh , Jun Won Choi

Human activity recognition (HAR) based on mobile sensors plays an important role in ubiquitous computing. However, the rise of data regulatory constraints precludes collecting private and labeled signal data from personal devices at scale.…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Chenglin Li , Di Niu , Bei Jiang , Xiao Zuo , Jianming Yang

Multimodal human action recognition based on RGB and skeleton data fusion, while effective, is constrained by significant limitations such as high computational complexity, excessive memory consumption, and substantial energy demands,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Naichuan Zheng , Hailun Xia , Zeyu Liang , Yuchen Du

Musculoskeletal injuries during military training significantly impact readiness, making prevention through activity monitoring crucial. While Human Activity Recognition (HAR) using wearable devices offers promising solutions, it faces…

Machine Learning · Computer Science 2025-04-30 Barak Gahtan , Shany Funk , Einat Kodesh , Itay Ketko , Tsvi Kuflik , Alex M. Bronstein

Human Activity Recognition (HAR) is an ongoing research topic. It has applications in medical support, sports, fitness, social networking, human-computer interfaces, senior care, entertainment, surveillance, and the list goes on.…

Human-Computer Interaction · Computer Science 2021-11-11 Hamza Ali Imran , Saad Wazir , Usman Iftikhar , Usama Latif