English
Related papers

Related papers: Progressive Cross-modal Knowledge Distillation for…

200 papers

Self-supervised representation learning for human action recognition has developed rapidly in recent years. Most of the existing works are based on skeleton data while using a multi-modality setup. These works overlooked the differences in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Yiping Wei , Kunyu Peng , Alina Roitberg , Jiaming Zhang , Junwei Zheng , Ruiping Liu , Yufan Chen , Kailun Yang , Rainer Stiefelhagen

Ensuring the safety and well-being of elderly and vulnerable populations in assisted living environments is a critical concern. Computer vision presents an innovative and powerful approach to predicting health risks through video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yixuan Wang , Paul Stynes , Pramod Pathak , Cristina Muntean

Human activity recognition (HAR) will be an essential function of various emerging applications. However, HAR typically encounters challenges related to modality limitations and label scarcity, leading to an application gap between current…

Machine Learning · Computer Science 2024-04-03 Lilin Xu , Chaojie Gu , Rui Tan , Shibo He , Jiming Chen

Human action recognition (HAR) with multi-modal inputs (RGB-D, skeleton, point cloud) can achieve high accuracy but typically relies on large labeled datasets and degrades sharply when sensors fail or are noisy. We present Robust…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Hasan Akgul , Mari Eplik , Javier Rojas , Akira Yamamoto , Rajesh Kumar , Maya Singh

Human Activity Recognition (HAR) primarily relied on traditional RGB cameras to achieve high-performance activity recognition. However, the challenging factors in real-world scenarios, such as insufficient lighting and rapid movements,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Shiao Wang , Xiao Wang , Bo Jiang , Lin Zhu , Guoqi Li , Yaowei Wang , Yonghong Tian , Jin Tang

Transformers have excelled in natural language processing and computer vision, paving their way to sensor-based Human Activity Recognition (HAR). Previous studies show that transformers outperform their counterparts exclusively when they…

Machine Learning · Computer Science 2024-10-18 Clayton Souza Leite , Henry Mauranen , Aziza Zhanabatyrova , Yu Xiao

Multimodal sentiment analysis (MSA) systems leverage information from different modalities to predict human sentiment intensities. Incomplete modality is an important issue that may cause a significant performance drop in MSA systems. By…

Multimedia · Computer Science 2024-10-14 Zhongyi Sang , Kotaro Funakoshi , Manabu Okumura

Skeleton-based action recognition leverages human pose keypoints to categorize human actions, which shows superior generalization and interoperability compared to regular end-to-end action recognition. Existing solutions use RGB cameras to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shunyu Huang , Yunjiao Zhou , Jianfei Yang

Human Activity Recognition (HAR) with wearable sensors is challenged by limited interpretability, which significantly impacts cross-dataset generalization. To address this challenge, we propose Motion-Primitive Transformer (MoPFormer), a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Hao Zhang , Zhan Zhuang , Xuehao Wang , Xiaodong Yang , Yu Zhang

Recent human activity recognition (HAR) methods, based on on-body inertial sensors, have achieved increasing performance; however, this is at the expense of longer CPU calculations and greater energy consumption. Therefore, these complex…

Computers and Society · Computer Science 2018-09-26 Roman Chereshnev , Attila Kertesz-Farkas

Knowledge distillation (KD) is a simple and successful method to transfer knowledge from a teacher to a student model solely based on functional activity. However, current KD has a few shortcomings: it has recently been shown that this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Arne F. Nix , Max F. Burg , Fabian H. Sinz

In 3D action recognition, there exists rich complementary information between skeleton modalities. Nevertheless, how to model and utilize this information remains a challenging problem for self-supervised 3D action representation learning.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Yunyao Mao , Wengang Zhou , Zhenbo Lu , Jiajun Deng , Houqiang Li

Despite the widespread integration of ambient light sensors (ALS) in smart devices commonly used for screen brightness adaptation, their application in human activity recognition (HAR), primarily through body-worn ALS, is largely…

Artificial Intelligence · Computer Science 2024-08-23 Lala Shakti Swarup Ray , Daniel Geißler , Mengxi Liu , Bo Zhou , Sungho Suh , Paul Lukowicz

Human activity recognition (HAR) in ubiquitous computing is beginning to adopt deep learning to substitute for well-established analysis techniques that rely on hand-crafted feature extraction and classification techniques. From these…

Machine Learning · Computer Science 2016-05-02 Nils Y. Hammerla , Shane Halloran , Thomas Ploetz

In order to unlock the potential of diverse sensors, we investigate a method to transfer knowledge between time-series modalities using a multimodal \textit{temporal} representation space for Human Activity Recognition (HAR). Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Abhi Kamboj , Anh Duy Nguyen , Minh N. Do

Human action recognition (HAR) in videos is a fundamental research topic in computer vision. It consists mainly in understanding actions performed by humans based on a sequence of visual observations. In recent years, HAR have witnessed…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Soufiane Lamghari , Guillaume-Alexandre Bilodeau , Nicolas Saunier

Knowledge Distillation (KD) has been validated as an effective model compression technique for learning compact object detectors. Existing state-of-the-art KD methods for object detection are mostly based on feature imitation. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jiabao Wang , Yuming Chen , Zhaohui Zheng , Xiang Li , Ming-Ming Cheng , Qibin Hou

There has been much recent research on human activity re\-cog\-ni\-tion (HAR), due to the proliferation of wearable sensors in watches and phones, and the advances of deep learning methods, which avoid the need to manually extract features…

Machine Learning · Computer Science 2022-09-20 Louis Mahon , Thomas Lukasiewicz

Sensor-based Human Activity Recognition (HAR) underpins many ubiquitous and wearable computing applications, yet current models remain limited by scarce labels, sensor heterogeneity, and weak generalization across users, devices, and…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Sizhen Bian , Mengxi Liu , Lala Shakti Swarup Ray , Bo Zhou , Bin Guo , Zhiwen Yu , Thomas Ploetz , Paul Lukowicz , Siyu Yuan , Vitor Fortes Rey

Deep learning methods have achieved a lot of success in various applications involving converting wearable sensor data to actionable health insights. A common application areas is activity recognition, where deep-learning methods still…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Eun Som Jeon , Hongjun Choi , Ankita Shukla , Yuan Wang , Hyunglae Lee , Matthew P. Buman , Pavan Turaga