English
Related papers

Related papers: IMUGPT 2.0: Language-Based Cross Modality Transfer…

200 papers

Despite living in a multi-sensory world, most AI models are limited to textual and visual understanding of human motion and behavior. In fact, full situational awareness of human motion could best be understood through a combination of…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Abhi Kamboj , Minh Do

The development of robust, generalized models in human activity recognition (HAR) has been hindered by the scarcity of large-scale, labeled data sets. Recent work has shown that virtual IMU data extracted from videos using computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Zikang Leng , Hyeokhyen Kwon , Thomas Plötz

Human Activity Recognition (HAR) using Inertial Measurement Unit (IMU) sensors is critical for applications in healthcare, safety, and industrial production. However, variations in activity patterns, device types, and sensor placements…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Hua Yan , Heng Tan , Yi Ding , Pengfei Zhou , Vinod Namboodiri , Yu Yang

As a critical component of Wearable AI, IMU-based Human Activity Recognition (HAR) has attracted increasing attention from both academia and industry in recent years. Although HAR performance has improved considerably in specific scenarios,…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Yize Cai , Baoshen Guo , Flora Salim , Zhiqing Hong

The lack of large-scale, labeled data sets impedes progress in developing robust and generalized predictive models for on-body sensor-based human activity recognition (HAR). Labeled data in human activity recognition is scarce and hard to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Hyeokhyen Kwon , Catherine Tong , Harish Haresamudram , Yan Gao , Gregory D. Abowd , Nicholas D. Lane , Thomas Ploetz

The ubiquitous availability of smartphones and smartwatches with integrated inertial measurement units (IMUs) enables straightforward capturing of human activities. For specific applications of sensor based human activity recognition (HAR),…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Megha Thukral , Harish Haresamudram , Thomas Ploetz

Human activity recognition (HAR) is often limited by the scarcity of labeled datasets due to the high cost and complexity of real-world data collection. To mitigate this, recent work has explored generating virtual inertial measurement unit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Zikang Leng , Archith Iyer , Thomas Plötz

Human Activity Recognition (HAR) based on wearable inertial sensors plays a critical role in remote health monitoring. In patients with movement disorders, the ability to detect abnormal patient movements in their home environments can…

Sensor-based human activity recognition (HAR) is now a research hotspot in multiple application areas. With the rise of smart wearable devices equipped with inertial measurement units (IMUs), researchers begin to utilize IMU data for HAR.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Fanyi Xiao , Ling Pei , Lei Chu , Danping Zou , Wenxian Yu , Yifan Zhu , Tao Li

Human Activity Recognition (HAR) from wearable sensor data identifies movements or activities in unconstrained environments. HAR is a challenging problem as it presents great variability across subjects. Obtaining large amounts of labelled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Arttu Lämsä , Jaakko Tervonen , Jussi Liikka , Constantino Álvarez Casado , Miguel Bordallo López

In human activity recognition (HAR), the limited availability of annotated data presents a significant challenge. Drawing inspiration from the latest advancements in generative AI, including Large Language Models (LLMs) and motion synthesis…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Zikang Leng , Hyeokhyen Kwon , Thomas Plötz

Together with the rapid development of the Internet of Things (IoT), human activity recognition (HAR) using wearable Inertial Measurement Units (IMUs) becomes a promising technology for many research areas. Recently, deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Ling Pei , Songpengcheng Xia , Lei Chu , Fanyi Xiao , Qi Wu , Wenxian Yu , Robert Qiu

Previous work has demonstrated that virtual accelerometry data, extracted from videos using cross-modality transfer approaches like IMUTube, is beneficial for training complex and effective human activity recognition (HAR) models. Systems…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zikang Leng , Yash Jain , Hyeokhyen Kwon , Thomas Plötz

We introduce SensorLLM, a two-stage framework that enables Large Language Models (LLMs) to perform human activity recognition (HAR) from sensor time-series data. Despite their strong reasoning and generalization capabilities, LLMs remain…

Computation and Language · Computer Science 2025-08-26 Zechen Li , Shohreh Deldari , Linyao Chen , Hao Xue , Flora D. Salim

Inertial Measurement Unit (IMU) sensors are widely employed for Human Activity Recognition (HAR) due to their portability, energy efficiency, and growing research interest. However, a significant challenge for IMU-HAR models is achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qi Qiu , Tao Zhu , Furong Duan , Kevin I-Kai Wang , Liming Chen , Mingxing Nie , Mingxing Nie

Cross-dataset Human Activity Recognition (HAR) suffers from limited model generalization, hindering its practical deployment. To address this critical challenge, inspired by the success of DoReMi in Large Language Models (LLMs), we…

Machine Learning · Computer Science 2025-03-19 Lulu Ban , Tao Zhu , Xiangqing Lu , Qi Qiu , Wenyong Han , Shuangjian Li , Liming Chen , Kevin I-Kai Wang , Mingxing Nie , Yaping Wan

Multimodal human action recognition (HAR) leverages complementary sensors for activity classification. Beyond recognition, recent advances in large language models (LLMs) enable detailed descriptions and causal reasoning, motivating new…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siyang Jiang , Mu Yuan , Xiang Ji , Bufang Yang , Zeyu Liu , Lilin Xu , Yang Li , Yuting He , Liran Dong , Wenrui Lu , Zhenyu Yan , Xiaofan Jiang , Wei Gao , Hongkai Chen , Guoliang Xing

Human activity recognition (HAR) using inertial measurement units (IMUs) increasingly leverages large language models (LLMs), yet existing approaches focus on coarse activities like walking or running. Our preliminary study indicates that…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Lilin Xu , Kaiyuan Hou , Xiaofan Jiang

To properly assist humans in their needs, human activity recognition (HAR) systems need the ability to fuse information from multiple modalities. Our hypothesis is that multimodal sensors, visual and non-visual tend to provide complementary…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Hyeongju Choi , Apoorva Beedu , Harish Haresamudram , Irfan Essa

Human Activity Recognition (HAR) is a fundamental technology for numerous human - centered intelligent applications. Although deep learning methods have been utilized to accelerate feature extraction, issues such as multimodal data mixing,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Ying Yu , Siyao Li , Yixuan Jiang , Hang Xiao , Jingxi Long , Haotian Tang , Hanyu Liu , Chao Li
‹ Prev 1 2 3 10 Next ›