English
Related papers

Related papers: IMUGPT 2.0: Language-Based Cross Modality Transfer…

200 papers

Inertial Measurement Unit (IMU)-based Human Activity Recognition (HAR) aims to interpret and classify user behaviors from temporal motion signals. Recently, deep learning frameworks have advanced this task by learning and extracting…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Peng Liao , Shangsong Liang , Lin Chen , Peijia Zheng

The astonishing success of Large Language Models (LLMs) in Natural Language Processing (NLP) has spurred their use in many application domains beyond text analysis, including wearable sensor-based Human Activity Recognition (HAR). In such…

Machine Learning · Computer Science 2024-06-11 Harish Haresamudram , Hrudhai Rajasekhar , Nikhil Murlidhar Shanbhogue , Thomas Ploetz

Vision-based human activity recognition (HAR) has made substantial progress in recognizing predefined gestures but lacks adaptability for emerging activities. This paper introduces a paradigm shift by harnessing generative modeling and…

Human-Computer Interaction · Computer Science 2023-12-13 Nikhil Kashyap , Manas Satish Bedmutha , Prerit Chaudhary , Brian Wood , Wanda Pratt , Janice Sabin , Andrea Hartzler , Nadir Weibel

Human Activity Recognition (HAR) is one of the central problems in fields such as healthcare, elderly care, and security at home. However, traditional HAR approaches face challenges including data scarcity, difficulties in model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xi Chen , Julien Cumin , Fano Ramparany , Dominique Vaufreydaz

Sensor-based human activity recognition (HAR) has been an active research area, owing to its applications in smart environments, assisted living, fitness, healthcare, etc. Recently, deep learning based end-to-end training has resulted in…

Machine Learning · Computer Science 2024-01-19 Sourish Gunesh Dhekane , Thomas Ploetz

Large Language Models (LLMs) have emerged as foundation models for IoT applications such as human activity recognition (HAR). However, directly applying high-frequency and multi-dimensional sensor data, such as eye-tracking data, leads to…

Human-Computer Interaction · Computer Science 2026-04-14 Jae Young Choi , Seon Gyeom Kim , Hyungjun Yoon , Taeckyung Lee , Donggun Lee , Jaeryung Chung , Jihyung Kil , Ryan Rossi , Sung-Ju Lee , Tak Yeon Lee

Human Activity Recognition (HAR) has been an active area of research, with applications ranging from healthcare to smart environments. The recent advancements in Large Language Models (LLMs) have opened new possibilities to leverage their…

Machine Learning · Computer Science 2025-12-24 Md Shakhrul Iman Siam , Ishtiaque Ahmed Showmik , Guanqun Song , Ting Zhu

In order to unlock the potential of diverse sensors, we investigate a method to transfer knowledge between time-series modalities using a multimodal \textit{temporal} representation space for Human Activity Recognition (HAR). Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Abhi Kamboj , Anh Duy Nguyen , Minh N. Do

Human Activity Recognition (HAR) is a core task in pervasive computing systems, where models must operate under strict computational constraints while remaining robust to heterogeneous and evolving deployment conditions. Recent advances…

Machine Learning · Computer Science 2026-05-13 Aleksandr Bredikhin , Philippe Lalanda , German Vega

Wearable sensor devices, which offer the advantage of recording daily objects used by a person while performing an activity, enable the feasibility of unsupervised Human Activity Recognition (HAR). Unfortunately, previous unsupervised…

Human-Computer Interaction · Computer Science 2023-06-12 Qingxin Xia , Takuya Maekawa , Takahiro Hara

As a fundamental problem in ubiquitous computing and machine learning, sensor-based human activity recognition (HAR) has drawn extensive attention and made great progress in recent years. HAR aims to recognize human activities based on the…

Signal Processing · Electrical Eng. & Systems 2022-03-01 Yimu Wang , Kun Yu , Yan Wang , Hui Xue

There is an ongoing debate regarding the potential of Large Language Models (LLMs) as foundational models seamlessly integrated with Cyber-Physical Systems (CPS) for interpreting the physical world. In this paper, we carry out a case study…

Computation and Language · Computer Science 2024-03-06 Sijie Ji , Xinzhe Zheng , Chenshu Wu

Due to the scarcity of labeled sensor data in HAR, prior research has turned to video data to synthesize Inertial Measurement Units (IMU) data, capitalizing on its rich activity annotations. However, generating IMU data from videos presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vitor Fortes Rey , Lala Shakti Swarup Ray , Xia Qingxin , Kaishun Wu , Paul Lukowicz

Despite the widespread integration of ambient light sensors (ALS) in smart devices commonly used for screen brightness adaptation, their application in human activity recognition (HAR), primarily through body-worn ALS, is largely…

Artificial Intelligence · Computer Science 2024-08-23 Lala Shakti Swarup Ray , Daniel Geißler , Mengxi Liu , Bo Zhou , Sungho Suh , Paul Lukowicz

Human Activity Recognition (HAR) has gained great attention from researchers due to the popularity of mobile devices and the need to observe users' daily activity data for better human-computer interaction. In this work, we collect a human…

Artificial Intelligence · Computer Science 2024-09-26 Ning Sun , Yufei Wang , Yuwei Zhang , Jixiang Wan , Shenyue Wang , Ping Liu , Xudong Zhang

With the rapid progress of large language models (LLMs), multimodal frameworks that unify understanding and generation have become promising, yet they face increasing complexity as the number of modalities and tasks grows. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Bingfan Zhu , Biao Jiang , Sunyi Wang , Shixiang Tang , Tao Chen , Linjie Luo , Youyi Zheng , Xin Chen

Machine learning-based wearable human activity recognition (WHAR) models enable the development of various smart and connected community applications such as sleep pattern monitoring, medication reminders, cognitive health assessment,…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Avijoy Chakma , Abu Zaher Md Faridee , Indrajeet Ghosh , Nirmalya Roy

Human activity recognition (HAR) from on-body sensors is a core functionality in many AI applications: from personal health, through sports and wellness to Industry 4.0. A key problem holding up progress in wearable sensor-based HAR,…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Si Zuo , Vitor Fortes Rey , Sungho Suh , Stephan Sigg , Paul Lukowicz

Human Activity Recognition (HAR) underpins applications in healthcare, rehabilitation, fitness tracking, and smart environments, yet existing deep learning approaches demand dataset-specific training, large labeled corpora, and significant…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nirhoshan Sivaroopan , Hansi Karunarathna , Chamara Madarasingha , Anura Jayasumana , Kanchana Thilakarathna

Transformers have excelled in natural language processing and computer vision, paving their way to sensor-based Human Activity Recognition (HAR). Previous studies show that transformers outperform their counterparts exclusively when they…

Machine Learning · Computer Science 2024-10-18 Clayton Souza Leite , Henry Mauranen , Aziza Zhanabatyrova , Yu Xiao