English
Related papers

Related papers: MHARFedLLM: Multimodal Human Activity Recognition …

200 papers

Pervasive computing promotes the integration of smart devices in our living spaces to develop services providing assistance to people. Such smart devices are increasingly relying on cloud-based Machine Learning, which raises questions in…

Machine Learning · Computer Science 2022-11-01 Sannara Ek , François Portet , Philippe Lalanda , German Vega

Traditional Federated Learning (FL) faces significant challenges in terms of efficiency and accuracy, particularly in heterogeneous environments where clients employ diverse model architectures and have varying computational resources. Such…

Machine Learning · Computer Science 2025-05-13 Jiacheng Wang , Hongtao Lv , Lei Liu

Human activity recognition (HAR) is a well-established field, significantly advanced by modern machine learning (ML) techniques. While companies have successfully integrated HAR into consumer products, they typically rely on a predefined…

Machine Learning · Computer Science 2024-02-16 Jingwei Zuo , George Arvanitakis , Mthandazo Ndhlovu , Hakim Hacid

Radio-Frequency (RF)-based Human Activity Recognition (HAR) rises as a promising solution for applications unamenable to techniques requiring computer visions. However, the scarcity of labeled RF data due to their non-interpretable nature…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuxuan Weng , Guoquan Wu , Tianyue Zheng , Yanbing Yang , Jun Luo

Previous work has demonstrated that virtual accelerometry data, extracted from videos using cross-modality transfer approaches like IMUTube, is beneficial for training complex and effective human activity recognition (HAR) models. Systems…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zikang Leng , Yash Jain , Hyeokhyen Kwon , Thomas Plötz

Wearable Human Activity Recognition (WHAR) is a prominent research area within ubiquitous computing. Multi-sensor synchronous measurement has proven to be more effective for WHAR than using a single sensor. However, existing WHAR methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Haoyu Xie , Haoxuan Li , Chunyuan Zheng , Haonan Yuan , Guorui Liao , Jun Liao , Li Liu

Measures of Activity of Daily Living (ADL) are an important indicator of overall health but difficult to measure in-clinic. Automated and accurate human activity recognition (HAR) using wrist-worn accelerometers enables practical and cost…

Machine Learning · Computer Science 2021-12-24 Niranjan Sridhar , Lance Myers

Human activity recognition (HAR) by wearable sensor devices embedded in the Internet of things (IOT) can play a significant role in remote health monitoring and emergency notification, to provide healthcare of higher standards. The purpose…

Machine Learning · Computer Science 2022-01-24 M. Abid , A. Khabou , Y. Ouakrim , H. Watel , S. Chemkhi , A. Mitiche , A. Benazza-Benyahia , N. Mezghani

Vertical Federated Learning (VFL) offers a privacy-preserving paradigm for Edge AI scenarios like mobile health diagnostics, where sensitive multimodal data reside on distributed, resource-constrained devices. Yet, standard VFL systems…

Machine Learning · Computer Science 2025-12-12 Mostafa Anoosha , Zeinab Dehghani , Kuniko Paxton , Koorosh Aslansefat , Dhavalkumar Thakker

Parameter-efficient fine-tuning (PEFT) methods typically assume that Large Language Models (LLMs) are trained on data from a single device or client. However, real-world scenarios often require fine-tuning these models on private data…

Machine Learning · Computer Science 2025-06-03 Sajjad Ghiasvand , Yifan Yang , Zhiyu Xue , Mahnoosh Alizadeh , Zheng Zhang , Ramtin Pedarsani

In smart healthcare, Human Activity Recognition (HAR) is considered to be an efficient model in pervasive computation from sensor readings. The Ambient Assisted Living (AAL) in the home or community helps the people in providing independent…

Machine Learning · Computer Science 2021-11-22 Pankaj Khatiwada , Ayan Chatterjee , Matrika Subedi

Utilizing the sensor characteristics of the audio, visible camera, and thermal camera, the robustness of person recognition can be enhanced. Existing multimodal person recognition frameworks are primarily formulated assuming that multimodal…

Multimedia · Computer Science 2022-10-25 Vijay John , Yasutomo Kawanishi

Electronic Health Records (EHR) data contains medical records such as diagnoses, medications, procedures, and treatments of patients. This data is often considered sensitive medical information. Therefore, the EHR data from the medical…

Machine Learning · Computer Science 2023-05-25 Ofir Ben Shoham , Nadav Rappoport

As a critical component of Wearable AI, IMU-based Human Activity Recognition (HAR) has attracted increasing attention from both academia and industry in recent years. Although HAR performance has improved considerably in specific scenarios,…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Yize Cai , Baoshen Guo , Flora Salim , Zhiqing Hong

Federated learning (FL) enables collaborative model training without sharing raw data, making it attractive for privacy-sensitive domains, e.g., healthcare, finance, and IoT. A major obstacle, however, is the potential heterogeneity of…

Machine Learning · Computer Science 2026-02-02 Abdelrhman Gaber , Muhammad ElMahdy , Youssif Abuzied , Hassan Abd-Eltawab , Tamer ElBatt

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Continual learning is an essential capability of human cognition, yet it poses significant challenges for current deep learning models. The primary issue is that new knowledge can interfere with previously learned information, causing the…

Machine Learning · Computer Science 2025-09-19 Eric Nuertey Coleman , Luigi Quarantiello , Samrat Mukherjee , Julio Hurtado , Vincenzo Lomonaco

Wearable sensor-based human activity recognition (HAR) is a critical research domain in activity perception. However, achieving high efficiency and long sequence recognition remains a challenge. Despite the extensive investigation of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Shuangjian Li , Tao Zhu , Furong Duan , Liming Chen , Huansheng Ning , Christopher Nugent , Yaping Wan

Indoor localization plays a vital role in applications such as emergency response, warehouse management, and augmented reality experiences. By deploying machine learning (ML) based indoor localization frameworks on their mobile devices,…

Machine Learning · Computer Science 2023-07-06 Danish Gufran , Sudeep Pasricha

The rapid evolution of Multimodal Large Language Models (MLLMs) is bottlenecked by the saturation of high-quality public data, while vast amounts of diverse multimodal data remain inaccessible in privacy-sensitive silos. Federated Learning…

Machine Learning · Computer Science 2026-03-31 Baochen Xiong , Yifan Xu , Xiaoshan Yang , Yaguang Song , Yaowei Wang , Changsheng Xu