English
Related papers

Related papers: Robust Multimodal Fusion for Human Activity Recogn…

200 papers

Human-machine interaction has been around for several decades now, with new applications emerging every day. One of the major goals that remain to be achieved is designing an interaction similar to how a human interacts with another human.…

Human-Computer Interaction · Computer Science 2022-12-27 Tauheed Khan Mohd , Nicole Nguyen , Ahmad Y Javaid

The extensive ubiquitous availability of sensors in smart devices and the Internet of Things (IoT) has opened up the possibilities for implementing sensor-based activity recognition. As opposed to traditional sensor time-series processing…

Signal Processing · Electrical Eng. & Systems 2023-10-09 Danial Ahangarani , Mohammad Shirazi , Navid Ashraf

In the last decade, Human Activity Recognition (HAR) has become a vibrant research area, especially due to the spread of electronic devices such as smartphones, smartwatches and video cameras present in our daily lives. In addition, the…

Signal Processing · Electrical Eng. & Systems 2020-11-20 Florenc Demrozi , Graziano Pravadelli , Azra Bihorac , Parisa Rashidi

This demo showcases a platform for developing human activity recognition (AR) systems, focusing on daily activities using sensor data, like binary sensors. With a data-driven approach, this platform, named FlowAR, features a three-step…

Machine Learning · Computer Science 2025-02-14 Ali Ncibi , Luc Bouganim , Philippe Pucheral

Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modalities. In this paper,…

Machine Learning · Computer Science 2019-04-22 Jun-Ho Choi , Jong-Seok Lee

Human activity recognition (HAR) holds immense potential for transforming health and fitness monitoring, yet challenges persist in achieving personalized outcomes and sustainability for on-device continuous inferences. This work introduces…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Bidyut Saha , Riya Samanta , Soumya K Ghosh , Ram Babu Roy

Human Activity Recognition (HAR) plays a vital role in applications such as fitness tracking, smart homes, and healthcare monitoring. Traditional HAR systems often rely on single modalities, such as motion sensors or cameras, limiting…

Machine Learning · Computer Science 2025-08-05 Asmit Bandyopadhyay , Rohit Basu , Tanmay Sen , Swagatam Das

Navigating the complexities of person re-identification (ReID) in varied surveillance scenarios, particularly when occlusions occur, poses significant challenges. We introduce an innovative Motion-Aware Fusion (MOTAR-FUSE) network that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Fuxi Ling , Hongye Liu , Guoqiang Huang , Jing Li , Hong Wu , Zhihao Tang

Unobtrusive and smart recognition of human activities using smartphones inertial sensors is an interesting topic in the field of artificial intelligence acquired tremendous popularity among researchers, especially in recent years. A…

Machine Learning · Computer Science 2021-09-21 Meysam Vakili , Masoumeh Rezaei

In this work, we propose an open-source scalable end-to-end RTL framework FieldHAR, for complex human activity recognition (HAR) from heterogeneous sensors using artificial neural networks (ANN) optimized for FPGA or ASIC integration.…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Mengxi Liu , Bo Zhou , Zimin Zhao , Hyeonseok Hong , Hyun Kim , Sungho Suh , Vitor Fortes Rey , Paul Lukowicz

Radar-based human activity recognition (HAR) is a pivotal research area for applications requiring non-invasive monitoring. However, the acquisition of diverse and high-fidelity radar datasets for robust algorithm development remains a…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Weicheng Gao

Human activity recognition (HAR) with wearables is promising research that can be widely adopted in many smart healthcare applications. In recent years, the deep learning-based HAR models have achieved impressive recognition performance.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Songpengcheng Xia , Lei Chu , Ling Pei , Wenxian Yu , Robert C. Qiu

Cross-dataset Human Activity Recognition (HAR) suffers from limited model generalization, hindering its practical deployment. To address this critical challenge, inspired by the success of DoReMi in Large Language Models (LLMs), we…

Machine Learning · Computer Science 2025-03-19 Lulu Ban , Tao Zhu , Xiangqing Lu , Qi Qiu , Wenyong Han , Shuangjian Li , Liming Chen , Kevin I-Kai Wang , Mingxing Nie , Yaping Wan

Human Action Recognition (HAR) is an interesting research area in human-computer interaction used to monitor the activities of elderly and disabled individuals affected by physical and mental health. In the recent era, skeleton-based HAR…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Faisal Mehmood , Enqing Chen , Touqeer Abbas , Samah M. Alzanin

Multimodal Sentiment Analysis (MSA) is critical for human-computer interaction but faces challenges when the modalities are incomplete or missing. Existing methods often assume pre-defined missing modalities or fixed missing rates, limiting…

Human-Computer Interaction · Computer Science 2025-11-24 Liling Li , Guoyang Xu , Xiongri Shen , Zhifei Xu , Yanbo Zhang , Zhiguo Zhang , Zhenxi Song

Human activity recognition (HAR) from on-body sensors is a core functionality in many AI applications: from personal health, through sports and wellness to Industry 4.0. A key problem holding up progress in wearable sensor-based HAR,…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Si Zuo , Vitor Fortes Rey , Sungho Suh , Stephan Sigg , Paul Lukowicz

In this paper, we report a hierarchical deep learning model for classification of complex human activities using motion sensors. In contrast to traditional Human Activity Recognition (HAR) models used for event-based activity recognition,…

Machine Learning · Computer Science 2022-07-19 Eric Rosen , Doruk Senkal

The human visual perception system has strong robustness in image fusion. This robustness is based on human visual perception system's characteristics of feature selection and non-linear fusion of different features. In order to simulate…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Aiqing Fang , Xinbo Zhao , Jiaqi Yang , Yanning Zhang

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

Multimodal emotion recognition analyzes emotions by combining data from multiple sources. However, real-world noise or sensor failures often cause missing or corrupted data, creating the Incomplete Multimodal Emotion Recognition (IMER)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yuehan Jin , Xiaoqing Liu , Yiyuan Yang , Zhiwen Yu , Tong Zhang , Kaixiang Yang