English
Related papers

Related papers: MMTSA: Multimodal Temporal Segment Attention Netwo…

200 papers

Previous work has demonstrated that virtual accelerometry data, extracted from videos using cross-modality transfer approaches like IMUTube, is beneficial for training complex and effective human activity recognition (HAR) models. Systems…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zikang Leng , Yash Jain , Hyeokhyen Kwon , Thomas Plötz

Recently, multimodal tasks have strongly advanced the field of action recognition with their rich multimodal information. However, due to the scarcity of tri-modal data, research on tri-modal action recognition tasks faces many challenges.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Songping Wang , Xiantao Hu , Yueming Lyu , Caifeng Shan

In the field of sensor-based Human Activity Recognition (HAR), deep neural networks provide advanced technical support. Many studies have proven that recognition accuracy can be improved by increasing the depth or width of the network.…

Machine Learning · Computer Science 2025-08-22 Xiaoyang Li , Yixuan Jiang , Junze Zhu , Haotian Tang , Dongchen Wu , Hanyu Liu , Chao Li

Multimodal Sentiment Analysis (MSA) is a rapidly developing field that integrates multimodal information to recognize sentiments, and existing models have made significant progress in this area. The central challenge in MSA is multimodal…

Computation and Language · Computer Science 2025-08-25 Yijie Jin , Junjie Peng , Xuanchao Lin , Haochen Yuan , Lan Wang , Cangzhi Zheng

Convolutional Neural Networks (CNNs) are successful deep learning models in the field of computer vision. To get the maximum advantage of CNN model for Human Action Recognition (HAR) using inertial sensor data, in this paper, we use 4 types…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Zeeshan Ahmad , Naimul Khan

Machine learning-based wearable human activity recognition (WHAR) models enable the development of various smart and connected community applications such as sleep pattern monitoring, medication reminders, cognitive health assessment,…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Avijoy Chakma , Abu Zaher Md Faridee , Indrajeet Ghosh , Nirmalya Roy

Human Activity Recognition (HAR) based on wearable inertial sensors plays a critical role in remote health monitoring. In patients with movement disorders, the ability to detect abnormal patient movements in their home environments can…

Human activity recognition (HAR) is a crucial area of research that involves understanding human movements using computer and machine vision technology. Deep learning has emerged as a powerful tool for this task, with models such as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Mohammad Belal , Taimur Hassan , Abdelfatah Ahmed , Ahmad Aljarah , Nael Alsheikh , Irfan Hussain

This paper attempts at improving the accuracy of Human Action Recognition (HAR) by fusion of depth and inertial sensor data. Firstly, we transform the depth data into Sequential Front view Images(SFI) and fine-tune the pre-trained AlexNet…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Zeeshan Ahmad , Naimul Khan

Multi-modal fusion is crucial for Internet of Things (IoT) perception, widely deployed in smart homes, intelligent transport, industrial automation, and healthcare. However, existing systems often face challenges: high model complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Weiqi Yang , Xu Zhou , Jingfu Guan , Hao Du , Tianyu Bai

Human activity recognition (HAR) with wearables is promising research that can be widely adopted in many smart healthcare applications. In recent years, the deep learning-based HAR models have achieved impressive recognition performance.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Songpengcheng Xia , Lei Chu , Ling Pei , Wenxian Yu , Robert C. Qiu

Multi-task learning (MTL) can advance assistive driving by exploring inter-task correlations through shared representations. However, existing methods face two critical limitations: single-modality constraints limiting comprehensive scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenzhuo Liu , Yicheng Qiao , Zhen Wang , Qiannan Guo , Zilong Chen , Meihua Zhou , Xinran Li , Letian Wang , Zhiwei Li , Huaping Liu , Wenshuo Wang

Human Activity Recognition is an important task in many human-computer collaborative scenarios, whilst having various practical applications. Although uni-modal approaches have been extensively studied, they suffer from data quality and…

Human-Computer Interaction · Computer Science 2023-05-09 Jingcheng Li , Lina Yao , Binghao Li , Claude Sammut

In recent years, the widespread adoption of wearable devices has highlighted the growing importance of behavior analysis using IMU. While applications span diverse fields such as healthcare and robotics, recent studies have increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Koki Matsuishi , Kosuke Ukita , Tsuyoshi Okita

Deep neural network is an effective choice to automatically recognize human actions utilizing data from various wearable sensors. These networks automate the process of feature extraction relying completely on data. However, various noises…

Signal Processing · Electrical Eng. & Systems 2021-01-05 Tanvir Mahmud , A. Q. M. Sazzad Sayyed , Shaikh Anowarul Fattah , Sun-Yuan Kung

Human Activity Recognition (HAR) is one of the essential building blocks of so many applications like security, monitoring, the internet of things and human-robot interaction. The research community has developed various methodologies to…

Human-Computer Interaction · Computer Science 2022-06-10 Farhad Nazari , Navid Mohajer , Darius Nahavandi , Abbas Khosravi , Saeid Nahavandi

The main streams of human activity recognition (HAR) algorithms are developed based on RGB cameras which are suffered from illumination, fast motion, privacy-preserving, and large energy consumption. Meanwhile, the biologically inspired…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Xiao Wang , Zongzhen Wu , Bo Jiang , Zhimin Bao , Lin Zhu , Guoqi Li , Yaowei Wang , Yonghong Tian

Human Activity Recognition (HAR) has become increasingly popular with ubiquitous computing, driven by the popularity of wearable sensors in fields like healthcare and sports. While Convolutional Neural Networks (ConvNets) have significantly…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Shuai Shao , Yu Guan , Victor Sanchez

Wi-Fi-based human activity recognition (HAR) has emerged as a promising approach for contactless sensing, leveraging channel state information (CSI) collected from wireless transceivers. While existing studies have primarily concentrated on…

Signal Processing · Electrical Eng. & Systems 2026-05-21 Amirhossein Mohammadi , Hina Tabassum

Human Activity Recognition (HAR) based on inertial data is an increasingly diffused task on embedded devices, from smartphones to ultra low-power sensors. Due to the high computational complexity of deep learning models, most embedded HAR…