English
Related papers

Related papers: Multimodal Contrastive Learning with Hard Negative…

200 papers

To properly assist humans in their needs, human activity recognition (HAR) systems need the ability to fuse information from multiple modalities. Our hypothesis is that multimodal sensors, visual and non-visual tend to provide complementary…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Hyeongju Choi , Apoorva Beedu , Harish Haresamudram , Irfan Essa

Human action recognition (HAR) with multi-modal inputs (RGB-D, skeleton, point cloud) can achieve high accuracy but typically relies on large labeled datasets and degrades sharply when sensors fail or are noisy. We present Robust…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Hasan Akgul , Mari Eplik , Javier Rojas , Akira Yamamoto , Rajesh Kumar , Maya Singh

Human activity recognition (HAR) is essential for effective Human-Robot Collaboration (HRC), enabling robots to interpret and respond to human actions. This study evaluates the ability of a vision-based tactile sensor to classify 15…

Various types of sensors have been considered to develop human action recognition (HAR) models. Robust HAR performance can be achieved by fusing multimodal data acquired by different sensors. In this paper, we introduce a new multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Kyoung Ok Yang , Junho Koh , Jun Won Choi

Human Activity Recognition (HAR) simply refers to the capacity of a machine to perceive human actions. HAR is a prominent application of advanced Machine Learning and Artificial Intelligence techniques that utilize computer vision to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Niloy Sikder , Md. Sanaullah Chowdhury , Abu Shamim Mohammad Arif , Abdullah-Al Nahid

Various types of sensors can be used for Human Activity Recognition (HAR), and each of them has different strengths and weaknesses. Sometimes a single sensor cannot fully observe the user's motions from its perspective, which causes wrong…

Machine Learning · Computer Science 2024-08-05 Duc-Anh Nguyen , Cuong Pham , Nhien-An Le-Khac

Human Activity Recognition (HAR) based on the sensors of mobile/wearable devices aims to detect the physical activities performed by humans in their daily lives. Although supervised learning methods are the most effective in this task,…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Sannara Ek , Riccardo Presotto , Gabriele Civitarese , François Portet , Philippe Lalanda , Claudio Bettini

Human Activity Recognition (HAR) based on wearable inertial sensors plays a critical role in remote health monitoring. In patients with movement disorders, the ability to detect abnormal patient movements in their home environments can…

Sensor-based human activity recognition (HAR), i.e., the ability to discover human daily activity patterns from wearable or embedded sensors, is a key enabler for many real-world applications in smart homes, personal healthcare, and urban…

Signal Processing · Electrical Eng. & Systems 2021-04-20 Saurav Jha , Martin Schiemer , Franco Zambonelli , Juan Ye

This paper addresses the problem of Human Activity Recognition (HAR) using data from wearable inertial sensors. An important challenge in HAR is the model's generalization capabilities to new unseen individuals due to inter-subject…

Human Activity Recognition (HAR) is an ongoing research topic. It has applications in medical support, sports, fitness, social networking, human-computer interfaces, senior care, entertainment, surveillance, and the list goes on.…

Human-Computer Interaction · Computer Science 2021-11-11 Hamza Ali Imran , Saad Wazir , Usman Iftikhar , Usama Latif

We present a new adversarial deep learning framework for the problem of human activity recognition (HAR) using inertial sensors worn by people. Our framework incorporates a novel adversarial activity-based discrimination task that addresses…

Signal Processing · Electrical Eng. & Systems 2025-03-19 Francisco M. Calatrava-Nicolás , Shoko Miyauchi , Oscar Martinez Mozos

Human activity recognition (HAR) is fundamental in human-robot collaboration (HRC), enabling robots to respond to and dynamically adapt to human intentions. This paper introduces a HAR system combining a modular data glove equipped with…

Together with the rapid development of the Internet of Things (IoT), human activity recognition (HAR) using wearable Inertial Measurement Units (IMUs) becomes a promising technology for many research areas. Recently, deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Ling Pei , Songpengcheng Xia , Lei Chu , Fanyi Xiao , Qi Wu , Wenxian Yu , Robert Qiu

Wearable-based Human Activity Recognition (HAR) is a key task in human-centric machine learning due to its fundamental understanding of human behaviours. Due to the dynamic nature of human behaviours, continual learning promises HAR systems…

Machine Learning · Computer Science 2024-01-05 Chi Ian Tang , Lorena Qendro , Dimitris Spathis , Fahim Kawsar , Akhil Mathur , Cecilia Mascolo

Human Activity Recognition (HAR) plays a vital role in applications such as fitness tracking, smart homes, and healthcare monitoring. Traditional HAR systems often rely on single modalities, such as motion sensors or cameras, limiting…

Machine Learning · Computer Science 2025-08-05 Asmit Bandyopadhyay , Rohit Basu , Tanmay Sen , Swagatam Das

Cross-modal contrastive pre-training between natural language and other modalities, e.g., vision and audio, has demonstrated astonishing performance and effectiveness across a diverse variety of tasks and domains. In this paper, we…

Machine Learning · Computer Science 2024-08-23 Harish Haresamudram , Apoorva Beedu , Mashfiqui Rabbi , Sankalita Saha , Irfan Essa , Thomas Ploetz

Contrastive learning is a powerful technique to learn representations that are semantically distinctive and geometrically invariant. While most of the earlier approaches have demonstrated its effectiveness on single-modality learning tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anurag Jain , Yashaswi Verma

Human Action Recognition (HAR) aims to understand human behavior and assign a label to each action. It has a wide range of applications, and therefore has been attracting increasing attention in the field of computer vision. Human actions…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zehua Sun , Qiuhong Ke , Hossein Rahmani , Mohammed Bennamoun , Gang Wang , Jun Liu

Human Action Anomaly Detection (HAAD) aims to identify anomalous actions given only normal action data during training. Existing methods typically follow a one-model-per-category paradigm, requiring separate training for each action…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Koichiro Kamide , Shunsuke Sakai , Shun Maeda , Chunzhi Gu , Chao Zhang