English
Related papers

Related papers: Multimodal Contrastive Learning with Hard Negative…

200 papers

Multimodal fusion frameworks for Human Action Recognition (HAR) using depth and inertial sensor data have been proposed over the years. In most of the existing works, fusion is performed at a single level (feature level or decision level),…

Machine Learning · Computer Science 2019-10-28 Zeeshan Ahmad , Naimul Khan

Human Activity Recognition (HAR) using wearable inertial measurement unit (IMU) sensors can revolutionize healthcare by enabling continual health monitoring, disease prediction, and routine recognition. Despite the high accuracy of Deep…

Human-Computer Interaction · Computer Science 2025-03-17 Azhar Ali Khaked , Nobuyuki Oishi , Daniel Roggen , Paula Lago

Human activity recognition (HAR) is an essential research field that has been used in different applications including home and workplace automation, security and surveillance as well as healthcare. Starting from conventional machine…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Rebeen Ali Hamad , Wai Lok Woo , Bo Wei , Longzhi Yang

Human Activity Recognition (HAR) is considered a valuable research topic in the last few decades. Different types of machine learning models are used for this purpose, and this is a part of analyzing human behavior through machines. It is…

Machine Learning · Computer Science 2021-03-31 Jakaria Rabbi , Md. Tahmid Hasan Fuad , Md. Abdul Awal

Human Activity Recognition (HAR) systems aim to understand human behaviour and assign a label to each action, attracting significant attention in computer vision due to their wide range of applications. HAR can leverage various data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Jungpil Shin , Najmul Hassan , Abu Saleh Musa Miah1 , Satoshi Nishimura

Sensor-based Human Activity Recognition (HAR) is crucial in ubiquitous computing, analysing behaviours through multi-dimensional observations. Despite research progress, HAR confronts challenges, particularly in data distribution…

Signal Processing · Electrical Eng. & Systems 2025-03-05 Xiaozhou Ye , Kouichi Sakurai , Nirmal Nair , Kevin I-Kai Wang

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Human Activity Recognition (HAR) using wearable devices such as smart watches embedded with Inertial Measurement Unit (IMU) sensors has various applications relevant to our daily life, such as workout tracking and health monitoring. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Wenjin Tao , Haodong Chen , Md Moniruzzaman , Ming C. Leu , Zhaozheng Yi , Ruwen Qin

Multimodal sensors provide complementary information to develop accurate machine-learning methods for human activity recognition (HAR), but introduce significantly higher computational load, which reduces efficiency. This paper proposes an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Ziqi Gao , Yuntao Wang , Jianguo Chen , Junliang Xing , Shwetak Patel , Xin Liu , Yuanchun Shi

There has been much recent research on human activity re\-cog\-ni\-tion (HAR), due to the proliferation of wearable sensors in watches and phones, and the advances of deep learning methods, which avoid the need to manually extract features…

Machine Learning · Computer Science 2022-09-20 Louis Mahon , Thomas Lukasiewicz

As a critical component of Wearable AI, IMU-based Human Activity Recognition (HAR) has attracted increasing attention from both academia and industry in recent years. Although HAR performance has improved considerably in specific scenarios,…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Yize Cai , Baoshen Guo , Flora Salim , Zhiqing Hong

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Deep learning has been widely adopted for human activity recognition (HAR) while generalizing a trained model across diverse users and scenarios remains challenging due to distribution shifts. The inherent low-resource challenge in HAR,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Junyao Wang , Mohammad Abdullah Al Faruque

In smart healthcare, Human Activity Recognition (HAR) is considered to be an efficient model in pervasive computation from sensor readings. The Ambient Assisted Living (AAL) in the home or community helps the people in providing independent…

Machine Learning · Computer Science 2021-11-22 Pankaj Khatiwada , Ayan Chatterjee , Matrika Subedi

Despite living in a multi-sensory world, most AI models are limited to textual and visual understanding of human motion and behavior. In fact, full situational awareness of human motion could best be understood through a combination of…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Abhi Kamboj , Minh Do

One of the challenges in contrastive learning is the selection of appropriate \textit{hard negative} examples, in the absence of label information. Random sampling or importance sampling methods based on feature similarity often lead to…

Machine Learning · Computer Science 2022-06-03 Afrina Tabassum , Muntasir Wahed , Hoda Eldardiry , Ismini Lourentzou

Unsupervised contrastive learning has achieved outstanding success, while the mechanism of contrastive loss has been less studied. In this paper, we concentrate on the understanding of the behaviours of unsupervised contrastive loss. We…

Machine Learning · Computer Science 2021-03-23 Feng Wang , Huaping Liu

Human activity recognition (HAR) has been playing an increasingly important role in various domains such as healthcare, security monitoring, and metaverse gaming. Though numerous HAR methods based on computer vision have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Jianfei Yang , Shijie Tang , Yuecong Xu , Yunjiao Zhou , Lihua Xie

Neural networks have changed the way machines interpret the world. At their core, they learn by following gradients, adjusting their parameters step by step until they identify the most discriminant patterns in the data. This process gives…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Samarup Bhattacharya , Anubhab Bhattacharya , Abir Chakraborty

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan