English
Related papers

Related papers: Multimodal Contrastive Learning with Hard Negative…

200 papers

Self-supervised learning establishes a new paradigm of learning representations with much fewer or even no label annotations. Recently there has been remarkable progress on large-scale contrastive learning models which require substantial…

Machine Learning · Computer Science 2022-02-15 Hangwei Qian , Tian Tian , Chunyan Miao

Mobile and wearable devices have enabled numerous applications, including activity tracking, wellness monitoring, and human--computer interaction, that measure and improve our daily lives. Many of these applications are made possible by…

Human-Computer Interaction · Computer Science 2022-03-04 Shibo Zhang , Yaxuan Li , Shen Zhang , Farzad Shahabi , Stephen Xia , Yu Deng , Nabil Alshurafa

Human activity recognition (HAR) is an important research field in ubiquitous computing where the acquisition of large-scale labeled sensor data is tedious, labor-intensive and time consuming. State-of-the-art unsupervised remedies…

Machine Learning · Computer Science 2021-10-13 Alireza Abedin , Hamid Rezatofighi , Damith C. Ranasinghe

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

Object Detection, a fundamental computer vision problem, has paramount importance in smart camera systems. However, a truly reliable camera system could be achieved if and only if the underlying object detection component is robust enough…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Ujjal Kr Dutta

Wearable sensor devices, which offer the advantage of recording daily objects used by a person while performing an activity, enable the feasibility of unsupervised Human Activity Recognition (HAR). Unfortunately, previous unsupervised…

Human-Computer Interaction · Computer Science 2023-06-12 Qingxin Xia , Takuya Maekawa , Takahiro Hara

Due to its widespread applications, human action recognition is one of the most widely studied research problems in Computer Vision. Recent studies have shown that addressing it using multimodal data leads to superior performance as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Muhammad Bilal Shaikh , Syed Mohammed Shamsul Islam , Douglas Chai , Naveed Akhtar

Human activity recognition (HAR) is a crucial area of research that involves understanding human movements using computer and machine vision technology. Deep learning has emerged as a powerful tool for this task, with models such as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Mohammad Belal , Taimur Hassan , Abdelfatah Ahmed , Ahmad Aljarah , Nael Alsheikh , Irfan Hussain

The performance of Human Activity Recognition (HAR) models, particularly deep neural networks, is highly contingent upon the availability of the massive amount of annotated training data which should be sufficiently labeled. Though, data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Elnaz Soleimani , Ghazaleh Khodabandelou , Abdelghani Chibani , Yacine Amirat

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

Human activity recognition (HAR) will be an essential function of various emerging applications. However, HAR typically encounters challenges related to modality limitations and label scarcity, leading to an application gap between current…

Machine Learning · Computer Science 2024-04-03 Lilin Xu , Chaojie Gu , Rui Tan , Shibo He , Jiming Chen

The emergence of self-supervised learning in the field of wearables-based human activity recognition (HAR) has opened up opportunities to tackle the most pressing challenges in the field, namely to exploit unlabeled data to derive reliable…

Signal Processing · Electrical Eng. & Systems 2022-11-22 Harish Haresamudram , Irfan Essa , Thomas Plötz

In recent years, self-supervised representation learning for skeleton-based action recognition has advanced with the development of contrastive learning methods. However, most of contrastive paradigms are inherently discriminative and often…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Dang Dinh Nguyen , Decky Aspandi Latif , Titus Zaharia

To fluently collaborate with people, robots need the ability to recognize human activities accurately. Although modern robots are equipped with various sensors, robust human activity recognition (HAR) still remains a challenging task for…

Robotics · Computer Science 2020-08-17 Md Mofijul Islam , Tariq Iqbal

Monitoring the health of complex industrial assets is crucial for safe and efficient operations. Health indicators that provide quantitative real-time insights into the health status of industrial assets over time serve as valuable tools…

Machine Learning · Computer Science 2024-05-29 Katharina Rombach , Gabriel Michau , Wilfried Bürzle , Stefan Koller , Olga Fink

Modern electronic health records (EHRs) hold immense promise in tracking personalized patient health trajectories through sequential deep learning, owing to their extensive breadth, scale, and temporal granularity. Nonetheless, how to…

Quite a few people in the world have to stay under permanent surveillance for health reasons; they include diabetic people or people with some other chronic conditions, the elderly and the disabled.These groups may face heightened risk of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Anna Nedorubova , Alena Kadyrova , Aleksey Khlyupin

Person re-identification (re-ID) has received great success with the supervised learning methods. However, the task of unsupervised cross-domain re-ID is still challenging. In this paper, we propose a Hard Samples Rectification (HSR)…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chih-Ting Liu , Man-Yu Lee , Tsai-Shien Chen , Shao-Yi Chien

Unsupervised sentence representation learning remains a critical challenge in modern natural language processing (NLP) research. Recently, contrastive learning techniques have achieved significant success in addressing this issue by…

Computation and Language · Computer Science 2024-11-20 Wenxiao Liu , Zihong Yang , Chaozhuo Li , Zijin Hong , Jianfeng Ma , Zhiquan Liu , Litian Zhang , Feiran Huang

Sensor-based human activity recognition (HAR) mines activity patterns from the time-series sensory data. In realistic scenarios, variations across individuals, devices, environments, and time introduce significant distributional shifts for…

Artificial Intelligence · Computer Science 2026-01-01 Wang Lu , Yao Zhu , Jindong Wang