English
Related papers

Related papers: Negative Selection by Clustering for Contrastive L…

200 papers

Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often overlap with each other in the representation space at the…

Machine Learning · Computer Science 2021-06-01 Dejiao Zhang , Feng Nan , Xiaokai Wei , Shangwen Li , Henghui Zhu , Kathleen McKeown , Ramesh Nallapati , Andrew Arnold , Bing Xiang

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Wearable-based Human Activity Recognition (HAR) is a key task in human-centric machine learning due to its fundamental understanding of human behaviours. Due to the dynamic nature of human behaviours, continual learning promises HAR systems…

Machine Learning · Computer Science 2024-01-05 Chi Ian Tang , Lorena Qendro , Dimitris Spathis , Fahim Kawsar , Akhil Mathur , Cecilia Mascolo

In Computer Vision, self-supervised contrastive learning enforces similar representations between different views of the same image. The pre-training is most often performed on image classification datasets, like ImageNet, where images…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Benjamin Missaoui , Chongbin Yuan

Contrastive learning has gained significant attention in skeleton-based action recognition for its ability to learn robust representations from unlabeled data. However, existing methods rely on a single skeleton convention, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Mert Kiray , Alvaro Ritter , Nassir Navab , Benjamin Busam

Human Activity Recognition is a field of research where input data can take many forms. Each of the possible input modalities describes human behaviour in a different way, and each has its own strengths and weaknesses. We explore the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Razvan Brinzea , Bulat Khaertdinov , Stylianos Asteriadis

Feature extraction is crucial for human activity recognition (HAR) using body-worn movement sensors. Recently, learned representations have been used successfully, offering promising alternatives to manually engineered features. Our work…

Machine Learning · Computer Science 2020-12-11 Harish Haresamudram , Irfan Essa , Thomas Ploetz

The self-supervised pretraining paradigm has achieved great success in skeleton-based action recognition. However, these methods treat the motion and static parts equally, and lack an adaptive design for different parts, which has a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Lilang Lin , Jiahang Zhang , Jiaying Liu

WiFi Channel State Information (CSI)-based activity recognition has sparked numerous studies due to its widespread availability and privacy protection. However, when applied in practical applications, general CSI-based recognition models…

Networking and Internet Architecture · Computer Science 2024-08-13 Chunjing Xiao , Yanhui Han , Wei Yang , Yane Hou , Fangzhan Shi , Kevin Chetty

Contrastive learning has been widely studied in sentence representation learning. However, earlier works mainly focus on the construction of positive examples, while in-batch samples are often simply treated as negative examples. This…

Computation and Language · Computer Science 2023-05-18 Jinghao Deng , Fanqi Wan , Tao Yang , Xiaojun Quan , Rui Wang

Unsupervised learning has been a long-standing goal of machine learning and is especially important for medical image analysis, where the learning can compensate for the scarcity of labeled datasets. A promising subclass of unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2021-09-09 Ozan Ciga , Tony Xu , Anne L. Martel

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

Recommender systems are designed to learn user preferences from observed feedback and comprise many fundamental tasks, such as rating prediction and post-click conversion rate (pCVR) prediction. However, the observed feedback usually suffer…

Information Retrieval · Computer Science 2024-02-09 Jun Wang , Haoxuan Li , Chi Zhang , Dongxu Liang , Enyun Yu , Wenwu Ou , Wenjia Wang

Human Activity Recognition (HAR) based on the sensors of mobile/wearable devices aims to detect the physical activities performed by humans in their daily lives. Although supervised learning methods are the most effective in this task,…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Sannara Ek , Riccardo Presotto , Gabriele Civitarese , François Portet , Philippe Lalanda , Claudio Bettini

The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language…

Information Retrieval · Computer Science 2022-06-02 Lanling Xu , Jianxun Lian , Wayne Xin Zhao , Ming Gong , Linjun Shou , Daxin Jiang , Xing Xie , Ji-Rong Wen

Vast quantities of person-generated health data (wearables) are collected but the process of annotating to feed to machine learning models is impractical. This paper discusses ways in which self-supervised approaches that use contrastive…

Machine Learning · Computer Science 2021-11-16 Kevalee Shah , Dimitris Spathis , Chi Ian Tang , Cecilia Mascolo

A good clustering algorithm can discover natural groupings in data. These groupings, if used wisely, provide a form of weak supervision for learning representations. In this work, we present Clustering-based Contrastive Learning (CCL), a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Vivek Sharma , Makarand Tapaswi , M. Saquib Sarfraz , Rainer Stiefelhagen

The effectiveness of contrastive learning technology in natural language processing tasks is yet to be explored and analyzed. How to construct positive and negative samples correctly and reasonably is the core challenge of contrastive…

Computation and Language · Computer Science 2023-07-17 Nankai Lin , Guanqiu Qin , Jigang Wang , Aimin Yang , Dong Zhou

Contrastive learning is a representation learning method performed by contrasting a sample to other similar samples so that they are brought closely together, forming clusters in the feature space. The learning process is typically…

Machine Learning · Computer Science 2022-09-28 Valentino Vito , Lim Yohanes Stefanus

The recent advances in representation learning inspire us to take on the challenging problem of unsupervised image classification tasks in a principled way. We propose ContraCluster, an unsupervised image classification method that combines…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seongho Joe , Byoungjip Kim , Hoyoung Kang , Kyoungwon Park , Bogun Kim , Jaeseon Park , Joonseok Lee , Youngjune Gwon