English
Related papers

Related papers: Divide and Contrast: Learning Robust Temporal Feat…

200 papers

Semi-supervised learning utilizes insights from unlabeled data to improve model generalization, thereby reducing reliance on large labeled datasets. Most existing studies focus on limited samples and fail to capture the overall data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Xiuzhen Guo , Lianyuan Yu , Ji Shi , Na Lei , Hongxiao Wang

How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These…

Machine Learning · Computer Science 2021-07-06 Zixin Wen , Yuanzhi Li

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das

Anomaly detection in multivariate time series (MTS) is hindered by dynamic inter-variable dependencies and feature entanglement under spectral noise, and in practice, is further complicated by the absence of anomaly labels. Existing…

Machine Learning · Computer Science 2026-05-25 Yunhua Pei , Zixing Song , Jin Zheng , John Cartlidge

Robust radio signal recognition is fundamental to spectrum management, electromagnetic space security, and intelligent wireless applications, yet existing deep-learning methods rely heavily on large labeled datasets and struggle to capture…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Shilian Zheng , Jie Chen , Luxin Zhang , Xiaoniu Yang

Self-supervised 3D representation learning aims to learn effective representations from large-scale unlabeled point clouds. Most existing approaches adopt point discrimination as the pretext task, which assigns matched points in two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chengyao Wang , Li Jiang , Xiaoyang Wu , Zhuotao Tian , Bohao Peng , Hengshuang Zhao , Jiaya Jia

In this study, we propose an innovative dynamic classification algorithm aimed at achieving zero missed detections and minimal false positives,acritical in safety-critical domains (e.g., medical diagnostics) where undetected cases risk…

Machine Learning · Computer Science 2025-06-02 Ziyuan Zhong , Junyang Zhou

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Haojin Deng , Yimin Yang

We introduce Contrastive FUSE, a fast and unified framework for scalable node representation learning in graphs with partially available pairwise node labels and no available node features. Unlike existing methods, we directly optimize a…

Machine Learning · Computer Science 2026-05-20 Sujan Chakraborty , Saptarshi Bej

We give a polynomial-time algorithm for learning high-dimensional halfspaces with margins in $d$-dimensional space to within desired TV distance when the ambient distribution is an unknown affine transformation of the $d$-fold product of an…

Machine Learning · Computer Science 2023-11-03 Xinyuan Cao , Santosh S. Vempala

The goal of contrastive learning based pre-training is to leverage large quantities of unlabeled data to produce a model that can be readily adapted downstream. Current approaches revolve around solving an image discrimination task: given…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Chenhongyi Yang , Lichao Huang , Elliot J. Crowley

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

Unsupervised pre-training has been proven as an effective approach to boost various downstream tasks given limited labeled data. Among various methods, contrastive learning learns a discriminative representation by constructing positive and…

Image and Video Processing · Electrical Eng. & Systems 2022-02-17 Jizong Peng , Ping Wang , Marco Pedersoli , Christian Desrosiers

Unsupervised image retrieval aims to learn an efficient retrieval system without expensive data annotations, but most existing methods rely heavily on handcrafted feature descriptors or pre-trained feature extractors. To minimize human…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Guile Wu , Chao Zhang , Stephan Liwicki

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

In this paper, we present a framework for contrastive learning for audio representations, in a self supervised frame work without access to any ground truth labels. The core idea in self supervised contrastive learning is to map an audio…

Sound · Computer Science 2021-03-18 Prateek Verma , Julius Smith

Self-supervised approaches for video have shown impressive results in video understanding tasks. However, unlike early works that leverage temporal self-supervision, current state-of-the-art methods primarily rely on tasks from the image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Ishan Rajendrakumar Dave , Simon Jenni , Mubarak Shah

We investigate a practical domain adaptation task, called source-free domain adaptation (SFUDA), where the source-pretrained model is adapted to the target domain without access to the source data. Existing techniques mainly leverage…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Ziyi Zhang , Weikai Chen , Hui Cheng , Zhen Li , Siyuan Li , Liang Lin , Guanbin Li

There have been several recent efforts towards developing representations for multivariate time-series in an unsupervised learning framework. Such representations can prove beneficial in tasks such as activity recognition, health…

Machine Learning · Computer Science 2022-09-23 Yitian Zhang , Florence Regol , Antonios Valkanas , Mark Coates