English
Related papers

Related papers: Evaluating Contrastive Learning on Wearable Timese…

200 papers

Advances in self-supervised learning (SSL) have shown that self-supervised pretraining on medical imaging data can provide a strong initialization for downstream supervised classification and segmentation. Given the difficulty of obtaining…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Gregory Holste , Evangelos K. Oikonomou , Bobak J. Mortazavi , Zhangyang Wang , Rohan Khera

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

Machine Learning · Computer Science 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

Recent breakthroughs in the field of semi-supervised learning have achieved results that match state-of-the-art traditional supervised learning methods. Most successful semi-supervised learning approaches in computer vision focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Khoi Nguyen , Yen Nguyen , Bao Le

Medical datasets and especially biobanks, often contain extensive tabular data with rich clinical information in addition to images. In practice, clinicians typically have less data, both in terms of diversity and scale, but still wish to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Paul Hager , Martin J. Menten , Daniel Rueckert

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Recommender systems (RecSys) play a vital role in online platforms, offering users personalized suggestions amidst vast information. Graph contrastive learning aims to learn from high-order collaborative filtering signals with unsupervised…

Information Retrieval · Computer Science 2024-04-29 Weizhi Zhang , Liangwei Yang , Zihe Song , Henry Peng Zou , Ke Xu , Yuanjie Zhu , Philip S. Yu

We address the problem of self-supervised learning on discrete event sequences generated by real-world users. Self-supervised learning incorporates complex information from the raw data in low-dimensional fixed-length vector representations…

Machine Learning · Computer Science 2022-07-25 Dmitrii Babaev , Ivan Kireev , Nikita Ovsov , Mariya Ivanova , Gleb Gusev , Ivan Nazarov , Alexander Tuzhilin

Contrastive learning (CL), a self-supervised learning approach, can effectively learn visual representations from unlabeled data. Given the CL training data, generative models can be trained to generate synthetic data to supplement the real…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yawen Wu , Zhepeng Wang , Dewen Zeng , Yiyu Shi , Jingtong Hu

Self-supervised contrastive learning (CL) has achieved state-of-the-art performance in representation learning by minimizing the distance between positive pairs while maximizing that of negative ones. Recently, it has been verified that the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jin-Young Kim , Soonwoo Kwon , Hyojun Go , Yunsung Lee , Seungtaek Choi , Hyun-Gyoon Kim

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Trajectory similarity measures act as query predicates in trajectory databases, making them the key player in determining the query results. They also have a heavy impact on the query efficiency. An ideal measure should have the capability…

Databases · Computer Science 2023-02-21 Yanchuan Chang , Jianzhong Qi , Yuxuan Liang , Egemen Tanin

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

Traditional approaches to RL have focused on learning decision policies directly from episodic decisions, while slowly and implicitly learning the semantics of compositional representations needed for generalization. While some approaches…

Computation and Language · Computer Science 2022-12-23 Chris Lengerich , Gabriel Synnaeve , Amy Zhang , Hugh Leather , Kurt Shuster , François Charton , Charysse Redwood

Recent advancements in contrastive learning have revolutionized self-supervised representation learning and achieved state-of-the-art performance on benchmark tasks. While most existing methods focus on applying contrastive learning to…

Machine Learning · Computer Science 2024-04-16 Lihui Liu , Jinha Kim , Vidit Bansal

Self-supervised contrastive learning frameworks have progressed rapidly over the last few years. In this paper, we propose a novel loss function for contrastive learning. We model our pre-training task as a binary classification problem to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siladittya Manna , Umapada Pal , Saumik Bhattacharya

Human activity recognition (HAR) with wearables is one of the serviceable technologies in ubiquitous and mobile computing applications. The sliding-window scheme is widely adopted while suffering from the multi-class windows problem. As a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Songpengcheng Xia , Lei Chu , Ling Pei , Jiarui Yang , Wenxian Yu , Robert C. Qiu

In the anomaly detection field, the scarcity of anomalous samples has directed the current research emphasis towards unsupervised anomaly detection. While these unsupervised anomaly detection methods offer convenience, they also overlook…

Information Retrieval · Computer Science 2023-11-15 Shunfeng Wang , Yueyang Li , Haichi Luo , Chenyang Bi

Biological brains learn continually from a stream of unlabeled data, while integrating specialized information from sparsely labeled examples without compromising their ability to generalize. Meanwhile, machine learning methods are…

Machine Learning · Computer Science 2026-01-27 Viet Anh Khoa Tran , Emre Neftci , Willem A. M. Wybo

Self-supervised methods have shown tremendous success in the field of computer vision, including applications in remote sensing and medical imaging. Most popular contrastive-loss based methods like SimCLR, MoCo, MoCo-v2 use multiple views…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Umangi Jain , Alex Wilson , Varun Gulshan