中文
相关论文

相关论文: Temperature Schedules for Self-Supervised Contrast…

200 篇论文

Recently, there has been a significant advancement in designing Self-Supervised Learning (SSL) frameworks for time series data to reduce the dependency on data labels. Among these works, hierarchical contrastive learning-based SSL…

机器学习 · 计算机科学 2025-02-18 Kevin Garcia , Juan Manuel Perez , Yifeng Gao

Learning useful data representations without requiring labels is a cornerstone of modern deep learning. Self-supervised learning methods, particularly contrastive learning (CL), have proven successful by leveraging data augmentations to…

机器学习 · 计算机科学 2023-12-11 Sacha Morin , Somjit Nath , Samira Ebrahimi Kahou , Guy Wolf

Semi-supervised action recognition aims to improve spatio-temporal reasoning ability with a few labeled data in conjunction with a large amount of unlabeled data. Albeit recent advancements, existing powerful methods are still prone to…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Yu Wang , Sanping Zhou , Kun Xia , Le Wang

In recent times, contrastive learning based loss functions have become increasingly popular for visual self-supervised representation learning owing to their state-of-the-art (SOTA) performance. Most of the modern contrastive learning…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Chaitanya Animesh , Manmohan Chandraker

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. However current theoretical analysis of SSL is mostly restricted…

机器学习 · 计算机科学 2023-09-06 Pascal Esser , Satyaki Mukherjee , Debarghya Ghoshdastidar

The surge in the significance of time series in digital health domains necessitates advanced methodologies for extracting meaningful patterns and representations. Self-supervised contrastive learning has emerged as a promising approach for…

机器学习 · 计算机科学 2025-09-25 Kevin Garcia , Cassandra Garza , Brooklyn Berry , Yifeng Gao

Self-Supervised Learning (SSL) is a valuable and robust training methodology for contemporary Deep Neural Networks (DNNs), enabling unsupervised pretraining on a 'pretext task' that does not require ground-truth labels/annotation. This…

Artificial intelligence (AI) is anticipated to play a pivotal role in 6G. However, a key challenge in developing AI-powered solutions is the extensive data collection and labeling efforts required to train supervised deep learning models.…

信号处理 · 电气工程与系统科学 2025-09-04 Ogechukwu Kanu , Ashkan Eshaghbeigi , Hatem Abou-Zeid

Self-training methods have proven to be effective in exploiting abundant unlabeled data in semi-supervised learning, particularly when labeled data is scarce. While many of these approaches rely on a cross-entropy loss function (CE), recent…

机器学习 · 计算机科学 2024-09-12 Aurelien Gauffre , Julien Horvat , Massih-Reza Amini

To address the problem of long-tail distribution for the large vocabulary object detection task, existing methods usually divide the whole categories into several groups and treat each group with different strategies. These methods bring…

计算机视觉与模式识别 · 计算机科学 2021-04-05 Tong Wang , Yousong Zhu , Chaoyang Zhao , Wei Zeng , Jinqiao Wang , Ming Tang

Pseudo-label-based semi-supervised learning (SSL) has achieved great success on raw data utilization. However, its training procedure suffers from confirmation bias due to the noise contained in self-generated artificial labels. Moreover,…

计算机视觉与模式识别 · 计算机科学 2022-09-12 Fan Yang , Kai Wu , Shuyi Zhang , Guannan Jiang , Yong Liu , Feng Zheng , Wei Zhang , Chengjie Wang , Long Zeng

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Salma Haidar , José Oramas

Deep learning-based recommender systems have achieved remarkable success in recent years. However, these methods usually heavily rely on labeled data (i.e., user-item interactions), suffering from problems such as data sparsity and…

信息检索 · 计算机科学 2023-10-12 Mengyuan Jing , Yanmin Zhu , Tianzi Zang , Ke Wang

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

机器学习 · 计算机科学 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

机器学习 · 计算机科学 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Self-supervised learning (SSL) recently has achieved outstanding success on recommendation. By setting up an auxiliary task (either predictive or contrastive), SSL can discover supervisory signals from the raw data without human annotation,…

信息检索 · 计算机科学 2022-07-26 Yinghui Tao , Min Gao , Junliang Yu , Zongwei Wang , Qingyu Xiong , Xu Wang

Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets. However, natural data could be highly correlated and…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Xudong Wang , Ziwei Liu , Stella X. Yu

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Contrastive learning, as a self-supervised learning paradigm, becomes popular for Multivariate Time-Series (MTS) classification. It ensures the consistency across different views of unlabeled samples and then learns effective…

机器学习 · 计算机科学 2024-01-11 Yucheng Wang , Yuecong Xu , Jianfei Yang , Min Wu , Xiaoli Li , Lihua Xie , Zhenghua Chen

Data collected from the real world typically exhibit long-tailed distributions, where frequent classes contain abundant data while rare ones have only a limited number of samples. While existing supervised learning approaches have been…

计算机视觉与模式识别 · 计算机科学 2023-09-18 Ci-Siang Lin , Min-Hung Chen , Yu-Chiang Frank Wang