中文
相关论文

相关论文: Non-contrastive representation learning for interv…

200 篇论文

One-stage object detectors such as the YOLO family achieve state-of-the-art performance in real-time vision applications but remain heavily reliant on large-scale labeled datasets for training. In this work, we present a systematic study of…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Manikanta Kotthapalli , Reshma Bhatia , Nainsi Jain

While state-of-the-art contrastive Self-Supervised Learning (SSL) models produce results competitive with their supervised counterparts, they lack the ability to infer latent variables. In contrast, prescribed latent variable (LV) models…

机器学习 · 计算机科学 2021-12-01 Jason Ramapuram , Dan Busbridge , Xavier Suau , Russ Webb

Bootstrap Your Own Latent (BYOL) introduced an approach to self-supervised learning avoiding the contrastive paradigm and subsequently removing the computational burden of negative sampling associated with such methods. However, we…

机器学习 · 计算机科学 2022-03-29 Aiden Durrant , Georgios Leontidis

Cell identification within the H&E slides is an essential prerequisite that can pave the way towards further pathology analyses including tissue classification, cancer grading, and phenotype prediction. However, performing such a task using…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Ramin Nakhli , Amirali Darbandsari , Hossein Farahani , Ali Bashashati

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

机器学习 · 计算机科学 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Concept-oriented deep learning (CODL) is a general approach to meet the future challenges for deep learning: (1) learning with little or no external supervision, (2) coping with test examples that come from a different distribution than the…

机器学习 · 计算机科学 2022-02-04 Daniel T. Chang

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the…

机器学习 · 计算机科学 2023-06-27 Quentin Garrido , Yubei Chen , Adrien Bardes , Laurent Najman , Yann Lecun

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

机器学习 · 计算机科学 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a classification task for an encoder with well representation…

计算与语言 · 计算机科学 2021-12-03 Deshui Miao , Jiaqi Zhang , Wenbo Xie , Jian Song , Xin Li , Lijuan Jia , Ning Guo

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

计算机视觉与模式识别 · 计算机科学 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Sequential Recommendationdescribes a set of techniques to model dynamic user behavior in order to predict future interactions in sequential user data. At their core, such approaches model transition probabilities between items in a…

信息检索 · 计算机科学 2021-08-17 Zhiwei Liu , Yongjun Chen , Jia Li , Philip S. Yu , Julian McAuley , Caiming Xiong

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

A major bottleneck in training robust Human-Activity Recognition models (HAR) is the need for large-scale labeled sensor datasets. Because labeling large amounts of sensor data is an expensive task, unsupervised and semi-supervised learning…

机器学习 · 计算机科学 2022-02-03 Yash Jain , Chi Ian Tang , Chulhong Min , Fahim Kawsar , Akhil Mathur

Most of the current self-supervised representation learning (SSL) methods are based on the contrastive loss and the instance-discrimination task, where augmented versions of the same image instance ("positives") are contrasted with…

机器学习 · 计算机科学 2021-05-17 Aleksandr Ermolov , Aliaksandr Siarohin , Enver Sangineto , Nicu Sebe

Long-tailed semi-supervised learning poses a significant challenge in training models with limited labeled data exhibiting a long-tailed label distribution. Current state-of-the-art LTSSL approaches heavily rely on high-quality…

机器学习 · 计算机科学 2024-10-10 Zi-Hao Zhou , Siyuan Fang , Zi-Jing Zhou , Tong Wei , Yuanyu Wan , Min-Ling Zhang

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

机器学习 · 计算机科学 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

Contrastive learning (CL) has recently emerged as an alternative to traditional supervised machine learning solutions by enabling rich representations from unstructured and unlabeled data. However, CL and, more broadly, self-supervised…

机器学习 · 计算机科学 2025-07-10 Roberto Pereira , Fernanda Famá , Asal Rangrazi , Marco Miozzo , Charalampos Kalalas , Paolo Dini