中文
相关论文

相关论文: Mean Shift for Self-Supervised Learning

200 篇论文

While contrastive approaches of self-supervised learning (SSL) learn representations by minimizing the distance between two augmented views of the same data point (positive pairs) and maximizing views from different data points (negative…

机器学习 · 计算机科学 2021-10-11 Yuandong Tian , Xinlei Chen , Surya Ganguli

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for…

计算机视觉与模式识别 · 计算机科学 2023-07-19 Yu Du , Miaojing Shi , Fangyun Wei , Guoqi Li

Clustering algorithms partition a dataset into groups of similar points. The primary contribution of this article is the Multiscale Spatially-Regularized Diffusion Learning (M-SRDL) clustering algorithm, which uses spatially-regularized…

机器学习 · 计算机科学 2022-04-08 Sam L. Polk , James M. Murphy

Given a similarity metric, contrastive methods learn a representation in which examples that are similar are pushed together and examples that are dissimilar are pulled apart. Contrastive learning techniques have been utilized extensively…

机器学习 · 计算机科学 2023-07-07 Emily Mu , John Guttag , Maggie Makar

Machine learning qualifies computers to assimilate with data, without being solely programmed [1, 2]. Machine learning can be classified as supervised and unsupervised learning. In supervised learning, computers learn an objective that…

Image clustering is an important and open-challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the image features, thus…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Shaotian Cai , Liping Qiu , Xiaojun Chen , Qin Zhang , Longteng Chen

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

计算机视觉与模式识别 · 计算机科学 2023-07-31 BW Sheffield

Rigid image alignment is a fundamental task in computer vision, while the traditional algorithms are either too sensitive to noise or time-consuming. Recent unsupervised image alignment methods developed based on spatial transformer…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Yu-Xuan Chen , Dagan Feng , Hong-Bin Shen

Recently, self-supervised metric learning has raised attention for the potential to learn a generic distance function. It overcomes the limitations of conventional supervised one, e.g., scalability and label biases. Despite progress in this…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Jiantao Wu , Shentong Mo , Sara Atito , Josef Kittler , Zhenhua Feng , Muhammad Awais

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

机器学习 · 计算机科学 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

In this work we examine how fine-tuning impacts the fairness of contrastive Self-Supervised Learning (SSL) models. Our findings indicate that Batch Normalization (BN) statistics play a crucial role, and that updating only the BN statistics…

机器学习 · 计算机科学 2021-10-04 Jason Ramapuram , Dan Busbridge , Russ Webb

The deep learning technique was used to increase the performance of single image super-resolution (SISR). However, most existing CNN-based SISR approaches primarily focus on establishing deeper or larger networks to extract more significant…

计算机视觉与模式识别 · 计算机科学 2022-12-29 Huipeng Zheng , Lukman Hakim , Takio Kurita , Junichi Miyao

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

机器学习 · 计算机科学 2022-05-25 Michael C. Burkhart , Kyle Shan

Self-supervised learning (SSL) methods learn from unlabeled data and achieve high generalization performance on downstream tasks. However, they may also suffer from overfitting to their training data and lose the ability to adapt to new…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Wenwen Qiang , Zeen Song , Ziyin Gu , Jiangmeng Li , Changwen Zheng , Fuchun Sun , Hui Xiong

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

With the recent promising results of contrastive learning in the self-supervised learning paradigm, supervised contrastive learning has successfully extended these contrastive approaches to supervised contexts, outperforming cross-entropy…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Jaewon Kim , Hyukjong Lee , Jooyoung Chang , Sang Min Park

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

机器学习 · 计算机科学 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

In open-world semi-supervised learning, a machine learning model is tasked with uncovering novel categories from unlabeled data while maintaining performance on seen categories from labeled data. The central challenge is the substantial…

机器学习 · 计算机科学 2024-04-18 Bo Ye , Kai Gan , Tong Wei , Min-Ling Zhang

Due to the existence of various views or representations in many real-world data, multi-view learning has drawn much attention recently. Multi-view spectral clustering methods based on similarity matrixes or graphs are pretty popular.…

计算机视觉与模式识别 · 计算机科学 2017-09-13 Nan Xu , Yanqing Guo , Jiujun Wang , Xiangyang Luo , Ran He

Recently, self-supervised learning (SSL) methods have been used in pre-training the segmentation models for 2D and 3D medical images. Most of these methods are based on reconstruction, contrastive learning and consistency regularization.…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Haofeng Li , Yiming Ouyang , Xiang Wan