中文
相关论文

相关论文: Self-Supervised Learning by Curvature Alignment

200 篇论文

Semi-supervised learning (SSL) algorithms struggle to perform well when exposed to imbalanced training data. In this scenario, the generated pseudo-labels can exhibit a bias towards the majority class, and models that employ these…

机器学习 · 计算机科学 2024-09-18 Zeju Li , Ying-Qiu Zheng , Chen Chen , Saad Jbabdi

Self-Supervised learning (SSL) has become the new state-of-art in several domain classification and segmentation tasks. Of these, one popular category in SSL is distillation networks such as BYOL. This work proposes RSDnet, which applies…

计算机视觉与模式识别 · 计算机科学 2022-09-09 Pallavi Jain , Bianca Schoen-Phelan , Robert Ross

Self-supervised learning (SSL) has revolutionized visual representation learning, but has not achieved the robustness of human vision. A reason for this could be that SSL does not leverage all the data available to humans during learning.…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Arthur Aubret , Céline Teulière , Jochen Triesch

Self-supervised learning (SSL) is an efficient approach that addresses the issue of limited training data and annotation shortage. The key part in SSL is its proxy task that defines the supervisory signals and drives the learning toward…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Jiuwen Zhu , Yuexiang Li , S. Kevin Zhou

Self-supervised learning (SSL) methods based on Siamese networks learn visual representations by aligning different views of the same image. The multi-crop strategy, which incorporates small local crops to global ones, enhances many SSL…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Pierre-François De Plaen , Abhishek Jha , Luc Van Gool , Tinne Tuytelaars , Marc Proesmans

Generative Adversarial Networks (GANs) based semi-supervised learning (SSL) approaches are shown to improve classification performance by utilizing a large number of unlabeled samples in conjunction with limited labeled samples. However,…

机器学习 · 计算机科学 2020-09-16 Zexi Chen , Bharathkumar Ramachandra , Ranga Raju Vatsavai

Self-supervised learning (SSL) has recently emerged as a powerful approach to learning representations from large-scale unlabeled data, showing promising results in time series analysis. The self-supervised representation learning can be…

机器学习 · 计算机科学 2024-03-18 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

RUL estimation suffers from a server data imbalance where data from machines near their end of life is rare. Additionally, the data produced by a machine can only be labeled after the machine failed. Semi-Supervised Learning (SSL) can…

机器学习 · 计算机科学 2021-08-27 Tilman Krokotsch , Mirko Knaak , Clemens Gühmann

Contrastive self-supervised learning (CSL) for speaker verification (SV) has drawn increasing interest recently due to its ability to exploit unlabeled data. Performing data augmentation on raw waveforms, such as adding noise or…

音频与语音处理 · 电气工程与系统科学 2024-03-12 Chong-Xin Gan , Man-Wai Mak , Weiwei Lin , Jen-Tzung Chien

Subspace clustering methods based on data self-expression have become very popular for learning from data that lie in a union of low-dimensional linear subspaces. However, the applicability of subspace clustering has been limited because…

计算机视觉与模式识别 · 计算机科学 2019-05-02 Junjian Zhang , Chun-Guang Li , Chong You , Xianbiao Qi , Honggang Zhang , Jun Guo , Zhouchen Lin

Recent advances in contrastive learning have enlightened diverse applications across various semi-supervised fields. Jointly training supervised learning and unsupervised learning with a shared feature encoder becomes a common scheme.…

机器学习 · 计算机科学 2022-06-03 Cheng Tan , Zhangyang Gao , Lirong Wu , Siyuan Li , Stan Z. Li

Graph representation learning (GRL) makes considerable progress recently, which encodes graphs with topological structures into low-dimensional embeddings. Meanwhile, the time-consuming and costly process of annotating graph labels manually…

机器学习 · 计算机科学 2024-02-28 Haojun Jiang , Jiawei Sun , Jie Li , Chentao Wu

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

图像与视频处理 · 电气工程与系统科学 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Ultrasound (US) imaging is clinically invaluable due to its noninvasive and safe nature. However, interpreting US images is challenging, requires significant expertise, and time, and is often prone to errors. Deep learning offers assistive…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Edward Ellis , Andrew Bulpitt , Nasim Parsa , Michael F Byrne , Sharib Ali

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

机器学习 · 计算机科学 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

This paper focuses on webly supervised learning (WSL), where datasets are built by crawling samples from the Internet and directly using search queries as web labels. Although WSL benefits from fast and low-cost data collection, noises in…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Jingkang Yang , Litong Feng , Weirong Chen , Xiaopeng Yan , Huabin Zheng , Ping Luo , Wayne Zhang

Self-supervised learning (SSL), which aims to learn meaningful prior representations from unlabeled data, has been proven effective for skeleton-based action understanding. Different from the image domain, skeleton data possesses sparser…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Jiahang Zhang , Lilang Lin , Shuai Yang , Jiaying Liu

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

机器学习 · 计算机科学 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

Self-supervised learning (SSL) has rapidly advanced in recent years, approaching the performance of its supervised counterparts through the extraction of representations from unlabeled data. However, dimensional collapse, where a few large…

机器学习 · 计算机科学 2024-11-04 Junlin He , Jinxiao Du , Wei Ma

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

机器学习 · 计算机科学 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka