中文
相关论文

相关论文: Preventing Dimensional Collapse in Self-Supervised…

200 篇论文

Self-Supervised Learning (SSL) has shown great promise in learning representations from unlabeled data. The power of learning representations without the need for human annotations has made SSL a widely used technique in real-world…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Aryan Satpathy , Nilaksh Singh , Dhruva Rajwade , Somesh Kumar

We propose a novel method for semi-supervised learning (SSL) based on data-driven distributionally robust optimization (DRO) using optimal transport metrics. Our proposed method enhances generalization error by using the unlabeled data to…

机器学习 · 统计学 2020-04-21 Jose Blanchet , Yang Kang

3D-aware Generative Adversarial Networks (3D-GANs) currently exhibit artifacts in their 3D geometrical modeling, such as mesh imperfections and holes. These shortcomings are primarily attributed to the limited availability of annotated 3D…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Jiarong Guo , Xiaogang Xu , Hengshuang Zhao

A combinatory approach of two well-known fields: deep learning and semi supervised learning is presented, to tackle the land cover identification problem. The proposed methodology demonstrates the impact on the performance of deep learning…

计算机视觉与模式识别 · 计算机科学 2020-06-02 Eftychios Protopapadakis , Anastasios Doulamis , Nikolaos Doulamis , Evangelos Maltezos

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Contrastive methods have led a recent surge in the performance of self-supervised representation learning (SSL). Recent methods like BYOL or SimSiam purportedly distill these contrastive methods down to their essence, removing bells and…

机器学习 · 计算机科学 2022-11-03 Alexander C. Li , Alexei A. Efros , Deepak Pathak

Deep learning methods, in particular trained Convolutional Neural Networks (CNNs) have recently been shown to produce compelling state-of-the-art results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the low…

计算机视觉与模式识别 · 计算机科学 2018-02-07 Tiantong Guo , Hojjat S. Mousavi , Vishal Monga

In many modern data sets, High dimension low sample size (HDLSS) data is prevalent in many fields of studies. There has been an increased focus recently on using machine learning and statistical methods to mine valuable information out of…

最优化与控制 · 数学 2023-05-23 Srivathsan Amruth , Xin Yee Lam

Prediction is a fundamental capability of all living organisms, and has been proposed as an objective for learning sensory representations. Recent work demonstrates that in primate visual systems, prediction is facilitated by neural…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Xueyan Niu , Cristina Savin , Eero P. Simoncelli

Despite recent advancements in deep learning, its application in real-world medical settings, such as phonocardiogram (PCG) classification, remains limited. A significant barrier is the lack of high-quality annotated datasets, which hampers…

机器学习 · 计算机科学 2025-04-08 Aristotelis Ballas , Vasileios Papapanagiotou , Christos Diou

Deep neural networks need huge amount of training data, while in real world there is a scarcity of data available for training purposes. To resolve these issues, self-supervised learning (SSL) methods are used. SSL using geometric…

计算机视觉与模式识别 · 计算机科学 2022-02-18 Muhammad Ali , Sayed Hashim

Self-supervised learning (SSL) has recently shown notable success in various visual tasks. However, in terms of discriminability, SSL is still not on par with supervised learning (SL). This paper identifies a key issue, the ``crowding…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Zeen Song , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

Self-supervised learning allows AI systems to learn effective representations from large amounts of data using tasks that do not require costly labeling. Mode collapse, i.e., the model producing identical representations for all inputs, is…

机器学习 · 计算机科学 2022-09-19 Serdar Ozsoy , Shadi Hamdan , Sercan Ö. Arik , Deniz Yuret , Alper T. Erdogan

Self-supervised learning (SSL), which aims to learn meaningful prior representations from unlabeled data, has been proven effective for skeleton-based action understanding. Different from the image domain, skeleton data possesses sparser…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Jiahang Zhang , Lilang Lin , Shuai Yang , Jiaying Liu

Self-supervised learning (SSL) has emerged as a promising paradigm that presents supervisory signals to real-world problems, bypassing the extensive cost of manual labeling. Consequently, self-supervised anomaly detection (SSAD) has seen a…

机器学习 · 计算机科学 2025-07-22 Jaemin Yoo , Lingxiao Zhao , Leman Akoglu

Self-supervised learning (SSL) has recently shown tremendous potential to learn generic visual representations useful for many image analysis tasks. Despite their notable success, the existing SSL methods fail to generalize to downstream…

计算机视觉与模式识别 · 计算机科学 2021-10-07 Chetan L Srinidhi , Anne L Martel

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

机器学习 · 统计学 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

A major limitation in applying deep learning to artificial intelligence (AI) systems is the scarcity of high-quality curated datasets. We investigate strong augmentation based self-supervised learning (SSL) techniques to address this…

图像与视频处理 · 电气工程与系统科学 2022-03-18 John D. Miller , Vignesh A. Arasu , Albert X. Pu , Laurie R. Margolies , Weiva Sieh , Li Shen

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

机器学习 · 计算机科学 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost