中文
相关论文

相关论文: Engineering the Neural Collapse Geometry of Superv…

200 篇论文

Conventional semi-supervised contrastive learning methods assign pseudo-labels only to samples whose highest predicted class probability exceeds a predefined threshold, and then perform supervised contrastive learning using those selected…

机器学习 · 计算机科学 2026-01-09 Shogo Nakayama , Masahiro Okuda

Graph contrastive learning (GCL) is an effective paradigm for node representation learning in graphs. The key components hidden behind GCL are data augmentation and positive-negative pair selection. Typical data augmentations in GCL, such…

机器学习 · 计算机科学 2024-07-25 Jiaqiang Zhang , Songcan Chen

We propose an intra-class subdivision pixel contrastive learning (SPCL) framework for cardiac image segmentation to address representation contamination at boundaries. The novel concept ``Unconcerned sample'' is proposed to distinguish…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Jiajun Zhao , Xuan Yang

SCGAN adds a similarity constraint between generated images and conditions as a regularization term on generative adversarial networks. Similarity constraint works as a tutor to instruct the generator network to comprehend the difference of…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Iman Yazdanpanah , Ali Eslamian

This paper introduces a semi-supervised contrastive learning framework and its application to text-independent speaker verification. The proposed framework employs generalized contrastive loss (GCL). GCL unifies losses from two different…

音频与语音处理 · 电气工程与系统科学 2020-06-09 Nakamasa Inoue , Keita Goto

In computational pathology, we often face a scarcity of annotations and a large amount of unlabeled data. One method for dealing with this is semi-supervised learning which is commonly split into a self-supervised pretext task and a…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Manuel Tran , Sophia J. Wagner , Melanie Boxberg , Tingying Peng

The recent emergence of contrastive learning approaches facilitates the application on graph representation learning (GRL), introducing graph contrastive learning (GCL) into the literature. These methods contrast semantically similar and…

机器学习 · 计算机科学 2022-06-03 Ganqu Cui , Yufeng Du , Cheng Yang , Jie Zhou , Liang Xu , Xing Zhou , Xingyi Cheng , Zhiyuan Liu

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

机器学习 · 统计学 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2022-02-09 Hyungtae Lee , Heesung Kwon

Recent advances in theoretical Deep Learning have introduced geometric properties that occur during training, past the Interpolation Threshold -- where the training error reaches zero. We inquire into the phenomena coined Neural Collapse in…

机器学习 · 计算机科学 2022-06-14 Ido Ben-Shaul , Shai Dekel

Place recognition is an essential and challenging task in loop closing and global localization for robotics and autonomous driving applications. Benefiting from the recent advances in deep learning techniques, the performance of LiDAR place…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Jiafeng Cui , Xieyuanli Chen

Existing graph contrastive learning (GCL) techniques typically require two forward passes for a single instance to construct the contrastive loss, which is effective for capturing the low-frequency signals of node features. Such a dual-pass…

机器学习 · 计算机科学 2023-11-21 Haonan Wang , Jieyu Zhang , Qi Zhu , Wei Huang , Kenji Kawaguchi , Xiaokui Xiao

To improve the detection accuracy and generalization of steganalysis, this paper proposes the Steganalysis Contrastive Framework (SCF) based on contrastive learning. The SCF improves the feature representation of steganalysis by maximizing…

人工智能 · 计算机科学 2021-03-02 Yanzhen Ren , Yiwen Liu , Lina Wang

Texture classification is a pivotal task in computer vision, presenting unique challenges due to high inter-class similarity and the sensitivity of structural patterns to scale and illumination changes. While Convolutional Neural Networks…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Joao B Florindo

Cross entropy loss has served as the main objective function for classification-based tasks. Widely deployed for learning neural network classifiers, it shows both effectiveness and a probabilistic interpretation. Recently, after the…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Rahaf Aljundi , Yash Patel , Milan Sulc , Daniel Olmeda , Nikolay Chumerin

Training effective embodied AI agents often involves manual reward engineering, expert imitation, specialized components such as maps, or leveraging additional sensors for depth and localization. Another approach is to use neural…

计算机视觉与模式识别 · 计算机科学 2022-12-05 Kunal Pratap Singh , Jordi Salvador , Luca Weihs , Aniruddha Kembhavi

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

机器学习 · 计算机科学 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

机器学习 · 计算机科学 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu