中文
相关论文

相关论文: Contrastive Similarity Matching for Supervised Lea…

200 篇论文

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Zhenyuan Lu

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

机器学习 · 统计学 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

Contrastive representation learning has been outstandingly successful in practice. In this work, we identify two key properties related to the contrastive loss: (1) alignment (closeness) of features from positive pairs, and (2) uniformity…

机器学习 · 计算机科学 2022-08-17 Tongzhou Wang , Phillip Isola

Brain-inspired machine intelligence research seeks to develop computational models that emulate the information processing and adaptability that distinguishes biological systems of neurons. This has led to the development of spiking neural…

神经与进化计算 · 计算机科学 2024-10-28 Alexander Ororbia

Contrastive Learning (CL) has emerged as a powerful method for training feature extraction models using unlabeled data. Recent studies suggest that incorporating a linear projection head post-backbone significantly enhances model…

机器学习 · 计算机科学 2024-10-08 Huanran Li , Daniel Pimentel-Alarcón

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

机器学习 · 计算机科学 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

机器学习 · 计算机科学 2023-03-03 Heejeong Choi , Pilsung Kang

The rapid proliferation of digital content and the ever-growing need for precise object recognition and segmentation have driven the advancement of cutting-edge techniques in the field of object classification and segmentation. This paper…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

A recent breakthrough in biologically-plausible normative frameworks for dimensionality reduction is based upon the similarity matching cost function and the low-rank matrix approximation problem. Despite clear biological interpretation,…

神经元与认知 · 定量生物学 2025-06-09 Veronica Centorrino , Francesco Bullo , Giovanni Russo

In recent years, contrastive learning achieves impressive results on self-supervised visual representation learning, but there still lacks a rigorous understanding of its learning dynamics. In this paper, we show that if we cast a…

机器学习 · 计算机科学 2023-03-09 Yifei Wang , Qi Zhang , Tianqi Du , Jiansheng Yang , Zhouchen Lin , Yisen Wang

Dense correspondence across semantically related images has been extensively studied, but still faces two challenges: 1) large variations in appearance, scale and pose exist even for objects from the same category, and 2) labeling…

计算机视觉与模式识别 · 计算机科学 2022-03-11 Taihong Xiao , Sifei Liu , Shalini De Mello , Zhiding Yu , Jan Kautz , Ming-Hsuan Yang

Self-supervised representation learning is a critical problem in computer vision, as it provides a way to pretrain feature extractors on large unlabeled datasets that can be used as an initialization for more efficient and effective…

计算机视觉与模式识别 · 计算机科学 2020-12-25 Yunze Liu , Li Yi , Shanghang Zhang , Qingnan Fan , Thomas Funkhouser , Hao Dong

Contrastive learning has demonstrated great success in representation learning, especially for image classification tasks. However, there is still a shortage in studies targeting regression tasks, and more specifically applications on…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Mohamad Dhaini , Paul Honeine , Maxime Berar , Antonin Van Exem

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

机器学习 · 计算机科学 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Contrastive learning is an efficient approach to self-supervised representation learning. Although recent studies have made progress in the theoretical understanding of contrastive learning, the investigation of how to characterize the…

机器学习 · 计算机科学 2023-08-21 Hiroki Waida , Yuichiro Wada , Léo Andéol , Takumi Nakagawa , Yuhui Zhang , Takafumi Kanamori

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

Advanced self-supervised visual representation learning methods rely on the instance discrimination (ID) pretext task. We point out that the ID task has an implicit semantic consistency (SC) assumption, which may not hold in unconstrained…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Yucheng Zhao , Guangting Wang , Chong Luo , Wenjun Zeng , Zheng-Jun Zha

Neural networks represent data as projections on trained weights in a high dimensional manifold. The trained weights act as a knowledge base consisting of causal class dependencies. Inference built on features that identify these…

机器学习 · 计算机科学 2021-03-24 Mohit Prabhushankar , Ghassan AlRegib