中文
相关论文

相关论文: $f$-MICL: Understanding and Generalizing InfoNCE-b…

200 篇论文

Conditional contrastive learning frameworks consider the conditional sampling procedure that constructs positive or negative data pairs conditioned on specific variables. Fair contrastive learning constructs negative pairs, for example,…

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

机器学习 · 计算机科学 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Image classification is hindered by subtle inter-class differences and substantial intra-class variations, which limit the effectiveness of existing contrastive learning methods. Supervised contrastive approaches based on the InfoNCE loss…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Bin Wang , Fadi Dornaika

Quantifying and evaluating image complexity can be instrumental in enhancing the performance of various computer vision tasks. Supervised learning can effectively learn image complexity features from well-annotated datasets. However,…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Shipeng Liu , Liang Zhao , Dengfeng Chen , Zhanping Song

Model-agnostic meta-learning (MAML) is one of the most popular and widely adopted meta-learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner-loop and outer-loop updates,…

机器学习 · 计算机科学 2022-03-15 Chia-Hsiang Kao , Wei-Chen Chiu , Pin-Yu Chen

Matrix completion is a widely adopted framework in recommender systems, as predicting the missing entries in the user-item rating matrix enables a comprehensive understanding of user preferences. However, current graph neural network…

信息检索 · 计算机科学 2025-06-13 Narges Nemati , Mostafa Haghir Chehreghani

In this paper, we present CLCC, a novel contrastive learning framework for color constancy. Contrastive learning has been applied for learning high-quality visual representations for image classification. One key aspect to yield useful…

计算机视觉与模式识别 · 计算机科学 2021-06-10 Yi-Chen Lo , Chia-Che Chang , Hsuan-Chao Chiu , Yu-Hao Huang , Chia-Ping Chen , Yu-Lin Chang , Kevin Jou

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

机器学习 · 计算机科学 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

信息检索 · 计算机科学 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

Combining information from various image features has become a standard technique in concept recognition tasks. However, the optimal way of fusing the resulting kernel functions is usually unknown in practical applications. Multiple kernel…

计算机视觉与模式识别 · 计算机科学 2012-11-26 Alexander Binder , Shinichi Nakajima , Marius Kloft , Christina Müller , Wojciech Samek , Ulf Brefeld , Klaus-Robert Müller , Motoaki Kawanabe

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

计算机视觉与模式识别 · 计算机科学 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

This paper introduces Ranking Info Noise Contrastive Estimation (RINCE), a new member in the family of InfoNCE losses that preserves a ranked ordering of positive samples. In contrast to the standard InfoNCE loss, which requires a strict…

计算机视觉与模式识别 · 计算机科学 2022-01-28 David T. Hoffmann , Nadine Behrmann , Juergen Gall , Thomas Brox , Mehdi Noroozi

Various graph contrastive learning models have been proposed to improve the performance of learning tasks on graph datasets in recent years. While effective and prevalent, these models are usually carefully customized. In particular,…

机器学习 · 计算机科学 2021-11-01 Dongkuan Xu , Wei Cheng , Dongsheng Luo , Haifeng Chen , Xiang Zhang

Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the similarity-based…

机器学习 · 计算机科学 2023-03-09 Zehua Zhang , Shilin Sun , Guixiang Ma , Caiming Zhong

Advances in the field of vision-language contrastive learning have made it possible for many downstream applications to be carried out efficiently and accurately by simply taking the dot product between image and text representations. One…

机器学习 · 计算机科学 2023-10-20 Yifei Zhou , Juntao Ren , Fengyu Li , Ramin Zabih , Ser-Nam Lim

We approach self-supervised learning of image representations from a statistical dependence perspective, proposing Self-Supervised Learning with the Hilbert-Schmidt Independence Criterion (SSL-HSIC). SSL-HSIC maximizes dependence between…

机器学习 · 统计学 2021-12-06 Yazhe Li , Roman Pogodin , Danica J. Sutherland , Arthur Gretton

This paper presents to integrate the auxiliary information (e.g., additional attributes for data such as the hashtags for Instagram images) in the self-supervised learning process. We first observe that the auxiliary information may bring…

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Perceiving the similarity between images has been a long-standing and fundamental problem underlying various visual generation tasks. Predominant approaches measure the inter-image distance by computing pointwise absolute deviations, which…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Fangneng Zhan , Jiahui Zhang , Yingchen Yu , Rongliang Wu , Shijian Lu

In typical multimodal contrastive learning, such as CLIP, encoders produce one point in the latent representation space for each input. However, one-point representation has difficulty in capturing the relationship and the similarity…

机器学习 · 计算机科学 2025-03-04 Toshimitsu Uesaka , Taiji Suzuki , Yuhta Takida , Chieh-Hsin Lai , Naoki Murata , Yuki Mitsufuji