English
Related papers

Related papers: Contrasting quadratic assignments for set-based re…

200 papers

Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

Classical machine learners are designed only to tackle one task without capability of adopting new emerging tasks or classes whereas such capacity is more practical and human-like in the real world. To address this shortcoming, continual…

Machine Learning · Computer Science 2021-12-06 Xuejun Han , Yuhong Guo

In seismic interpretation, pixel-level labels of various rock structures can be time-consuming and expensive to obtain. As a result, there oftentimes exists a non-trivial quantity of unlabeled data that is left unused simply because…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib

Contrastive self-supervised learning has shown impressive results in learning visual representations from unlabeled images by enforcing invariance against different data augmentations. However, the learned representations are often…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Sangwoo Mo , Hyunwoo Kang , Kihyuk Sohn , Chun-Liang Li , Jinwoo Shin

Recent self-supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Elijah Cole , Xuan Yang , Kimberly Wilber , Oisin Mac Aodha , Serge Belongie

The sequential recommendation aims at predicting the next items in user behaviors, which can be solved by characterizing item relationships in sequences. Due to the data sparsity and noise issues in sequences, a new self-supervised learning…

Machine Learning · Computer Science 2022-03-30 Zhiwei Liu , Yongjun Chen , Jia Li , Man Luo , Philip S. Yu , Caiming Xiong

In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-supervised approach. Given an input sentence, it optimizes a joint self-contrastive and decorrelation objective. Learning a representation is facilitated by leveraging…

Computation and Language · Computer Science 2022-03-16 Tassilo Klein , Moin Nabi

Self-supervised contrastive learning (CL) has achieved state-of-the-art performance in representation learning by minimizing the distance between positive pairs while maximizing that of negative ones. Recently, it has been verified that the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jin-Young Kim , Soonwoo Kwon , Hyojun Go , Yunsung Lee , Seungtaek Choi , Hyun-Gyoon Kim

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Computation and Language · Computer Science 2021-03-29 Dongsheng Luo , Wei Cheng , Jingchao Ni , Wenchao Yu , Xuchao Zhang , Bo Zong , Yanchi Liu , Zhengzhang Chen , Dongjin Song , Haifeng Chen , Xiang Zhang

Existing approaches for unsupervised metric learning focus on exploring self-supervision information within the input image itself. We observe that, when analyzing images, human eyes often compare images against each other instead of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Yang Li , Shichao Kan , Zhihai He

Analysis of cardiac ultrasound images is commonly performed in routine clinical practice for quantification of cardiac function. Its increasing automation frequently employs deep learning networks that are trained to predict disease or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Agisilaos Chartsias , Shan Gao , Angela Mumith , Jorge Oliveira , Kanwal Bhatia , Bernhard Kainz , Arian Beqiri

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami

As the basic element of graph-structured data, node has been recognized as the main object of study in graph representation learning. A single node intuitively has multiple node-centered subgraphs from the whole graph (e.g., one person in a…

Artificial Intelligence · Computer Science 2023-09-01 Dong Li , Wenjun Wang , Minglai Shao , Chen Zhao

Session-based recommendation aims to predict intents of anonymous users based on limited behaviors. With the ability in alleviating data sparsity, contrastive learning is prevailing in the task. However, we spot that existing contrastive…

Information Retrieval · Computer Science 2025-06-06 Xiaokun Zhang , Bo Xu , Fenglong Ma , Zhizheng Wang , Liang Yang , Hongfei Lin

Self-supervised visual representation learning aims to learn useful representations without relying on human annotations. Joint embedding approach bases on maximizing the agreement between embedding vectors from different views of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Li Jing , Pascal Vincent , Yann LeCun , Yuandong Tian

Unsupervised learning of visual similarities is of paramount importance to computer vision, particularly due to lacking training data for fine-grained similarities. Deep learning of similarities is often based on relationships between pairs…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Miguel A Bautista , Artsiom Sanakoyeu , Björn Ommer

Contrastive Learning (CL) has been successfully applied to classification and other downstream tasks related to concrete concepts, such as objects contained in the ImageNet dataset. No attempts seem to have been made so far in applying this…

Machine Learning · Computer Science 2025-05-30 Daniel N. Nissani

Vector representations of natural language are ubiquitous in search applications. Recently, various methods based on contrastive learning have been proposed to learn textual representations from unlabelled data; by maximizing alignment…

Computation and Language · Computer Science 2023-07-17 Sachin J. Chanchani , Ruihong Huang

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

Machine Learning · Computer Science 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov