English
Related papers

Related papers: Contrastive Bayesian Analysis for Deep Metric Lear…

200 papers

Unsupervised Deep Distance Metric Learning (UDML) aims to learn sample similarities in the embedding space from an unlabeled dataset. Traditional UDML methods usually use the triplet loss or pairwise loss which requires the mining of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Binh X. Nguyen , Binh D. Nguyen , Gustavo Carneiro , Erman Tjiputra , Quang D. Tran , Thanh-Toan Do

In this paper, we present a novel deep metric learning method to tackle the multi-label image classification problem. In order to better learn the correlations among images features, as well as labels, we attempt to explore a latent space,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Changsheng Li , Chong Liu , Lixin Duan , Peng Gao , Kai Zheng

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

Machine Learning · Computer Science 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang

Deep metric learning aims at learning the distance metric between pair of samples, through the deep neural networks to extract the semantic feature embeddings where similar samples are close to each other while dissimilar samples are…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Haijun Liu , Jian Cheng , Wen Wang , Yanzhou Su

We study three intriguing properties of contrastive learning. First, we generalize the standard contrastive loss to a broader family of losses, and we find that various instantiations of the generalized loss perform similarly under the…

Machine Learning · Computer Science 2021-10-26 Ting Chen , Calvin Luo , Lala Li

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

Recent work has compared neural network representations via similarity-based analyses to improve model interpretation. The quality of a similarity measure is typically evaluated by its success in assigning a high score to representations…

Computation and Language · Computer Science 2024-09-23 Adir Rahamim , Yonatan Belinkov

Image classification is a fundamental computer vision task and an important baseline for deep metric learning. In decades efforts have been made on enhancing image classification accuracy by using deep learning models while less attention…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Yunfeng Zhao , Huiyu Zhou , Fei Wu , Xifeng Wu

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

Machine Learning · Computer Science 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Overlapping sound events are ubiquitous in real-world environments, but existing end-to-end sound event detection (SED) methods still struggle to detect them effectively. A critical reason is that these methods represent overlapping events…

Sound · Computer Science 2024-01-12 Yadong Guan , Jiqing Han , Hongwei Song , Wenjie Song , Guibin Zheng , Tieran Zheng , Yongjun He

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

Machine Learning · Statistics 2025-12-03 Ali Alvandi , Mina Rezaei

Multi-label classification (MLC) is a prediction task where each sample can have more than one label. We propose a novel contrastive learning boosted multi-label prediction model based on a Gaussian mixture variational autoencoder…

Machine Learning · Computer Science 2022-06-13 Junwen Bai , Shufeng Kong , Carla P. Gomes

In seismic interpretation, pixel-level labels of various rock structures can be time-consuming and expensive to obtain. As a result, there oftentimes exists a non-trivial quantity of unlabeled data that is left unused simply because…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib

Deep Metric Learning algorithms aim to learn an efficient embedding space to preserve the similarity relationships among the input data. Whilst these algorithms have achieved significant performance gains across a wide plethora of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Soumava Kumar Roy , Yan Han , Mehrtash Harandi , Lars Petersson

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei

Contrastive representation learning is a modern paradigm for learning representations of unlabeled data via augmentations -- precisely, contrastive models learn to embed semantically similar pairs of samples (positive pairs) closer than…

Machine Learning · Statistics 2026-01-01 Anna Van Elst , Debarghya Ghoshdastidar

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

Contrastive learning has shown outstanding performances in both supervised and unsupervised learning, and has recently been introduced to solve weakly supervised learning problems such as semi-supervised learning and noisy label learning.…

Machine Learning · Computer Science 2023-06-08 Jingyi Cui , Weiran Huang , Yifei Wang , Yisen Wang

Contrastive loss has been increasingly used in learning representations from multiple modalities. In the limit, the nature of the contrastive loss encourages modalities to exactly match each other in the latent space. Yet it remains an open…

Machine Learning · Computer Science 2023-03-13 Qian Jiang , Changyou Chen , Han Zhao , Liqun Chen , Qing Ping , Son Dinh Tran , Yi Xu , Belinda Zeng , Trishul Chilimbi

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

Machine Learning · Computer Science 2022-05-03 Ralph Peeters , Christian Bizer