English
Related papers

Related papers: The Group Loss for Deep Metric Learning

200 papers

The loss function is a key component in deep learning models. A commonly used loss function for classification is the cross entropy loss, which is a simple yet effective application of information theory for classification problems. Based…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Zeyu Song , Dongliang Chang , Zhanyu Ma , Xiaoxu Li , Zheng-Hua Tan

Deep metric learning (DML) is a cornerstone of many computer vision applications. It aims at learning a mapping from the input domain to an embedding space, where semantically similar objects are located nearby and dissimilar objects far…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Artsiom Sanakoyeu , Pingchuan Ma , Vadim Tschernezki , Björn Ommer

Improving the classification of multi-class imbalanced data is more difficult than its two-class counterpart. In this paper, we use deep neural networks to train new representations of tabular multi-class data. Unlike the typically…

Machine Learning · Computer Science 2023-12-19 Damian Horna , Lango Mateusz , Jerzy Stefanowski

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

Machine Learning · Computer Science 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

Deep-learning has proved in recent years to be a powerful tool for image analysis and is now widely used to segment both 2D and 3D medical images. Deep-learning segmentation frameworks rely not only on the choice of network architecture but…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Carole H Sudre , Wenqi Li , Tom Vercauteren , Sébastien Ourselin , M. Jorge Cardoso

We present a Gaussian kernel loss function and training algorithm for convolutional neural networks that can be directly applied to both distance metric learning and image classification problems. Our method treats all training features…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Benjamin J. Meyer , Ben Harwood , Tom Drummond

Recognition of objects with subtle differences has been used in many practical applications, such as car model recognition and maritime vessel identification. For discrimination of the objects in fine-grained detail, we focus on deep…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Kaan Karaman , Erhan Gundogdu , Aykut Koc , A. Aydin Alatan

Deep Metric Learning algorithms aim to learn an efficient embedding space to preserve the similarity relationships among the input data. Whilst these algorithms have achieved significant performance gains across a wide plethora of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Soumava Kumar Roy , Yan Han , Mehrtash Harandi , Lars Petersson

Learning the similarity between images constitutes the foundation for numerous vision tasks. The common paradigm is discriminative metric learning, which seeks an embedding that separates different training classes. However, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Timo Milbich , Karsten Roth , Biagio Brattoli , Björn Ommer

A family of loss functions built on pair-based computation have been proposed in the literature which provide a myriad of solutions for deep metric learning. In this paper, we provide a general weighting framework for understanding recent…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Xun Wang , Xintong Han , Weilin Huang , Dengke Dong , Matthew R. Scott

Few-shot learning is a challenging area of research that aims to learn new concepts with only a few labeled samples of data. Recent works based on metric-learning approaches leverage the meta-learning approach, which is encompassed by…

We consider the problem of constructing embeddings of large attributed graphs and supporting multiple downstream learning tasks. We develop a graph embedding method, which is based on extending deep metric and unbiased contrastive learning…

Machine Learning · Computer Science 2024-11-22 Xiang Li , Gagan Agrawal , Ruoming Jin , Rajiv Ramnath

We introduce a novel end-to-end approach for learning to cluster in the absence of labeled examples. Our clustering objective is based on optimizing normalized cuts, a criterion which measures both intra-cluster similarity as well as…

Machine Learning · Computer Science 2019-10-18 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Clustering is a fundamental unsupervised learning approach. Many clustering algorithms -- such as $k$-means -- rely on the euclidean distance as a similarity measure, which is often not the most relevant metric for high dimensional data…

Machine Learning · Computer Science 2019-10-22 Aude Genevay , Gabriel Dulac-Arnold , Jean-Philippe Vert

In this work, a discriminatively learned CNN embedding is proposed for remote sensing image scene classification. Our proposed siamese network simultaneously computes the classification loss function and the metric learning loss function of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Wen Wang , Lijun Du , Yinxing Gao , Yanzhou Su , Feng Wang , Jian Cheng

Using class labels to represent class similarity is a typical approach to training deep hashing systems for retrieval; samples from the same or different classes take binary 1 or 0 similarity values. This similarity does not model the full…

Information Retrieval · Computer Science 2019-08-16 Heikki Arponen , Tom E Bishop

Data imbalance is a well-known issue in the field of machine learning, attributable to the cost of data collection, the difficulty of labeling, and the geographical distribution of the data. In computer vision, bias in data distribution…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Shubham Shrivastava , Xianling Zhang , Sushruth Nagesh , Armin Parchami

We present a formulation of deep learning that aims at producing a large margin classifier. The notion of margin, minimum distance to a decision boundary, has served as the foundation of several theoretically profound and empirically…

Machine Learning · Statistics 2018-12-05 Gamaleldin F. Elsayed , Dilip Krishnan , Hossein Mobahi , Kevin Regan , Samy Bengio

Learning discriminative shape representations is a crucial issue for large-scale 3D shape retrieval. In this paper, we propose the Collaborative Inner Product Loss (CIP Loss) to obtain ideal shape embedding that discriminative among…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Zhaoqun Li , Cheng Xu , Biao Leng

Image-generating machine learning models are typically trained with loss functions based on distance in the image space. This often leads to over-smoothed results. We propose a class of loss functions, which we call deep perceptual…

Machine Learning · Computer Science 2016-02-10 Alexey Dosovitskiy , Thomas Brox