English
Related papers

Related papers: Ranked List Loss for Deep Metric Learning

200 papers

A key characteristic of deep recommendation models is the immense memory requirements of their embedding tables. These embedding tables can often reach hundreds of gigabytes which increases hardware requirements and training cost. A common…

Deep metric learning aims at learning the distance metric between pair of samples, through the deep neural networks to extract the semantic feature embeddings where similar samples are close to each other while dissimilar samples are…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Haijun Liu , Jian Cheng , Wen Wang , Yanzhou Su

In this paper, we aim to learn a mapping (or embedding) from images to a compact binary space in which Hamming distances correspond to a ranking measure for the image retrieval task. We make use of a triplet loss because this has been shown…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Bohan Zhuang , Guosheng Lin , Chunhua Shen , Ian Reid

Deep Metric Learning (DML) serves to learn an embedding function to project semantically similar data into nearby embedding space and plays a vital role in many applications, such as image retrieval and face recognition. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Lizhao Liu , Shangxin Huang , Zhuangwei Zhuang , Ran Yang , Mingkui Tan , Yaowei Wang

This paper describes one objective function for learning semantically coherent feature embeddings in multi-output classification problems, i.e., when the response variables have dimension higher than one. In particular, we consider the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Hugo Proença , Ehsan Yaghoubi , Pendar Alirezazadeh

Deep metric learning is essential for visual recognition. The widely used pair-wise (or triplet) based loss objectives cannot make full use of semantical information in training samples or give enough attention to those hard samples during…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Lin Xu , Han Sun , Yuai Liu

We employ triplet loss as a feature embedding regularizer to boost classification performance. Standard architectures, like ResNet and Inception, are extended to support both losses with minimal hyper-parameter tuning. This promotes…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

Embedded spaces are a key feature in deep learning. Good embedded spaces represent the data well to support classification and advanced techniques such as open-set recognition, few-short learning and explainability. This paper presents a…

Machine Learning · Computer Science 2024-08-06 Stefan Scholl

Few-shot deep learning is a topical challenge area for scaling visual recognition to open ended growth of unseen new classes with limited labeled examples. A promising approach is based on metric learning, which trains a deep embedding to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Xueting Zhang , Yuting Qiang , Flood Sung , Yongxin Yang , Timothy M. Hospedales

Estimating causal treatment effects in observational settings is frequently compromised by selection bias arising from unobserved confounders. While traditional econometric methods struggle when these confounders are orthogonal to…

Artificial Intelligence · Computer Science 2026-01-06 Ahmed Dawoud , Osama El-Shamy

There is extensive interest in metric learning methods for image retrieval. Many metric learning loss functions focus on learning a correct ranking of training samples, but strongly overfit semantically inconsistent labels and require a…

Machine Learning · Computer Science 2023-06-05 Christopher Liao , Theodoros Tsiligkaridis , Brian Kulis

Recent studies have shown that many deep metric learning loss functions perform very similarly under the same experimental conditions. One potential reason for this unexpected result is that all losses let the network focus on similar image…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Konstantin Kobs , Michael Steininger , Andrzej Dulny , Andreas Hotho

Metric learning is a fundamental problem in computer vision whereby a model is trained to learn a semantically useful embedding space via ranking losses. Traditionally, the effectiveness of a ranking loss depends on the minibatch size, and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Thalaiyasingam Ajanthan , Matt Ma , Anton van den Hengel , Stephen Gould

The field of meta-learning has seen a dramatic rise in interest in recent years. In existing meta-learning approaches, learning tasks for training meta-models are usually collected from public datasets, which brings the difficulty of…

Machine Learning · Computer Science 2021-11-23 Zhaoyang Hai , Xiabi Liu , Yuchen Ren , Nouman Q. Soomro

Evaluation metrics in machine learning are often hardly taken as loss functions, as they could be non-differentiable and non-decomposable, e.g., average precision and F1 score. This paper aims to address this problem by revisiting the…

Machine Learning · Computer Science 2022-03-01 Tao Huang , Zekang Li , Hua Lu , Yong Shan , Shusheng Yang , Yang Feng , Fei Wang , Shan You , Chang Xu

Deep neural networks trained using a softmax layer at the top and the cross-entropy loss are ubiquitous tools for image classification. Yet, this does not naturally enforce intra-class similarity nor inter-class margin of the learned deep…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 José Lezama , Qiang Qiu , Pablo Musé , Guillermo Sapiro

Learning to generate a task-aware base learner proves a promising direction to deal with few-shot learning (FSL) problem. Existing methods mainly focus on generating an embedding model utilized with a fixed metric (eg, cosine distance) for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Lei Zhang , Fei Zhou , Wei Wei , Yanning Zhang

We address the problem of merging graph and feature-space information while learning a metric from structured data. Existing algorithms tackle the problem in an asymmetric way, by either extracting vectorized summaries of the graph…

Machine Learning · Computer Science 2020-02-17 Nicolo Colombo

Intelligent diagnosis method based on data-driven and deep learning is an attractive and meaningful field in recent years. However, in practical application scenarios, the imbalance of time-series fault is an urgent problem to be solved.…

Machine Learning · Computer Science 2021-07-15 Xingtai Gui , Jiyang Zhang

The continually increasing number of complex datasets each year necessitates ever improving machine learning methods for robust and accurate categorization of these data. This paper introduces Random Multimodel Deep Learning (RMDL): a new…

Machine Learning · Computer Science 2018-06-01 Kamran Kowsari , Mojtaba Heidarysafa , Donald E. Brown , Kiana Jafari Meimandi , Laura E. Barnes