English
Related papers

Related papers: Adaptive Cross Batch Normalization for Metric Lear…

200 papers

Metric-based meta-learning has attracted a lot of attention due to its effectiveness and efficiency in few-shot learning. Recent studies show that metric scaling plays a crucial role in the performance of metric-based meta-learning…

Machine Learning · Computer Science 2020-08-27 Jiaxin Chen , Li-Ming Zhan , Xiao-Ming Wu , Fu-lai Chung

Representation learning (RL) methods learn objects' latent embeddings where information is preserved by distances. Since distances are invariant to certain linear transformations, one may obtain different embeddings while preserving the…

Machine Learning · Computer Science 2021-01-19 Furkan Gürsoy , Mounir Haddad , Cécile Bothorel

In continual learning scenarios, catastrophic forgetting of previously learned tasks is a critical issue, making it essential to effectively measure such forgetting. Recently, there has been growing interest in focusing on representation…

Machine Learning · Computer Science 2025-06-13 Joonkyu Kim , Yejin Kim , Jy-yong Sohn

Metric learning networks are used to compute image embeddings, which are widely used in many applications such as image retrieval and face recognition. In this paper, we propose to use network distillation to efficiently compute image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Lu Yu , Vacit Oguz Yazici , Xialei Liu , Joost van de Weijer , Yongmei Cheng , Arnau Ramisa

Deep metric learning (DML) is a cornerstone of many computer vision applications. It aims at learning a mapping from the input domain to an embedding space, where semantically similar objects are located nearby and dissimilar objects far…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Artsiom Sanakoyeu , Pingchuan Ma , Vadim Tschernezki , Björn Ommer

During the training of networks for distance metric learning, minimizers of the typical loss functions can be considered as "feasible points" satisfying a set of constraints imposed by the training data. To this end, we reformulate distance…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Oğul Can , Yeti Ziya Gürbüz , A. Aydın Alatan

While many approaches exist in the literature to learn low-dimensional representations for data collections in multiple modalities, the generalizability of multi-modal nonlinear embeddings to previously unseen data is a rather overlooked…

Machine Learning · Computer Science 2021-05-05 Semih Kaya , Elif Vural

Few-shot learning is a challenging problem that has attracted more and more attention recently since abundant training samples are difficult to obtain in practical applications. Meta-learning has been proposed to address this issue, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Xian Zhong , Cheng Gu , Wenxin Huang , Lin Li , Shuqin Chen , Chia-Wen Lin

Data analysis has become a necessity in the modern era of cricket. Everything from effective team management to match win predictions use some form of analytics. Meaningful data representations are necessary for efficient analysis of data.…

Machine Learning · Computer Science 2021-08-17 Souridas Alaka , Rishikesh Sreekumar , Hrithwik Shalu

Metric learning aims at learning a distance which is consistent with the semantic meaning of the samples. The problem is generally solved by learning an embedding for each sample such that the embeddings of samples of the same category are…

Machine Learning · Computer Science 2018-09-13 Xu Zhang , Felix Xinnan Yu , Svebor Karaman , Wei Zhang , Shih-Fu Chang

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

Machine Learning · Computer Science 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Learning the distance metric between pairs of examples is of great importance for learning and visual recognition. With the remarkable success from the state of the art convolutional neural networks, recent works have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2015-11-23 Hyun Oh Song , Yu Xiang , Stefanie Jegelka , Silvio Savarese

This work focuses on the training dynamics of one associative memory module storing outer products of token embeddings. We reduce this problem to the study of a system of particles, which interact according to properties of the data…

Machine Learning · Computer Science 2024-03-01 Vivien Cabannes , Berfin Simsek , Alberto Bietti

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

Embedding learning, a.k.a. representation learning, has been shown to be able to model large-scale semantic knowledge graphs. A key concept is a mapping of the knowledge graph to a tensor representation whose entries are predicted by models…

Artificial Intelligence · Computer Science 2016-05-10 Volker Tresp , Cristóbal Esteban , Yinchong Yang , Stephan Baier , Denis Krompaß

Cross-modal image-text retrieval is challenging because of the diverse possible associations between content from different modalities. Traditional methods learn a single-vector embedding to represent semantics of each sample, but struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Hani Alomari , Anushka Sivakumar , Andrew Zhang , Chris Thomas

Metric learning projects samples into an embedded space, where similarities and dissimilarities are quantified based on their learned representations. However, existing methods often rely on label-guided representation learning, where…

Sound · Computer Science 2025-01-17 Donghuo Zeng , Kazushi Ikeda

This paper proposes a meta-learning approach to evolving a parametrized loss function, which is called Meta-Loss Network (MLN), for training the image classification learning on small datasets. In our approach, the MLN is embedded in the…

Artificial Intelligence · Computer Science 2023-10-31 Zhaoyang Hai , Xiabi Liu

Metric learning involves learning a discriminative representation such that embeddings of similar classes are encouraged to be close, while embeddings of dissimilar classes are pushed far apart. State-of-the-art methods focus mostly on…

Metric learning has become an attractive field for research on the latest years. Loss functions like contrastive loss, triplet loss or multi-class N-pair loss have made possible generating models capable of tackling complex scenarios with…

Machine Learning · Computer Science 2019-05-28 Alfonso Medela , Artzai Picon