English
Related papers

Related papers: No Fuss Distance Metric Learning using Proxies

200 papers

Metric learning has become an attractive field for research on the latest years. Loss functions like contrastive loss, triplet loss or multi-class N-pair loss have made possible generating models capable of tackling complex scenarios with…

Machine Learning · Computer Science 2019-05-28 Alfonso Medela , Artzai Picon

During the training of networks for distance metric learning, minimizers of the typical loss functions can be considered as "feasible points" satisfying a set of constraints imposed by the training data. To this end, we reformulate distance…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Oğul Can , Yeti Ziya Gürbüz , A. Aydın Alatan

Distances are pervasive in machine learning. They serve as similarity measures, loss functions, and learning targets; it is said that a good distance measure solves a task. When defining distances, the triangle inequality has proven to be a…

Machine Learning · Computer Science 2020-07-08 Silviu Pitis , Harris Chan , Kiarash Jamali , Jimmy Ba

This paper presents an analysis regarding an influence of the Distance Metric Learning (DML) loss functions on the supervised fine-tuning of the language models for classification tasks. We experimented with known datasets from SentEval…

Computation and Language · Computer Science 2022-11-29 Witold Sosnowski , Karolina Seweryn , Anna Wróblewska , Piotr Gawrysiak

In many practical applications of constrained optimization, scale and solving time limits make traditional optimization solvers prohibitively slow. Thus, the research question of how to design optimization proxies -- machine learning models…

Machine Learning · Computer Science 2025-02-14 Michael Klamkin , Mathieu Tanneau , Pascal Van Hentenryck

Triplet loss is widely used for learning local descriptors from image patch. However, triplet loss only minimizes the Euclidean distance between matching descriptors and maximizes that between the non-matching descriptors, which neglects…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Honghu Pan , Fanyang Meng , Zhenyu He , Yongsheng Liang , Wei Liu

Deep metric learning is essential for visual recognition. The widely used pair-wise (or triplet) based loss objectives cannot make full use of semantical information in training samples or give enough attention to those hard samples during…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Lin Xu , Han Sun , Yuai Liu

The Triplet Margin Ranking Loss is one of the most widely used loss functions in Siamese Networks for solving Distance Metric Learning (DML) problems. This loss function depends on a margin parameter {\mu}, which defines the minimum…

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

Machine Learning · Computer Science 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

The objective of deep metric learning (DML) is to learn embeddings that can capture semantic similarity and dissimilarity information among data points. Existing pairwise or tripletwise loss functions used in DML are known to suffer from…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Xinshao Wang , Yang Hua , Elyor Kodirov , Neil M. Robertson

This work focuses on active learning of distance metrics from relative comparison information. A relative comparison specifies, for a data point triplet $(x_i,x_j,x_k)$, that instance $x_i$ is more similar to $x_j$ than to $x_k$. Such…

Machine Learning · Computer Science 2014-09-16 Sicheng Xiong , Rómer Rosales , Yuanli Pei , Xiaoli Z. Fern

Unsupervised deep metric learning (UDML) focuses on learning a semantic representation space using only unlabeled data. This challenging problem requires accurately estimating the similarity between data points, which is used to supervise a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shubhang Bhatnagar , Narendra Ahuja

We propose a simple modification from a fixed margin triplet loss to an adaptive margin triplet loss. While the original triplet loss is used widely in classification problems such as face recognition, face re-identification and…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Mai Lan Ha , Volker Blanz

We present an active learning strategy for training parametric models of distance metrics, given triplet-based similarity assessments: object $x_i$ is more similar to object $x_j$ than to $x_k$. In contrast to prior work on class-based…

Machine Learning · Computer Science 2020-05-26 Priyadarshini K , Ritesh Goru , Siddhartha Chaudhuri , Subhasis Chaudhuri

The mainstream researche in deep metric learning can be divided into two genres: proxy-based and pair-based methods. Proxy-based methods have attracted extensive attention due to the lower training complexity and fast network convergence.…

Information Retrieval · Computer Science 2023-04-19 Xinyue Li , Jian Wang , Wei Song , Yanling Du , Zhixiang Liu

We propose a novel distance-based regularization method for deep metric learning called Multi-level Distance Regularization (MDR). MDR explicitly disturbs a learning procedure by regularizing pairwise distances between embedding vectors…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Yonghyun Kim , Wonpyo Park

This paper studies how to train machine-learning models that directly approximate the optimal solutions of constrained optimization problems. This is an empirical risk minimization under constraints, which is challenging as training must…

Machine Learning · Computer Science 2022-11-24 Seonho Park , Pascal Van Hentenryck

Distance metric learning aims to learn from the given training data a valid distance metric, with which the similarity between data samples can be more effectively evaluated for classification. Metric learning is often formulated as a…

Machine Learning · Computer Science 2015-02-03 Wangmeng Zuo , Faqiang Wang , David Zhang , Liang Lin , Yuchi Huang , Deyu Meng , Lei Zhang

Deep representation learning using triplet network for classification suffers from a lack of theoretical foundation and difficulty in tuning both the network and classifiers for performance. To address the problem, local-margin triplet loss…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Phawis Thammasorn , Daniel Hippe , Wanpracha Chaovalitwongse , Matthew Spraker , Landon Wootton , Matthew Nyflot , Stephanie Combs , Jan Peeken , Eric Ford

The scalability and complexity of deep learning models remains a key issue in many of visual recognition applications like, e.g., video surveillance, where fine tuning with labeled image data from each new camera is required to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 George Ekladious , Hugo Lemoine , Eric Granger , Kaveh Kamali , Salim Moudache