English
Related papers

Related papers: No Fuss Distance Metric Learning using Proxies

200 papers

A number of machine learning algorithms are using a metric, or a distance, in order to compare individuals. The Euclidean distance is usually employed, but it may be more efficient to learn a parametric distance such as Mahalanobis metric.…

Machine Learning · Computer Science 2016-12-16 Hoel Le Capitaine

As an effective way of metric learning, triplet loss has been widely used in many deep learning tasks, including face recognition and person-ReID, leading to many states of the arts. The main innovation of triplet loss is using feature map…

Machine Learning · Computer Science 2017-11-15 Gongze Cao , Yezhou Yang , Jie Lei , Cheng Jin , Yang Liu , Mingli Song

Constrained optimization problems arise in various engineering systems such as inventory management and power grids. Standard deep neural network (DNN) based machine learning proxies are ineffective in practical settings where labeled data…

Machine Learning · Computer Science 2025-06-09 Parikshit Pareek , Abhijith Jayakumar , Kaarthik Sundar , Deepjyoti Deka , Sidhant Misra

Face recognition models trained under the assumption of identical training and test distributions often suffer from poor generalization when faced with unknown variations, such as a novel ethnicity or unpredictable individual make-ups…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Masoud Faraki , Xiang Yu , Yi-Hsuan Tsai , Yumin Suh , Manmohan Chandraker

We introduce a novel algorithm for solving learning problems where both the loss function and the regularizer are non-convex but belong to the class of difference of convex (DC) functions. Our contribution is a new general purpose proximal…

Machine Learning · Computer Science 2015-07-03 Alain Rakotomamonjy , Remi Flamary , Gilles Gasso

Recent work has shown a variety of ways in which machine learning can be used to accelerate the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial…

Machine Learning · Computer Science 2024-04-02 Ethan King , James Kotary , Ferdinando Fioretto , Jan Drgona

In large scale machine learning and data mining problems with high feature dimensionality, the Euclidean distance between data points can be uninformative, and Distance Metric Learning (DML) is often desired to learn a proper similarity…

Machine Learning · Computer Science 2014-12-19 Pengtao Xie , Eric Xing

Self-supervised learning (especially contrastive learning) has attracted great interest due to its huge potential in learning discriminative representations in an unsupervised manner. Despite the acknowledged successes, existing contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Guangrun Wang , Keze Wang , Guangcong Wang , Philip H. S. Torr , Liang Lin

Machine learning is at the heart of managing the real-world problems associated with massive data. With the success of neural networks on such large-scale problems, more research in machine learning is being conducted now than ever before.…

Machine Learning · Computer Science 2026-02-23 Ryan O'Dowd

Non-parametric neural language models (NLMs) learn predictive distributions of text utilizing an external datastore, which allows them to learn through explicitly memorizing the training datapoints. While effective, these models often…

Computation and Language · Computer Science 2021-11-16 Junxian He , Graham Neubig , Taylor Berg-Kirkpatrick

Distance metric learning (DML) aims to find an appropriate way to reveal the underlying data relationship. It is critical in many machine learning, pattern recognition and data mining algorithms, and usually require large amount of label…

Machine Learning · Statistics 2018-11-13 Yong Luo , Yonggang Wen , Ling-Yu Duan , Dacheng Tao

We present ReMoT, a unified training paradigm to systematically address the fundamental shortcomings of VLMs in spatio-temporal consistency -- a critical failure point in navigation, robotics, and autonomous driving. ReMoT integrates two…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Cong Wan , Zeyu Guo , Jiangyang Li , SongLin Dong , Yifan Bai , Lin Peng , Zhiheng Ma , Yihong Gong

Optimization problems are ubiquitous in our societies and are present in almost every segment of the economy. Most of these optimization problems are NP-hard and computationally demanding, often requiring approximate solutions for…

Optimization and Control · Mathematics 2021-06-23 James Kotary , Ferdinando Fioretto , Pascal Van Hentenryck

Distance metric learning (DML) is an important task that has found applications in many domains. The high computational cost of DML arises from the large number of variables to be determined and the constraint that a distance metric has to…

Machine Learning · Computer Science 2013-04-05 Qi Qian , Rong Jin , Jinfeng Yi , Lijun Zhang , Shenghuo Zhu

The comparative losses (typically, triplet loss) are appealing choices for learning person re-identification (ReID) features. However, the triplet loss is computationally much more expensive than the (practically more popular)…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Ye Yuan , Wuyang Chen , Yang Yang , Zhangyang Wang

Density-based distances (DBDs) provide a principled approach to metric learning by defining distances in terms of the underlying data distribution. By employing a Riemannian metric that increases in regions of low probability density,…

Machine Learning · Computer Science 2025-06-02 Peter Sorrenson , Daniel Behrend-Uriarte , Christoph Schnörr , Ullrich Köthe

In this paper, a progress recognition method consider occlusion using deep metric learning is proposed to visualize the product assembly process in a factory. First, the target assembly product is detected from images acquired from a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Takumi Kitsukawa , Kazuma Miura , Shigeki Yumoto , Sarthak Pathak , Alessandro Moro , Kazunori Umeda

Although the optimization objectives for learning neural networks are highly non-convex, gradient-based methods have been wildly successful at learning neural networks in practice. This juxtaposition has led to a number of recent studies on…

Machine Learning · Computer Science 2022-09-14 Spencer Frei , Quanquan Gu

Many industrial applications use Metric Learning as a way to circumvent scalability issues when designing systems with a high number of classes. Because of this, this field of research is attracting a lot of interest from the academic and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Carlos Roig , David Varas , Issey Masuda , Juan Carlos Riveiro , Elisenda Bou-Balust

Document alignment techniques based on multilingual sentence representations have recently shown state of the art results. However, these techniques rely on unsupervised distance measurement techniques, which cannot be fined-tuned to the…

Computation and Language · Computer Science 2021-12-01 Charith Rajitha , Lakmali Piyarathne , Dilan Sachintha , Surangika Ranathunga