English
Related papers

Related papers: Metric Embedding for Nearest Neighbor Classificati…

200 papers

Data visualization and dimension reduction for regression between a general metric space-valued response and Euclidean predictors is proposed. Current Fr\'ech\'et dimension reduction methods require that the response metric space be…

Methodology · Statistics 2024-05-28 Abdul-Nasah Soale , Yuexiao Dong

We propose a fast, distance-preserving, binary embedding algorithm to transform a high-dimensional dataset $\mathcal{T}\subseteq\mathbb{R}^n$ into binary sequences in the cube $\{\pm 1\}^m$. When $\mathcal{T}$ consists of well-spread (i.e.,…

Information Theory · Computer Science 2021-03-11 Jinjie Zhang , Rayan Saab

We present a Gaussian kernel loss function and training algorithm for convolutional neural networks that can be directly applied to both distance metric learning and image classification problems. Our method treats all training features…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Benjamin J. Meyer , Ben Harwood , Tom Drummond

Learning low-dimensional numerical representations from symbolic data, e.g., embedding the nodes of a graph into a geometric space, is an important concept in machine learning. While embedding into Euclidean space is common, recent…

Machine Learning · Computer Science 2024-10-10 Thomas Bläsius , Jean-Pierre von der Heydt , Maximilian Katzmann , Nikolai Maas

$K$-NN classifier is one of the most famous classification algorithms, whose performance is crucially dependent on the distance metric. When we consider the distance metric as a parameter of $K$-NN, learning an appropriate distance metric…

Machine Learning · Computer Science 2019-11-26 Kun Song

The problem of recovering the configuration of points from their partial pairwise distances, referred to as the Euclidean Distance Matrix Completion (EDMC) problem, arises in a broad range of applications, including sensor network…

Optimization and Control · Mathematics 2026-05-07 Chandler Smith , HanQin Cai , Abiy Tasissa

Deep metric learning (DML) is a cornerstone of many computer vision applications. It aims at learning a mapping from the input domain to an embedding space, where semantically similar objects are located nearby and dissimilar objects far…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Artsiom Sanakoyeu , Pingchuan Ma , Vadim Tschernezki , Björn Ommer

The objective of ordinal embedding is to find a Euclidean representation of a set of abstract items, using only answers to triplet comparisons of the form "Is item $i$ closer to the item $j$ or item $k$?". In recent years, numerous…

Machine Learning · Computer Science 2021-10-22 Leena Chennuru Vankadara , Siavash Haghiri , Michael Lohaus , Faiz Ul Wahab , Ulrike von Luxburg

With the emergence of deep learning, metric learning has gained significant popularity in numerous machine learning tasks dealing with complex and large-scale datasets, such as information retrieval, object recognition and recommendation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Imam Mustafa Kamal , Hyerim Bae , Ling Liu

Metric learning from a set of triplet comparisons in the form of "Do you think item h is more similar to item i or item j?", indicating similarity and differences between items, plays a key role in various applications including image…

Machine Learning · Statistics 2025-08-07 Gokcan Tatli , Yi Chen , Blake Mason , Robert Nowak , Ramya Korlakai Vinayak

Metric learning plays a critical role in training image retrieval and classification. It is also a key algorithm in representation learning, e.g., for feature learning and its alignment in metric space. Hyperbolic embedding has been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Shiyang Yan , Zongxuan Liu , Lin Xu

Distance metric learning is of fundamental interest in machine learning because the distance metric employed can significantly affect the performance of many learning methods. Quadratic Mahalanobis metric learning is a popular approach to…

Machine Learning · Computer Science 2013-02-15 Chunhua Shen , Junae Kim , Fayao Liu , Lei Wang , Anton van den Hengel

Most metric learning algorithms, as well as Fisher's Discriminant Analysis (FDA), optimize some cost function of different measures of within-and between-class distances. On the other hand, Support Vector Machines(SVMs) and several Multiple…

Machine Learning · Computer Science 2013-09-17 Huyen Do , Alexandros Kalousis

We consider the problem of positioning a cloud of points in the Euclidean space $\mathbb{R}^d$, using noisy measurements of a subset of pairwise distances. This task has applications in various areas, such as sensor network localization and…

Statistics Theory · Mathematics 2012-11-22 Adel Javanmard , Andrea Montanari

We present a deep learning approach for learning the joint semantic embeddings of images and captions in a Euclidean space, such that the semantic similarity is approximated by the L2 distances in the embedding space. For that, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Noam Malali , Yosi Keller

The $k$-nearest neighbour ($k$-NN) classifier is one of the oldest and most important supervised learning algorithms for classifying datasets. Traditionally the Euclidean norm is used as the distance for the $k$-NN classifier. In this…

Machine Learning · Statistics 2015-12-02 Stan Hatko

Nearest neighbor methods are a popular class of nonparametric estimators with several desirable properties, such as adaptivity to different distance scales in different regions of space. Prior work on convergence rates for nearest neighbor…

Machine Learning · Computer Science 2014-07-03 Kamalika Chaudhuri , Sanjoy Dasgupta

Metric learning aims to embed one metric space into another to benefit tasks like classification and clustering. Although a greatly distorted metric space has a high degree of freedom to fit training data, it is prone to overfitting and…

Machine Learning · Computer Science 2015-05-12 Renjie Liao , Jianping Shi , Ziyang Ma , Jun Zhu , Jiaya Jia

In this paper, a novel K-Nearest Neighbour and Support Vector Machine hybrid classification technique has been proposed that is simple and robust. It is based on the concept of discriminative nearest neighbourhood classification. The…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 A. M. Hafiz

Learning node representations is a fundamental problem in graph machine learning. While existing embedding methods effectively preserve local similarity measures, they often fail to capture global functions like graph distances. Inspired by…

Machine Learning · Statistics 2025-10-20 My Le , Luana Ruiz , Souvik Dhara