English
Related papers

Related papers: Multiple Closed-Form Local Metric Learning for K-N…

200 papers

We propose a low-rank approach to learning a Mahalanobis metric from data. Inspired by the recent geometric mean metric learning (GMML) algorithm, we propose a low-rank variant of the algorithm. This allows to jointly learn a…

Machine Learning · Computer Science 2018-06-15 Mukul Bhutani , Pratik Jawanpuria , Hiroyuki Kasai , Bamdev Mishra

This paper proposes an inexpensive way to learn an effective dissimilarity function to be used for $k$-nearest neighbor ($k$-NN) classification. Unlike Mahalanobis metric learning methods that map both query (unlabeled) objects and labeled…

Machine Learning · Computer Science 2020-08-31 Yutaro Shigeto , Masashi Shimbo , Yuji Matsumoto

Self-Organising Maps (SOM) are Artificial Neural Networks used in Pattern Recognition tasks. Their major advantage over other architectures is human readability of a model. However, they often gain poorer accuracy. Mostly used metric in SOM…

Machine Learning · Computer Science 2014-07-07 Piotr Płoński , Krzysztof Zaremba

When training automated systems, it has been shown to be beneficial to adapt the representation of data by learning a problem-specific metric. This metric is global. We extend this idea and, for the widely used family of k nearest neighbors…

Machine Learning · Computer Science 2021-09-30 Jan Philip Göpfert , Heiko Wersing , Barbara Hammer

Most metric learning algorithms, as well as Fisher's Discriminant Analysis (FDA), optimize some cost function of different measures of within-and between-class distances. On the other hand, Support Vector Machines(SVMs) and several Multiple…

Machine Learning · Computer Science 2013-09-17 Huyen Do , Alexandros Kalousis

We study the problem of learning local metrics for nearest neighbor classification. Most previous works on local metric learning learn a number of local unrelated metrics. While this "independence" approach delivers an increased flexibility…

Machine Learning · Computer Science 2012-09-17 Jun Wang , Adam Woznica , Alexandros Kalousis

Online metric learning has been widely applied in classification and retrieval. It can automatically learn a suitable metric from data by restricting similar instances to be separated from dissimilar instances with a given margin. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Wenbin Li , Yanfang Liu , Jing Huo , Yinghuan Shi , Yang Gao , Lei Wang , Jiebo Luo

Any generic deep machine learning algorithm is essentially a function fitting exercise, where the network tunes its weights and parameters to learn discriminatory features by minimizing some cost function. Though the network tries to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Tapabrata Chakraborti , Brendan McCane , Steven Mills , Umapada Pal

A key element of any machine learning algorithm is the use of a function that measures the dis/similarity between data points. Given a task, such a function can be optimized with a metric learning algorithm. Although this research field has…

Machine Learning · Statistics 2019-09-05 Léo Gautheron , Emilie Morvant , Amaury Habrard , Marc Sebban

Mahalanobis metrics are widely used in machine learning in conjunction with methods like $k$-nearest neighbors, $k$-means clustering, and $k$-medians clustering. Despite their importance, there has not been any prior work on applying…

Machine Learning · Computer Science 2024-01-02 Lianke Qin , Aravind Reddy , Zhao Song

The performance of distance-based classifiers heavily depends on the underlying distance metric, so it is valuable to learn a suitable metric from the data. To address the problem of multimodality, it is desirable to learn local metrics. In…

Machine Learning · Computer Science 2018-02-13 Mingzhi Dong , Yujiang Wang , Xiaochen Yang , Jing-Hao Xue

Distance metric learning is of fundamental interest in machine learning because the distance metric employed can significantly affect the performance of many learning methods. Quadratic Mahalanobis metric learning is a popular approach to…

Machine Learning · Computer Science 2013-02-15 Chunhua Shen , Junae Kim , Fayao Liu , Lei Wang , Anton van den Hengel

Learning Mahalanobis metric spaces is an important problem that has found numerous applications. Several algorithms have been designed for this problem, including Information Theoretic Metric Learning (ITML) [Davis et al. 2007] and Large…

Machine Learning · Computer Science 2020-03-03 Diego Ihara , Neshat Mohammadi , Francesco Sgherzi , Anastasios Sidiropoulos

To classify time series by nearest neighbors, we need to specify or learn one or several distance measures. We consider variations of the Mahalanobis distance measures which rely on the inverse covariance matrix of the data. Unfortunately…

Machine Learning · Computer Science 2015-03-17 Zoltán Prekopcsák , Daniel Lemire

Tensor completion and tensor decomposition are important problems in many domains. In this work, we leverage the connection between these problems to learn a distance metric that improves both decomposition and completion. We show that the…

Optimization and Control · Mathematics 2022-09-02 Maryam Bagherian , Davoud A. Tarzanagh , Ivo Dinov , Joshua D. Welch

Recent work in metric learning has significantly improved the state-of-the-art in k-nearest neighbor classification. Support vector machines (SVM), particularly with RBF kernels, are amongst the most popular classification algorithms that…

Machine Learning · Statistics 2013-01-09 Zhixiang Xu , Kilian Q. Weinberger , Olivier Chapelle

Metric learning aims to embed one metric space into another to benefit tasks like classification and clustering. Although a greatly distorted metric space has a high degree of freedom to fit training data, it is prone to overfitting and…

Machine Learning · Computer Science 2015-05-12 Renjie Liao , Jianping Shi , Ziyang Ma , Jun Zhu , Jiaya Jia

Metric learning seeks a transformation of the feature space that enhances prediction quality for the given task at hand. In this work we provide PAC-style sample complexity rates for supervised metric learning. We give matching lower- and…

Machine Learning · Computer Science 2015-05-12 Nakul Verma , Kristin Branson

Neural networks may naturally favor distance-based representations, where smaller activations indicate closer proximity to learned prototypes. This contrasts with intensity-based approaches, which rely on activation magnitudes. To test this…

Machine Learning · Computer Science 2025-02-05 Alan Oursland

Learning Mahanalobis distance metrics in a high- dimensional feature space is very difficult especially when structural sparsity and low rank are enforced to improve com- putational efficiency in testing phase. This paper addresses both…

Computer Vision and Pattern Recognition · Computer Science 2012-12-27 Chang Huang , Shenghuo Zhu , Kai Yu