English
Related papers

Related papers: Online Adaptive Mahalanobis Distance Estimation

200 papers

We consider the supervised classification problem of machine learning in Cayley-Klein projective geometries: We show how to learn a curved Mahalanobis metric distance corresponding to either the hyperbolic geometry or the elliptic geometry…

Machine Learning · Computer Science 2016-09-27 Frank Nielsen , Boris Muzellec , Richard Nock

To classify time series by nearest neighbors, we need to specify or learn one or several distance measures. We consider variations of the Mahalanobis distance measures which rely on the inverse covariance matrix of the data. Unfortunately…

Machine Learning · Computer Science 2015-03-17 Zoltán Prekopcsák , Daniel Lemire

Metric learning is an important family of algorithms for classification and similarity search, but the robustness of learned metrics against small adversarial perturbations is less studied. In this paper, we show that existing metric…

Machine Learning · Computer Science 2020-12-22 Lu Wang , Xuanqing Liu , Jinfeng Yi , Yuan Jiang , Cho-Jui Hsieh

Metric learning is a key problem for many data mining and machine learning applications, and has long been dominated by Mahalanobis methods. Recent advances in nonlinear metric learning have demonstrated the potential power of…

Machine Learning · Statistics 2014-02-25 David M. Johnson , Caiming Xiong , Jason J. Corso

The learning of appropriate distance metrics is a critical problem in image classification and retrieval. In this work, we propose a boosting-based technique, termed \BoostMetric, for learning a Mahalanobis distance metric. One of the…

Computer Vision and Pattern Recognition · Computer Science 2009-10-14 Chunhua Shen , Junae Kim , Lei Wang , Anton van den Hengel

Many researches have been devoted to learn a Mahalanobis distance metric, which can effectively improve the performance of kNN classification. Most approaches are iterative and computational expensive and linear rigidity still critically…

Machine Learning · Computer Science 2013-11-14 Jianbo Ye

Distance metric learning has attracted much attention in recent years, where the goal is to learn a distance metric based on user feedback. Conventional approaches to metric learning mainly focus on learning the Mahalanobis distance metric…

Machine Learning · Computer Science 2020-11-10 Zhongfang Zhuang , Xiangnan Kong , Elke Rundensteiner , Jihane Zouaoui , Aditya Arora

Self-Organising Maps (SOM) are Artificial Neural Networks used in Pattern Recognition tasks. Their major advantage over other architectures is human readability of a model. However, they often gain poorer accuracy. Mostly used metric in SOM…

Machine Learning · Computer Science 2014-07-07 Piotr Płoński , Krzysztof Zaremba

We show how to approximate a data matrix $\mathbf{A}$ with a much smaller sketch $\mathbf{\tilde A}$ that can be used to solve a general class of constrained k-rank approximation problems to within $(1+\epsilon)$ error. Importantly, this…

Data Structures and Algorithms · Computer Science 2015-04-06 Michael B. Cohen , Sam Elder , Cameron Musco , Christopher Musco , Madalina Persu

Motivated by establishing theoretical foundations for various manifold learning algorithms, we study the problem of Mahalanobis distance (MD), and the associated precision matrix, estimation from high-dimensional noisy data. By relying on…

Statistics Theory · Mathematics 2021-09-13 Matan Gavish , Ronen Talmon , Pei-Chun Su , Hau-Tieng Wu

We propose a novel semiparametric classifier based on Mahalanobis distances of an observation from the competing classes. Our tool is a generalized additive model with the logistic link function that uses these distances as features to…

Methodology · Statistics 2025-02-05 Annesha Ghosh , Anil K. Ghosh , Rita SahaRay , Soham Sarkar

We propose a low-rank approach to learning a Mahalanobis metric from data. Inspired by the recent geometric mean metric learning (GMML) algorithm, we propose a low-rank variant of the algorithm. This allows to jointly learn a…

Machine Learning · Computer Science 2018-06-15 Mukul Bhutani , Pratik Jawanpuria , Hiroyuki Kasai , Bamdev Mishra

One of the basic problems in data analysis lies in choosing the optimal rescaling (change of coordinate system) to study properties of a given data-set $Y$. The classical Mahalanobis approach has its basis in the classical…

Methodology · Statistics 2013-06-11 Przemysław Spurek , Jacek Tabor

When training automated systems, it has been shown to be beneficial to adapt the representation of data by learning a problem-specific metric. This metric is global. We extend this idea and, for the widely used family of k nearest neighbors…

Machine Learning · Computer Science 2021-09-30 Jan Philip Göpfert , Heiko Wersing , Barbara Hammer

Metric learning seeks a transformation of the feature space that enhances prediction quality for the given task at hand. In this work we provide PAC-style sample complexity rates for supervised metric learning. We give matching lower- and…

Machine Learning · Computer Science 2015-05-12 Nakul Verma , Kristin Branson

A key element of any machine learning algorithm is the use of a function that measures the dis/similarity between data points. Given a task, such a function can be optimized with a metric learning algorithm. Although this research field has…

Machine Learning · Statistics 2019-09-05 Léo Gautheron , Emilie Morvant , Amaury Habrard , Marc Sebban

For many tasks and data types, there are natural transformations to which the data should be invariant or insensitive. For instance, in visual recognition, natural images should be insensitive to rotation and translation. This requirement…

Machine Learning · Computer Science 2015-07-28 Ethan Fetaya , Shimon Ullman

The Mahalanobis distance is commonly used in multi-object trackers for measurement-to-track association. Starting with the original definition of the Mahalanobis distance we review its use in association. Given that there is no principle in…

Systems and Control · Computer Science 2023-08-11 Richard Altendorfer , Sebastian Wirkert

Curve matching is a prediction technique that relies on predictive mean matching, which matches donors that are most similar to a target based on the predictive distance. Even though this approach leads to high prediction accuracy, the…

Methodology · Statistics 2022-07-12 Anaïs Fopma , Mingyang Cai , Stef van Buuren , Gerko Vink

The problem of constrained clustering has attracted significant attention in the past decades. In this paper, we study the balanced $k$-center, $k$-median, and $k$-means clustering problems where the size of each cluster is constrained by…

Computational Geometry · Computer Science 2018-09-11 Hu Ding