English
Related papers

Related papers: Neural Bregman Divergences for Distance Learning

200 papers

Similarity between objects is multi-faceted and it can be easier for human annotators to measure it when the focus is on a specific aspect. We consider the problem of mapping objects into view-specific embeddings where the distance between…

Machine Learning · Statistics 2015-10-08 Liwen Zhang , Subhransu Maji , Ryota Tomioka

Many of the tools available for robot learning were designed for Euclidean data. However, many applications in robotics involve manifold-valued data. A common example is orientation; this can be represented as a 3-by-3 rotation matrix or a…

Robotics · Computer Science 2024-05-15 P. C. Lopez-Custodio , K. Bharath , A. Kucukyilmaz , S. P. Preston

Finding best architectures of learning machines, such as deep neural networks, is a well-known technical and theoretical challenge. Recent work by Mellor et al (2021) showed that there may exist correlations between the accuracies of…

Machine Learning · Computer Science 2022-04-01 Qinghua Zhou , Alexander N. Gorban , Evgeny M. Mirkes , Jonathan Bac , Andrei Zinovyev , Ivan Y. Tyukin

A key element in transfer learning is representation learning; if representations can be developed that expose the relevant factors underlying the data, then new tasks and domains can be learned readily based on mappings of these salient…

Machine Learning · Computer Science 2014-12-18 Yujia Li , Kevin Swersky , Richard Zemel

Metric learning aims at finding a suitable distance metric over the input space, to improve the performance of distance-based learning algorithms. In high-dimensional settings, it can also serve as dimensionality reduction by imposing a…

Machine Learning · Computer Science 2024-04-16 Efstratios Palias , Ata Kabán

In large scale machine learning and data mining problems with high feature dimensionality, the Euclidean distance between data points can be uninformative, and Distance Metric Learning (DML) is often desired to learn a proper similarity…

Machine Learning · Computer Science 2014-12-19 Pengtao Xie , Eric Xing

Clustering is an important part of many modern data analysis pipelines, including network analysis and data retrieval. There are many different clustering algorithms developed by various communities, and it is often not clear which…

Machine Learning · Computer Science 2019-10-04 Maria-Florina Balcan , Travis Dick , Manuel Lang

This paper proposes a new deep convolutional neural network (DCNN) architecture that learns pixel embeddings, such that pairwise distances between the embeddings can be used to infer whether or not the pixels lie on the same region. That…

Computer Vision and Pattern Recognition · Computer Science 2016-01-11 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

We propose a metric learning framework for the construction of invariant geometric functions of planar curves for the Eucledian and Similarity group of transformations. We leverage on the representational power of convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Gautam Pai , Aaron Wetzler , Ron Kimmel

We address the problem of distance metric learning (DML), defined as learning a distance consistent with a notion of semantic similarity. Traditionally, for this problem supervision is expressed in the form of sets of points that follow an…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Yair Movshovitz-Attias , Alexander Toshev , Thomas K. Leung , Sergey Ioffe , Saurabh Singh

Metric learning aims to build a distance metric typically by learning an effective embedding function that maps similar objects into nearby points in its embedding space. Despite recent advances in deep metric learning, it remains…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Deunsol Jung , Dahyun Kang , Suha Kwak , Minsu Cho

Manifold learning methods play a prominent role in nonlinear dimensionality reduction and other tasks involving high-dimensional data sets with low intrinsic dimensionality. Many of these methods are graph-based: they associate a vertex…

Machine Learning · Computer Science 2021-11-16 Joe Kileel , Amit Moscovich , Nathan Zelesko , Amit Singer

In this paper, we propose a deep convolutional neural network for learning the embeddings of images in order to capture the notion of visual similarity. We present a deep siamese architecture that when trained on positive and negative pairs…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Rishab Sharma , Anirudha Vishvakarma

Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Nir Ailon

A common goal in observational research is to estimate marginal causal effects in the presence of confounding variables. One solution to this problem is to use the covariate distribution to weight the outcomes such that the data appear…

Methodology · Statistics 2020-08-18 Kevin P. Josey , Elizabeth Juarez-Colunga , Fan Yang , Debashis Ghosh

This paper investigates the theoretical foundations of metric learning, focused on three key questions that are not fully addressed in prior work: 1) we consider learning general low-dimensional (low-rank) metrics as well as sparse metrics;…

Machine Learning · Statistics 2018-02-07 Lalit Jain , Blake Mason , Robert Nowak

Among various distance functions for graphs, graph and subgraph edit distances (GED and SED respectively) are two of the most popular and expressive measures. Unfortunately, exact computations for both are NP-hard. To overcome this…

Machine Learning · Computer Science 2023-04-25 Rishabh Ranjan , Siddharth Grover , Sourav Medya , Venkatesan Chakaravarthy , Yogish Sabharwal , Sayan Ranu

Metric learning has been shown to be highly effective to improve the performance of nearest neighbor classification. In this paper, we address the problem of metric learning for Symmetric Positive Definite (SPD) matrices such as covariance…

Machine Learning · Computer Science 2015-02-13 Florian Yger , Masashi Sugiyama

Learning well-separated features in high-dimensional spaces, such as text or image embeddings, is crucial for many machine learning applications. Achieving such separation can be effectively accomplished through the dispersion of…

Machine Learning · Computer Science 2025-08-27 Evgeniia Tokarchuk , Hua Chang Bakker , Vlad Niculae

Recognizing symmetries in data allows for significant boosts in neural network training. In many cases, however, the underlying symmetry is present only in an idealized dataset, and is broken in the training data, due to effects such as…

High Energy Physics - Experiment · Physics 2023-11-13 Edmund Witkowski , Daniel Whiteson