English
Related papers

Related papers: Metric Learning in an RKHS

200 papers

This paper is about similarity between objects that can be represented as points in metric measure spaces. A metric measure space is a metric space that is also equipped with a measure. For example, a network with distances between its…

Discrete Mathematics · Computer Science 2020-11-03 Evgeny Dantsin , Alexander Wolpert

Learning with few labeled data is a key challenge for visual recognition, as deep neural networks tend to overfit using a few samples only. One of the Few-shot learning methods called metric learning addresses this challenge by first…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Li Ke , Meng Pan , Weigao Wen , Dong Li

Supervised learning in reproducing kernel Hilbert space (RKHS) and vector-valued RKHS (vvRKHS) has been investigated for more than 30 years. In this paper, we provide a new twist to this rich literature by generalizing supervised learning…

Machine Learning · Statistics 2024-06-27 Yuka Hashimoto , Masahiro Ikeda , Hachem Kadri

What representation do deep neural networks learn? How similar are images to each other for neural networks? Despite the overwhelming success of deep learning methods key questions about their internal workings still remain largely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Tassilo Wald , Constantin Ulrich , Gregor Köhler , David Zimmerer , Stefan Denner , Michael Baumgartner , Fabian Isensee , Priyank Jaini , Klaus H. Maier-Hein

Distances are pervasive in machine learning. They serve as similarity measures, loss functions, and learning targets; it is said that a good distance measure solves a task. When defining distances, the triangle inequality has proven to be a…

Machine Learning · Computer Science 2020-07-08 Silviu Pitis , Harris Chan , Kiarash Jamali , Jimmy Ba

Selecting an optimal set of icons is a crucial step in the pipeline of visual design to structure and navigate through content. However, designing the icons sets is usually a difficult task for which expert knowledge is required. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Manuel Lagunas , Elena Garces , Diego Gutierrez

It is critical and meaningful to make image classification since it can help human in image retrieval and recognition, object detection, etc. In this paper, three-sides efforts are made to accomplish the task. First, visual features with…

Computer Vision and Pattern Recognition · Computer Science 2016-10-24 Dewei Li , Yingjie Tian

Data similarity is a key concept in many data-driven applications. Many algorithms are sensitive to similarity measures. To tackle this fundamental problem, automatically learning of similarity information from data via self-expression has…

Machine Learning · Computer Science 2019-03-12 Zhao Kang , Yiwei Lu , Yuanzhang Su , Changsheng Li , Zenglin Xu

Learning to hash is an efficient paradigm for exact and approximate nearest neighbor search from massive databases. Binary hash codes are typically extracted from an image by rounding output features from a CNN, which is trained on a…

Machine Learning · Computer Science 2020-05-12 Heikki Arponen , Tom E. Bishop

We introduce an algorithm that, given n objects, learns a similarity matrix over all n^2 pairs, from crowdsourced data alone. The algorithm samples responses to adaptively chosen triplet-based relative-similarity queries. Each query has the…

Machine Learning · Computer Science 2013-07-19 Omer Tamuz , Ce Liu , Serge Belongie , Ohad Shamir , Adam Tauman Kalai

How do the neural networks distinguish two images? It is of critical importance to understand the matching mechanism of deep models for developing reliable intelligent systems for many risky visual applications such as surveillance and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Wenliang Zhao , Yongming Rao , Ziyi Wang , Jiwen Lu , Jie Zhou

We introduce the loss kernel, an interpretability method for measuring similarity between data points according to a trained neural network. The kernel is the covariance matrix of per-sample losses computed under a distribution of…

Machine Learning · Computer Science 2025-10-01 Maxwell Adam , Zach Furman , Jesse Hoogland

In this paper we propose a novel metric learning framework called Nullspace Kernel Maximum Margin Metric Learning (NK3ML) which efficiently addresses the small sample size (SSS) problem inherent in person re-identification and offers a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 T M Feroz Ali , Subhasis Chaudhuri

Finding best architectures of learning machines, such as deep neural networks, is a well-known technical and theoretical challenge. Recent work by Mellor et al (2021) showed that there may exist correlations between the accuracies of…

Machine Learning · Computer Science 2022-04-01 Qinghua Zhou , Alexander N. Gorban , Evgeny M. Mirkes , Jonathan Bac , Andrei Zinovyev , Ivan Y. Tyukin

Online metric learning has been widely applied in classification and retrieval. It can automatically learn a suitable metric from data by restricting similar instances to be separated from dissimilar instances with a given margin. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Wenbin Li , Yanfang Liu , Jing Huo , Yinghuan Shi , Yang Gao , Lei Wang , Jiebo Luo

Clifford Group Equivariant Neural Networks (CGENNs) leverage Clifford algebras and multivectors as an alternative approach to incorporating group equivariance to ensure symmetry constraints in neural representations. In principle, this…

Machine Learning · Computer Science 2025-06-11 Riccardo Ali , Paulina Kulytė , Haitz Sáez de Ocáriz Borde , Pietro Liò

We present a deep learning approach for learning the joint semantic embeddings of images and captions in a Euclidean space, such that the semantic similarity is approximated by the L2 distances in the embedding space. For that, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Noam Malali , Yosi Keller

This paper proposes Relational Similarity Machines (RSM): a fast, accurate, and flexible relational learning framework for supervised and semi-supervised learning tasks. Despite the importance of relational learning, most existing methods…

Machine Learning · Statistics 2016-08-03 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

We analytically study proximity and distance properties of various kernels and similarity measures on graphs. This helps to understand the mathematical nature of such measures and can potentially be useful for recommending the adoption of…

Combinatorics · Mathematics 2018-08-17 Konstantin Avrachenkov , Pavel Chebotarev , Dmytro Rubanov

Under mild assumptions on the kernel, we obtain the best known error rates in a regularized learning scenario taking place in the corresponding reproducing kernel Hilbert space (RKHS). The main novelty in the analysis is a proof that one…

Statistics Theory · Mathematics 2010-01-14 Shahar Mendelson , Joseph Neeman