English
Related papers

Related papers: A new class of metrics for learning on real-valued…

200 papers

We consider classifiers for high-dimensional data under the strongly spiked eigenvalue (SSE) model. We first show that high-dimensional data often have the SSE model. We consider a distance-based classifier using eigenstructures for the SSE…

Machine Learning · Statistics 2017-10-31 Makoto Aoshima , Kazuyoshi Yata

The modern data analyst must cope with data encoded in various forms, vectors, matrices, strings, graphs, or more. Consequently, statistical and machine learning models tailored to different data encodings are important. We focus on data…

Machine Learning · Statistics 2016-05-03 Suvrit Sra

While machine learning (ML) architectures have evolved rapidly to account for complex data, loss functions like cross-entropy remain mostly structure-agnostic in many real-world applications. However, the `class-symmetric' nature of these…

Machine Learning · Computer Science 2026-05-28 Yasser Taha , Grégoire Montavon , Nils Körber

The paper introduces scaled Bregman distances of probability distributions which admit non-uniform contributions of observed events. They are introduced in a general form covering not only the distances of discrete and continuous stochastic…

Information Theory · Computer Science 2021-05-12 Wolfgang Stummer , Igor Vajda

Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging results in many computer vision tasks.$L2$-normalization in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Xuefei Zhe , Shifeng Chen , Hong Yan

Many complex networks display a mesoscopic structure with groups of nodes sharing many links with the other nodes in their group and comparatively few with nodes of different groups. This feature is known as community structure and encodes…

Physics and Society · Physics 2009-07-31 Andrea Lancichinetti , Santo Fortunato

Behavioural metrics have been shown to be an effective mechanism for constructing representations in reinforcement learning. We present a novel perspective on behavioural metrics for Markov decision processes via the use of positive…

Machine Learning · Computer Science 2023-11-01 Pablo Samuel Castro , Tyler Kastner , Prakash Panangaden , Mark Rowland

This paper is partly an exposition, and partly an extension of our work [1] to the multiparameter case. We consider certain classes of parametrized dynamically defined measures. These are push-forwards, under the natural projection, of…

Dynamical Systems · Mathematics 2024-05-13 Balázs Bárány , Károly Simon , Boris Solomyak , Adam Śpiewak

We give two new applications of an observation from \cite{ADFGW11}. The first is an almost linear sized constant time data structure for reporting very large distances in undirected graphs. The second is a generic transformation of results…

Data Structures and Algorithms · Computer Science 2012-06-20 Ilya Razenshteyn

The vast combination of material properties seen in nature are achieved by the complexity of the material microstructure. Advanced characterization and physics based simulation techniques have led to generation of extremely large…

Machine Learning · Computer Science 2023-01-12 Veera Sundararaghavan , Megna N. Shah , Jeff P. Simmons

Density-based distances (DBDs) provide a principled approach to metric learning by defining distances in terms of the underlying data distribution. By employing a Riemannian metric that increases in regions of low probability density,…

Machine Learning · Computer Science 2025-06-02 Peter Sorrenson , Daniel Behrend-Uriarte , Christoph Schnörr , Ullrich Köthe

Credal sets, i.e., closed convex sets of probability measures, provide a natural framework to represent aleatoric and epistemic uncertainty in machine learning. Yet how to quantify these two types of uncertainty for a given credal set,…

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

Machine Learning · Computer Science 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

The performance of distance-based classifiers heavily depends on the underlying distance metric, so it is valuable to learn a suitable metric from the data. To address the problem of multimodality, it is desirable to learn local metrics. In…

Machine Learning · Computer Science 2018-02-13 Mingzhi Dong , Yujiang Wang , Xiaochen Yang , Jing-Hao Xue

A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution…

Probability · Mathematics 2016-08-24 Christian Soize , Roger Ghanem

In machine learning, observation features are measured in a metric space to obtain their distance function for optimization. Given similar features that are statistically sufficient as a population, a statistical distance between two…

Machine Learning · Statistics 2020-06-23 Xin Lu

Vector similarity measures play a fundamental role in various fields, including machine learning, natural language processing, information retrieval, and data mining. These measures quantify the closeness between two vectors in a…

General Mathematics · Mathematics 2025-05-01 Abeeb A. Awotunde

Metric learning for classification has been intensively studied over the last decade. The idea is to learn a metric space induced from a normed vector space on which data from different classes are well separated. Different measures of the…

Machine Learning · Computer Science 2019-10-22 Yinan Yu , Tomas McKelvey

Collections of probability distributions arise in a variety of applications ranging from user activity pattern analysis to brain connectomics. In practice these distributions can be defined over diverse domain types including finite…

Methodology · Statistics 2023-06-16 Raif Rustamov , Subhabrata Majumdar

Deep neural networks have shown remarkable performance when trained on independent and identically distributed data from a fixed set of classes. However, in real-world scenarios, it can be desirable to train models on a continuous stream of…

Machine Learning · Computer Science 2023-09-04 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher , Toshihiko Yamasaki