English
Related papers

Related papers: Learning Distances from Data with Normalizing Flow…

200 papers

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

Machine Learning · Computer Science 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli

Distance metric learning (DML) is an important task that has found applications in many domains. The high computational cost of DML arises from the large number of variables to be determined and the constraint that a distance metric has to…

Machine Learning · Computer Science 2013-04-05 Qi Qian , Rong Jin , Jinfeng Yi , Lijun Zhang , Shenghuo Zhu

In this paper, we present a novel two-stage metric learning algorithm. We first map each learning instance to a probability distribution by computing its similarities to a set of fixed anchor points. Then, we define the distance in the…

Machine Learning · Computer Science 2014-05-16 Jun Wang , Ke Sun , Fei Sha , Stephane Marchand-Maillet , Alexandros Kalousis

We introduce a novel and scalable Bayesian framework for multivariate-density-density regression (DDR), designed to model relationships between multivariate distributions. Our approach addresses the critical issue of distributions residing…

Methodology · Statistics 2025-09-24 Khai Nguyen , Yang Ni , Peter Mueller

Diffusion models (DMs) have become the dominant paradigm of generative modeling in a variety of domains by learning stochastic processes from noise to data. Recently, diffusion denoising bridge models (DDBMs), a new formulation of…

Machine Learning · Computer Science 2024-11-01 Guande He , Kaiwen Zheng , Jianfei Chen , Fan Bao , Jun Zhu

Classifying large-scale image data into object categories is an important problem that has received increasing research attention. Given the huge amount of data, non-parametric approaches such as nearest neighbor classifiers have shown…

Computer Vision and Pattern Recognition · Computer Science 2014-04-28 Zhaowen Wang , Jianchao Yang , Zhe Lin , Jonathan Brandt , Shiyu Chang , Thomas Huang

Domain adaptation techniques address the problem of reducing the sensitivity of machine learning methods to the so-called domain shift, namely the difference between source (training) and target (test) data distributions. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Pietro Morerio , Vittorio Murino

Density-based directed distances -- particularly known as divergences -- between probability distributions are widely used in statistics as well as in the adjacent research fields of information theory, artificial intelligence and machine…

Statistics Theory · Mathematics 2022-03-03 Michel Broniatowski , Wolfgang Stummer

Understanding visual scenes relies more and more on dense pixel-wise classification obtained via deep fully convolutional neural networks. However, due to the nature of the networks, predictions often suffer from blurry boundaries and…

Neural and Evolutionary Computing · Computer Science 2019-09-05 Nicolas Audebert , Alexandre Boulch , Bertrand Le Saux , Sébastien Lefèvre

We introduce a (de)-regularization of the Maximum Mean Discrepancy (DrMMD) and its Wasserstein gradient flow. Existing gradient flows that transport samples from source distribution to target distribution with only target samples, either…

The paper addresses the problem of learning a regression model parameterized by a fixed-rank positive semidefinite matrix. The focus is on the nonlinear nature of the search space and on scalability to high-dimensional problems. The…

Machine Learning · Computer Science 2011-02-01 Gilles Meyer , Silvere Bonnabel , Rodolphe Sepulchre

In this work, we propose to study the global geometrical properties of generative models. We introduce a new Riemannian metric to assess the similarity between any two data points. Importantly, our metric is agnostic to the parametrization…

Machine Learning · Computer Science 2024-07-17 Beomsu Kim , Michael Puthawala , Jong Chul Ye , Emanuele Sansone

Normalizing flows are a popular class of models for approximating probability distributions. However, their invertible nature limits their ability to model target distributions whose support have a complex topological structure, such as…

Machine Learning · Statistics 2022-02-25 Vincent Stimper , Bernhard Schölkopf , José Miguel Hernández-Lobato

Deep Metric Learning algorithms aim to learn an efficient embedding space to preserve the similarity relationships among the input data. Whilst these algorithms have achieved significant performance gains across a wide plethora of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Soumava Kumar Roy , Yan Han , Mehrtash Harandi , Lars Petersson

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that is routinely generated. In applications that are constrained by memory and computational intensity, excessively large…

Machine Learning · Computer Science 2023-02-28 Malik Hassanaly , Bruce A. Perry , Michael E. Mueller , Shashank Yellapantula

We revisit the task of learning a Euclidean metric from data. We approach this problem from first principles and formulate it as a surprisingly simple optimization problem. Indeed, our formulation even admits a closed form solution. This…

Machine Learning · Statistics 2016-07-19 Pourya Habib Zadeh , Reshad Hosseini , Suvrit Sra

Image-generating machine learning models are typically trained with loss functions based on distance in the image space. This often leads to over-smoothed results. We propose a class of loss functions, which we call deep perceptual…

Machine Learning · Computer Science 2016-02-10 Alexey Dosovitskiy , Thomas Brox

Denoising Diffusion Probabilistic Models (DDPM) are powerful state-of-the-art methods used to generate synthetic data from high-dimensional data distributions and are widely used for image, audio, and video generation as well as many more…

Machine Learning · Statistics 2025-04-25 Iskander Azangulov , George Deligiannidis , Judith Rousseau

We address the problem of merging graph and feature-space information while learning a metric from structured data. Existing algorithms tackle the problem in an asymmetric way, by either extracting vectorized summaries of the graph…

Machine Learning · Computer Science 2020-02-17 Nicolo Colombo

The \textit{biharmonic distance} (BD) is a fundamental metric that measures the distance of two nodes in a graph. It has found applications in network coherence, machine learning, and computational graphics, among others. In spite of BD's…

Social and Information Networks · Computer Science 2024-08-27 Changan Liu , Ahad N. Zehmakan , Zhongzhi Zhang