English
Related papers

Related papers: Weighted quantization using MMD: From mean field t…

200 papers

We address the optimization problem of simultaneously minimizing multiple objective functionals over a family of probability distributions. This type of Multi-Objective Distributional Optimization commonly arises in machine learning and…

Machine Learning · Computer Science 2025-05-27 Dai Hai Nguyen , Hiroshi Mamitsuka , Atsuyoshi Nakamura

Dataset Distillation (DD) aims to generate a compact synthetic dataset that enables models to achieve performance comparable to training on the full large dataset, significantly reducing computational costs. Drawing from optimal transport…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Haoyang Liu , Yijiang Li , Tiancheng Xing , Peiran Wang , Vibhu Dalal , Luwei Li , Jingrui He , Haohan Wang

Approximation of a target probability distribution using a finite set of points is a problem of fundamental importance in numerical integration. Several authors have proposed to select points by minimising a maximum mean discrepancy (MMD),…

Machine Learning · Statistics 2026-05-13 Zonghao Chen , Toni Karvonen , Heishiro Kanagawa , François-Xavier Briol , Chris. J. Oates

Clustering is an important exploratory data analysis technique to group objects based on their similarity. The widely used $K$-means clustering method relies on some notion of distance to partition data into a fewer number of groups. In the…

Machine Learning · Statistics 2022-10-14 Yubo Zhuang , Xiaohui Chen , Yun Yang

We propose a novel supervised learning method to optimize the kernel in the maximum mean discrepancy generative adversarial networks (MMD GANs), and the kernel support vector machines (SVMs). Specifically, we characterize a distributionally…

Machine Learning · Computer Science 2020-02-25 Masoud Badiei Khuzani , Liyue Shen , Shahin Shahrampour , Lei Xing

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Machine Learning · Computer Science 2026-05-22 Arthur Gretton , Li Kevin Wenliang , Alexandre Galashov , James Thornton , Valentin De Bortoli , Arnaud Doucet

Over the last 25 years, techniques based on drift and minorization (d&m) have been mainstays in the convergence analysis of MCMC algorithms. However, results presented herein suggest that d&m may be less useful in the emerging area of…

Statistics Theory · Mathematics 2020-10-15 Qian Qin , James P. Hobert

The mean shift algorithm is a popular way to find modes of some probability density functions taking a specific kernel-based shape, used for clustering or visual tracking. Since its introduction, it underwent several practical improvements…

Machine Learning · Computer Science 2020-01-08 Sébastien Razakarivony , Axel Barrau

Bias evaluation is fundamental to trustworthy AI, both in terms of checking data quality and in terms of checking the outputs of AI systems. In testing data quality, for example, one may study the distance of a given dataset, viewed as a…

Machine Learning · Computer Science 2025-06-12 Jiří Němeček , Mark Kozdoba , Illia Kryvoviaz , Tomáš Pevný , Jakub Mareček

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

We examine the infinite-dimensional optimization problem of finding a decomposition of a probability measure into K probability sub-measures to minimize specific loss functions inspired by applications in clustering and user grouping. We…

Optimization and Control · Mathematics 2024-06-04 Jiangze Han , Christopher Thomas Ryan , Xin T. Tong

This paper is motivated by addressing open questions in distributionally robust chance-constrained programs (DRCCP) using the popular Wasserstein ambiguity sets. Specifically, the computational techniques for those programs typically place…

Optimization and Control · Mathematics 2022-04-26 Yassine Nemmour , Heiner Kremer , Bernhard Schölkopf , Jia-Jie Zhu

In this paper we target the class of modal clustering methods where clusters are defined in terms of the local modes of the probability density function which generates the data. The most well-known modal clustering method is the k-means…

Machine Learning · Computer Science 2022-03-04 Gaël Beck , Tarn Duong , Mustapha Lebbah , Hanane Azzag , Christophe Cérin

This paper presents a new gradient flow dissipation geometry over non-negative and probability measures. This is motivated by a principled construction that combines the unbalanced optimal transport and interaction forces modeled by…

Machine Learning · Computer Science 2024-11-01 Egor Gladin , Pavel Dvurechensky , Alexander Mielke , Jia-Jie Zhu

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

In this paper, we consider the filtering problem for partially observed diffusions, which are regularly observed at discrete times. We are concerned with the case when one must resort to time-discretization of the diffusion process if the…

Numerical Analysis · Mathematics 2020-04-09 Marco Ballesio , Ajay Jasra , Erik von Schwerin , Raul Tempone

The main difficulty that arises in the analysis of most machine learning algorithms is to handle, analytically and numerically, a large number of interacting random variables. In this Ph.D manuscript, we revisit an approach based on the…

Disordered Systems and Neural Networks · Physics 2021-03-11 Benjamin Aubin

Compressing large Neural Networks (NN) by quantizing the parameters, while maintaining the performance is highly desirable due to reduced memory and time complexity. In this work, we cast NN quantization as a discrete labelling problem, and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Thalaiyasingam Ajanthan , Puneet K. Dokania , Richard Hartley , Philip H. S. Torr

Among dissimilarities between probability distributions, the Kernel Stein Discrepancy (KSD) has received much interest recently. We investigate the properties of its Wasserstein gradient flow to approximate a target probability distribution…

Machine Learning · Statistics 2021-05-24 Anna Korba , Pierre-Cyril Aubin-Frankowski , Szymon Majewski , Pierre Ablin

We consider the maximum mean discrepancy ($\mathrm{MMD}$) GAN problem and propose a parametric kernelized gradient flow that mimics the min-max game in gradient regularized $\mathrm{MMD}$ GAN. We show that this flow provides a descent…

Machine Learning · Computer Science 2020-11-05 Youssef Mroueh , Truyen Nguyen