English
Related papers

Related papers: Score-based Generative Modeling Secretly Minimizes…

200 papers

A traditional stochastic program under a finite population typically seeks to optimize efficiency by maximizing the expected profits or minimizing the expected costs, subject to a set of constraints. However, implementing such…

Optimization and Control · Mathematics 2024-02-12 Qing Ye , Grani A. Hanasusanto , Weijun Xie

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

Generative modeling over natural images is one of the most fundamental machine learning problems. However, few modern generative models, including Wasserstein Generative Adversarial Nets (WGANs), are studied on manifold-valued images that…

Computer Vision and Pattern Recognition · Computer Science 2019-01-04 Zhiwu Huang , Jiqing Wu , Luc Van Gool

The sliced Wasserstein (SW) distance has been widely recognized as a statistically effective and computationally efficient metric between two probability measures. A key component of the SW distance is the slicing distribution. There are…

Machine Learning · Statistics 2024-01-02 Khai Nguyen , Nhat Ho

This paper deals with the problem of learning a skill-conditioned policy that acts meaningfully in the absence of a reward signal. Mutual information based objectives have shown some success in learning skills that reach a diverse set of…

Machine Learning · Computer Science 2021-10-29 Ishan Durugkar , Steven Hansen , Stephen Spencer , Volodymyr Mnih

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

Machine Learning · Statistics 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

Machine Learning · Statistics 2023-06-01 Titouan Vayer , Rémi Gribonval

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

Machine Learning · Statistics 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

Score-based generative models have demonstrated significant practical success in data-generating tasks. The models establish a diffusion process that perturbs the ground truth data to Gaussian noise and then learn the reverse process to…

Machine Learning · Computer Science 2024-05-24 Ziqing Wen , Xiaoge Deng , Ping Luo , Tao Sun , Dongsheng Li

Generative Adversial Networks (GANs) have made a major impact in computer vision and machine learning as generative models. Wasserstein GANs (WGANs) brought Optimal Transport (OT) theory into GANs, by minimizing the $1$-Wasserstein distance…

Machine Learning · Computer Science 2019-02-12 Anton Mallasto , Jes Frellsen , Wouter Boomsma , Aasa Feragen

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

Generative adversarial networks (GANs) have enjoyed much success in learning high-dimensional distributions. Learning objectives approximately minimize an $f$-divergence ($f$-GANs) or an integral probability metric (Wasserstein GANs)…

Machine Learning · Computer Science 2020-06-19 Jiaming Song , Stefano Ermon

Defining meaningful distances between samples in a dataset is a fundamental problem in machine learning. Optimal Transport (OT) lifts a distance between features (the "ground metric") to a geometrically meaningful distance between samples.…

Machine Learning · Statistics 2022-07-20 Geert-Jan Huizing , Laura Cantini , Gabriel Peyré

We study the asymptotic error of score-based diffusion model sampling in large-sample scenarios from a non-parametric statistics perspective. We show that a kernel-based score estimator achieves an optimal mean square error of…

Statistics Theory · Mathematics 2024-07-25 Kaihong Zhang , Caitlyn H. Yin , Feng Liang , Jingbo Liu

In this paper, we establish sharp upper and lower bounds on the convergence rate of the empirical measures of point processes under the Wasserstein distance. To this end, we first introduce a new metric on the space of counting measures…

Statistics Theory · Mathematics 2026-04-28 Dongzhou Huang , Tianyi Jiang , Haonan Wang

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

Machine Learning · Computer Science 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros

We develop a kernel projected Wasserstein distance for the two-sample test, an essential building block in statistics and machine learning: given two sets of samples, to determine whether they are from the same distribution. This method…

Statistics Theory · Mathematics 2022-05-10 Jie Wang , Rui Gao , Yao Xie

Existing approaches to depth or disparity estimation output a distribution over a set of pre-defined discrete values. This leads to inaccurate results when the true depth or disparity does not match any of these values. The fact that this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Divyansh Garg , Yan Wang , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger , Wei-Lun Chao

This paper addresses a new active learning strategy for regression problems. The presented Wasserstein active regression model is based on the principles of distribution-matching to measure the representativeness of the labeled dataset. The…

Machine Learning · Computer Science 2024-03-25 Benjamin Bobbia , Matthias Picard

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

Machine Learning · Computer Science 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang