中文
相关论文

相关论文: Score-based Generative Modeling Secretly Minimizes…

200 篇论文

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

机器学习 · 计算机科学 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

This paper proposes a distributionally robust approach to logistic regression. We use the Wasserstein distance to construct a ball in the space of probability distributions centered at the uniform distribution on the training samples. If…

最优化与控制 · 数学 2015-12-02 Soroosh Shafieezadeh-Abadeh , Peyman Mohajerin Esfahani , Daniel Kuhn

The two-sample homogeneity testing problem is fundamental in statistics and becomes particularly challenging in high dimensions, where classical tests can suffer substantial power loss. We develop a learning-assisted procedure based on the…

统计方法学 · 统计学 2026-01-30 Xiaoyu Hu , Zhenhua Lin

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

机器学习 · 计算机科学 2023-11-27 Clément Bonet

Score-based diffusion models are a class of generative models whose dynamics is described by stochastic differential equations that map noise into data. While recent works have started to lay down a theoretical foundation for these models,…

Distribution data refers to a data set where each sample is represented as a probability distribution, a subject area receiving burgeoning interest in the field of statistics. Although several studies have developed…

统计方法学 · 统计学 2024-02-09 Ryo Okano , Masaaki Imaizumi

Wasserstein Generative Adversarial Networks (WGANs) provide a versatile class of models, which have attracted great attention in various applications. However, this framework has two main drawbacks: (i) Wasserstein-1 (or Earth-Mover)…

机器学习 · 统计学 2021-07-20 Xin Guo , Johnny Hong , Tianyi Lin , Nan Yang

We develop a projected Wasserstein distance for the two-sample test, a fundamental problem in statistics and machine learning: given two sets of samples, to determine whether they are from the same distribution. In particular, we aim to…

机器学习 · 统计学 2024-04-01 Jie Wang , Rui Gao , Yao Xie

Score matching provides an effective approach to learning flexible unnormalized models, but its scalability is limited by the need to evaluate a second-order derivative. In this paper, we present a scalable approximation to a general family…

机器学习 · 统计学 2020-02-19 Ziyu Wang , Shuyu Cheng , Yueru Li , Jun Zhu , Bo Zhang

A growing number of generative statistical models do not permit the numerical evaluation of their likelihood functions. Approximate Bayesian computation (ABC) has become a popular approach to overcome this issue, in which one simulates…

统计方法学 · 统计学 2019-05-10 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert

Score-based generative models (SGMs) are powerful tools to sample from complex data distributions. Their underlying idea is to (i) run a forward process for time $T_1$ by adding noise to the data, (ii) estimate its score function, and (iii)…

机器学习 · 计算机科学 2024-06-06 Francesco Pedrotti , Jan Maas , Marco Mondelli

Flow-based generative models enjoy certain advantages in computing the data generation and the likelihood, and have recently shown competitive empirical performance. Compared to the accumulating theoretical studies on related score-based…

机器学习 · 统计学 2025-06-30 Xiuyuan Cheng , Jianfeng Lu , Yixin Tan , Yao Xie

We study data-driven decision problems where historical observations are generated by a time-evolving distribution whose consecutive shifts are bounded in Wasserstein distance. We address this nonstationarity using a distributionally robust…

最优化与控制 · 数学 2025-12-25 Dominic S. T. Keehan , Edward J. Anderson , Wolfram Wiesemann

Diffusion models have demonstrated remarkable empirical success in the recent years and are considered one of the state-of-the-art generative models in modern AI. These models consist of a forward process, which gradually diffuses the data…

机器学习 · 计算机科学 2026-01-07 Xingyu Xu , Ziyi Zhang , Yorie Nakahira , Guannan Qu , Yuejie Chi

The maximum mean discrepancy and Wasserstein distance are popular distance measures between distributions and play important roles in many machine learning problems such as metric learning, generative modeling, domain adaption, and…

机器学习 · 计算机科学 2025-01-22 Dong Qiao , Jicong Fan

Score-based generative modeling (SGM) is a highly successful approach for learning a probability distribution from data and generating further samples. We prove the first polynomial convergence guarantees for the core mechanic behind SGM:…

机器学习 · 计算机科学 2023-05-04 Holden Lee , Jianfeng Lu , Yixin Tan

In this paper we introduce a Wasserstein-type distance on the set of Gaussian mixture models. This distance is defined by restricting the set of possible coupling measures in the optimal transport problem to Gaussian mixture models. We…

最优化与控制 · 数学 2020-06-15 Julie Delon , Agnes Desolneux

The use of optimal transport cost for learning generative models has become popular with Wasserstein Generative Adversarial Networks (WGAN). Training of WGAN relies on a theoretical background: the calculation of the gradient of the optimal…

机器学习 · 统计学 2024-04-04 Antoine Houdard , Arthur Leclaire , Nicolas Papadakis , Julien Rabin

Optimal transport has been very successful for various machine learning tasks; however, it is known to suffer from the curse of dimensionality. Hence, dimensionality reduction is desirable when applied to high-dimensional data with…

机器学习 · 统计学 2025-07-21 Jie Wang , March Boedihardjo , Yao Xie

Multiple marginal matching problem aims at learning mappings to match a source domain to multiple target domains and it has attracted great attention in many applications, such as multi-domain image translation. However, addressing this…

机器学习 · 计算机科学 2019-11-05 Jiezhang Cao , Langyuan Mo , Yifan Zhang , Kui Jia , Chunhua Shen , Mingkui Tan