中文
相关论文

相关论文: Asymptotic Guarantees for Learning Generative Mode…

200 篇论文

Stochastic Gradient Descent (SGD) is one of the most popular algorithms in statistical and machine learning due to its computational and memory efficiency. Various averaging schemes have been proposed to accelerate the convergence of SGD in…

机器学习 · 统计学 2025-04-08 Ziyang Wei , Wanrong Zhu , Wei Biao Wu

The introduction of Variational Autoencoders (VAE) has been marked as a breakthrough in the history of representation learning models. Besides having several accolades of its own, VAE has successfully flagged off a series of inventions in…

机器学习 · 统计学 2021-10-11 Anish Chakrabarty , Swagatam Das

Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions.…

机器学习 · 计算机科学 2018-05-23 Maziar Sanjabi , Jimmy Ba , Meisam Razaviyayn , Jason D. Lee

In state estimation tasks, the usual assumption of exactly known disturbance distribution is often unrealistic and renders the estimator fragile in practice. The recently emerging Wasserstein distributionally robust state estimation (DRSE)…

最优化与控制 · 数学 2026-02-10 Yulin Feng , Xianyu Li , Steven X. Ding , Hao Ye , Chao Shang

We introduce sliced optimal transport dataset distance (s-OTDD), a model-agnostic, embedding-agnostic approach for dataset comparison that requires no training, is robust to variations in the number of classes, and can handle disjoint label…

机器学习 · 计算机科学 2025-05-16 Khai Nguyen , Hai Nguyen , Tuan Pham , Nhat Ho

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution…

We present theoretical convergence guarantees for ODE-based generative models, specifically flow matching. We use a pre-trained autoencoder network to map high-dimensional original inputs to a low-dimensional latent space, where a…

机器学习 · 统计学 2024-04-30 Yuling Jiao , Yanming Lai , Yang Wang , Bokai Yan

Sliced optimal transport (SOT), or sliced Wasserstein (SW) distance, is widely recognized for its statistical and computational scalability. In this work, we further enhance computational scalability by proposing the first method for…

机器学习 · 计算机科学 2026-05-12 Khai Nguyen

We revisit the classical problem of deriving convergence rates for the maximum likelihood estimator (MLE) in finite mixture models. The Wasserstein distance has become a standard loss function for the analysis of parameter estimation in…

统计理论 · 数学 2022-06-22 Tudor Manole , Nhat Ho

We consider the problem of distributed estimation of an unknown deterministic scalar parameter (the target signal) in a wireless sensor network (WSN), where each sensor receives a single snapshot of the field. We assume that the observation…

信息论 · 计算机科学 2015-10-09 Qing Zhou , Di Li , Soummya Kar , Lauren Huie , H. Vincent Poor , Shuguang Cui

The Sliced-Wasserstein (SW) distance between probability measures is defined as the average of the Wasserstein distances resulting for the associated one-dimensional projections. As a consequence, the SW distance can be written as an…

机器学习 · 统计学 2024-05-16 Rémi Leluc , Aymeric Dieuleveut , François Portier , Johan Segers , Aigerim Zhuman

Conditional distribution is a fundamental quantity for describing the relationship between a response and a predictor. We propose a Wasserstein generative approach to learning a conditional distribution. The proposed approach uses a…

机器学习 · 计算机科学 2021-12-21 Shiao Liu , Xingyu Zhou , Yuling Jiao , Jian Huang

Spherical Sliced-Wasserstein (SSW) has recently been proposed to measure the discrepancy between spherical data distributions in various fields, such as geology, medical domains, computer vision, and deep representation learning. However,…

机器学习 · 计算机科学 2024-12-30 Hongliang Zhang , Shuo Chen , Lei Luo , Jian Yang

The performance of unsupervised methods such as clustering depends on the choice of distance metric between features, or ground metric. Commonly, ground metrics are decided with heuristics or learned via supervised algorithms. However,…

机器学习 · 计算机科学 2025-01-13 Kira M. Düsterwald , Samo Hromadka , Makoto Yamada

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

机器学习 · 计算机科学 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

统计理论 · 数学 2024-12-10 Bernard Bercu , Jérémie Bigot

Stochastic Gradient Descent (SGD) is one of the most widely used techniques for online optimization in machine learning. In this work, we accelerate SGD by adaptively learning how to sample the most useful training examples at each time…

机器学习 · 计算机科学 2016-03-16 Guillaume Bouchard , Théo Trouillon , Julien Perez , Adrien Gaidon

Optimal Transport (OT) has attracted significant interest in the machine learning community, not only for its ability to define meaningful distances between probability distributions -- such as the Wasserstein distance -- but also for its…

机器学习 · 计算机科学 2025-11-04 Laetitia Chapel , Romain Tavenard , Samuel Vaiter

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

机器学习 · 计算机科学 2023-11-27 Clément Bonet

This paper proposes minimum sliced distance estimation in structural econometric models with possibly parameter-dependent supports. In contrast to likelihood-based estimation, we show that under mild regularity conditions, the minimum…

计量经济学 · 经济学 2024-12-10 Yanqin Fan , Hyeonseok Park