English
Related papers

Related papers: Wasserstein Gradient Boosting: A Framework for Dis…

200 papers

Gradient boosting is a state-of-the-art prediction technique that sequentially produces a model in the form of linear combinations of simple predictors---typically decision trees---by solving an infinite-dimensional convex optimization…

Statistics Theory · Mathematics 2017-07-18 Gérard Biau , Benoît Cadre

Wasserstein dictionary learning is an unsupervised approach to learning a collection of probability distributions that generate observed distributions as Wasserstein barycentric combinations. Existing methods for Wasserstein dictionary…

Machine Learning · Computer Science 2022-10-24 Marshall Mueller , Shuchin Aeron , James M. Murphy , Abiy Tasissa

Learning conditional densities and identifying factors that influence the entire distribution are vital tasks in data-driven applications. Conventional approaches work mostly with summary statistics, and are hence inadequate for a…

Methodology · Statistics 2022-09-13 Chengliang Tang , Nathan Lenssen , Ying Wei , Tian Zheng

This paper studies the optimization of the KL functional on the Wasserstein space of probability measures, and develops a sampling framework based on Wasserstein gradient descent (WGD). We identify two important subclasses of the…

Computation · Statistics 2026-02-04 Van Chien Ta , Thi Mai Hong Chu , Minh-Ngoc Tran

Separating audio mixtures into individual instrument tracks has been a long standing challenging task. We introduce a novel weakly supervised audio source separation approach based on deep adversarial learning. Specifically, our loss…

Sound · Computer Science 2018-05-18 Ning Zhang , Junchi Yan , Yuchen Zhou

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

This paper addresses a new active learning strategy for regression problems. The presented Wasserstein active regression model is based on the principles of distribution-matching to measure the representativeness of the labeled dataset. The…

Machine Learning · Computer Science 2024-03-25 Benjamin Bobbia , Matthias Picard

Many applications in machine learning involve data represented as probability distributions. The emergence of such data requires radically novel techniques to design tractable gradient flows on probability distributions over this type of…

Machine Learning · Computer Science 2025-06-10 Clément Bonet , Christophe Vauthier , Anna Korba

A novel variational inference based resampling framework is proposed to evaluate the robustness and generalization capability of deep learning models with respect to distribution shift. We use Auto Encoding Variational Bayes to find a…

Machine Learning · Computer Science 2019-10-29 Xudong Sun , Alexej Gossmann , Yu Wang , Bernd Bischl

Gaussian processes (GPs) are a well-known nonparametric Bayesian inference technique, but they suffer from scalability problems for large sample sizes, and their performance can degrade for non-stationary or spatially heterogeneous data. In…

Machine Learning · Statistics 2021-07-28 Michael E. Kepler , Alec Koppel , Amrit Singh Bedi , Daniel J. Stilwell

This paper presents a computationally efficient variant of gradient boosting for multi-class classification and multi-output regression tasks. Standard gradient boosting uses a 1-vs-all strategy for classifications tasks with more than two…

Machine Learning · Computer Science 2024-07-25 Seyedsaman Emami , Gonzalo Martínez-Muñoz

Domain adaptation aims to generalise a high-performance learner on target domain (non-labelled data) by leveraging the knowledge from source domain (rich labelled data) which comes from a different but related distribution. Assuming the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Jie Su

A novel optimization approach is proposed for application to policy gradient methods and evolution strategies for reinforcement learning (RL). The procedure uses a computationally efficient Wasserstein natural gradient (WNG) descent that…

Machine Learning · Computer Science 2021-03-19 Ted Moskovitz , Michael Arbel , Ferenc Huszar , Arthur Gretton

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

Machine Learning · Statistics 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

Existing approaches to depth or disparity estimation output a distribution over a set of pre-defined discrete values. This leads to inaccurate results when the true depth or disparity does not match any of these values. The fact that this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Divyansh Garg , Yan Wang , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger , Wei-Lun Chao

ProBoost, a new boosting algorithm for probabilistic classifiers, is proposed in this work. This algorithm uses the epistemic uncertainty of each training sample to determine the most challenging/uncertain ones; the relevance of these…

Variational inference (VI) can be cast as an optimization problem in which the variational parameters are tuned to closely align a variational distribution with the true posterior. The optimization task can be approached through vanilla…

Machine Learning · Computer Science 2025-04-24 Dai Hai Nguyen , Tetsuya Sakurai , Hiroshi Mamitsuka

The gradient boosting machine is a powerful ensemble-based machine learning method for solving regression problems. However, one of the difficulties of its using is a possible discontinuity of the regression function, which arises when…

Machine Learning · Computer Science 2020-06-22 Andrei V. Konstantinov , Lev V. Utkin

Diffusion models and flow-based methods have shown impressive generative capability, especially for images, but their sampling is expensive because it requires many iterative updates. We introduce W-Flow, a framework for training a…

Machine Learning · Computer Science 2026-05-28 Jiaqi Han , Puheng Li , Qiushan Guo , Renyuan Xu , Stefano Ermon , Emmanuel J. Candès

Wasserstein barycenters provide a principled approach for aggregating probability measures, while preserving the geometry of their ambient space. Existing discrete methods are not scalable as they assume access to the complete set of…

Machine Learning · Statistics 2026-03-10 Eduardo Fernandes Montesuma , Yassir Bendou , Mike Gartrell