English
Related papers

Related papers: A Wasserstein Minimax Framework for Mixed Linear R…

200 papers

Longitudinal Dispersion(LD) is the dominant process of scalar transport in natural streams. An accurate prediction on LD coefficient(Dl) can produce a performance leap in related simulation. The emerging machine learning(ML) techniques…

Geophysics · Physics 2021-07-28 Yifeng Zhao , Pei Zhang , S. A. Galindo-Torres , Stan Z. Li

This paper provides a simple procedure to fit generative networks to target distributions, with the goal of a small Wasserstein distance (or other optimal transport costs). The approach is based on two principles: (a) if the source…

Machine Learning · Computer Science 2019-06-12 Yucheng Chen , Matus Telgarsky , Chao Zhang , Bolton Bailey , Daniel Hsu , Jian Peng

Modern data-driven and distributed learning frameworks deal with diverse massive data generated by clients spread across heterogeneous environments. Indeed, data heterogeneity is a major bottleneck in scaling up many distributed learning…

Machine Learning · Computer Science 2023-08-23 Amirhossein Reisizadeh , Khashayar Gatmiry , Asuman Ozdaglar

Parallelism is a ubiquitous method for accelerating machine learning algorithms. However, theoretical analysis of parallel learning is usually done in an algorithm- and protocol-specific setting, giving little insight about how changes in…

Machine Learning · Computer Science 2020-06-09 Yucheng Lu , Jack Nash , Christopher De Sa

Clustering and dimensionality reduction have been crucial topics in machine learning and computer vision. Clustering high-dimensional data has been challenging for a long time due to the curse of dimensionality. For that reason, a more…

Machine Learning · Statistics 2026-04-16 Sida Liu , Yangzi Guo , Mingyuan Wang

Multiple marginal matching problem aims at learning mappings to match a source domain to multiple target domains and it has attracted great attention in many applications, such as multi-domain image translation. However, addressing this…

Machine Learning · Computer Science 2019-11-05 Jiezhang Cao , Langyuan Mo , Yifan Zhang , Kui Jia , Chunhua Shen , Mingkui Tan

Relational logistic regression (RLR) is a representation of conditional probability in terms of weighted formulae for modelling multi-relational data. In this paper, we develop a learning algorithm for RLR models. Learning an RLR model from…

Artificial Intelligence · Computer Science 2016-06-29 Bahare Fatemi , Seyed Mehran Kazemi , David Poole

Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of…

Machine Learning · Statistics 2019-05-16 Luca Ambrogioni , Umut Guclu , Marcel van Gerven

Unsupervised learning aims to capture the underlying structure of potentially large and high-dimensional datasets. Traditionally, this involves using dimensionality reduction (DR) methods to project data onto lower-dimensional spaces or…

Machine Learning · Computer Science 2025-06-30 Hugues Van Assel , Cédric Vincent-Cuaz , Nicolas Courty , Rémi Flamary , Pascal Frossard , Titouan Vayer

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these…

Machine Learning · Statistics 2022-07-13 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

The computation of Wasserstein gradient direction is essential for posterior sampling problems and scientific computing. The approximation of the Wasserstein gradient with finite samples requires solving a variational problem. We study the…

Machine Learning · Computer Science 2022-05-27 Yifei Wang , Peng Chen , Mert Pilanci , Wuchen Li

This paper is focused on the statistical analysis of data consisting of a collection of multiple series of probability measures that are indexed by distinct time instants and supported over a bounded interval of the real line. By modeling…

Machine Learning · Statistics 2026-05-05 Yiye Jiang , Jérémie Bigot

Multi-distribution learning (MDL), which seeks to learn a shared model that minimizes the worst-case risk across $k$ distinct data distributions, has emerged as a unified framework in response to the evolving demand for robustness,…

Machine Learning · Computer Science 2025-08-12 Zihan Zhang , Wenhao Zhan , Yuxin Chen , Simon S. Du , Jason D. Lee

We propose a class of convex relaxations to solve the sensor network localization problem, based on a maximum likelihood (ML) formulation. This class, as well as the tightness of the relaxations, depends on the noise probability density…

Information Theory · Computer Science 2017-09-18 Andrea Simonetto , Geert Leus

Finite Mixture Regression (FMR) refers to the mixture modeling scheme which learns multiple regression models from the training data set. Each of them is in charge of a subset. FMR is an effective scheme for handling sample heterogeneity,…

Machine Learning · Statistics 2020-10-13 Jian Liang , Kun Chen , Ming Lin , Changshui Zhang , Fei Wang

We present a computationally efficient framework, called $\texttt{FlowDRO}$, for solving flow-based distributionally robust optimization (DRO) problems with Wasserstein uncertainty sets while aiming to find continuous worst-case…

Machine Learning · Computer Science 2024-02-27 Chen Xu , Jonghyeok Lee , Xiuyuan Cheng , Yao Xie

For the problem of multi-class linear classification and feature selection, we propose approximate message passing approaches to sparse multinomial logistic regression (MLR). First, we propose two algorithms based on the Hybrid Generalized…

Information Theory · Computer Science 2016-09-21 Evan Byrne , Philip Schniter

In federated learning, participating clients typically possess non-i.i.d. data, posing a significant challenge to generalization to unseen distributions. To address this, we propose a Wasserstein distributionally robust optimization scheme…

Machine Learning · Computer Science 2022-06-06 Tung-Anh Nguyen , Tuan Dung Nguyen , Long Tan Le , Canh T. Dinh , Nguyen H. Tran

Multi-marginal optimal transport enables one to compare multiple probability measures, which increasingly finds application in multi-task learning problems. One practical limitation of multi-marginal transport is computational scalability…