English
Related papers

Related papers: Wasserstein-penalized Entropy closure: A use case …

200 papers

Distributionally robust chance constrained programs minimize a deterministic cost function subject to the satisfaction of one or more safety conditions with high probability, given that the probability distribution of the uncertain problem…

Optimization and Control · Mathematics 2022-11-22 Zhi Chen , Daniel Kuhn , Wolfram Wiesemann

We study a variety of Wasserstein distributionally robust optimization (WDRO) problems where the distributions in the ambiguity set are chosen by constraining their Wasserstein discrepancies to the empirical distribution. Using the notion…

Optimization and Control · Mathematics 2024-02-07 Hong T. M. Chu , Meixia Lin , Kim-Chuan Toh

We use the method of Maximum (relative) Entropy to process information in the form of observed data and moment constraints. The generic "canonical" form of the posterior distribution for the problem of simultaneous updating with data and…

Data Analysis, Statistics and Probability · Physics 2016-09-08 Adom Giffin , Ariel Caticha

Compared with word embedding based on point representation, distribution-based word embedding shows more flexibility in expressing uncertainty and therefore embeds richer semantic information when representing words. The Wasserstein…

Computation and Language · Computer Science 2018-09-05 Chi Sun , Hang Yan , Xipeng Qiu , Xuanjing Huang

We propose a relative entropy gradient sampler (REGS) for sampling from unnormalized distributions. REGS is a particle method that seeks a sequence of simple nonlinear transforms iteratively pushing the initial samples from a reference…

Machine Learning · Statistics 2021-10-07 Xingdong Feng , Yuan Gao , Jian Huang , Yuling Jiao , Xu Liu

We propose to align distributional data from the perspective of Wasserstein means. We raise the problem of regularizing Wasserstein means and propose several terms tailored to tackle different problems. Our formulation is based on the…

Machine Learning · Computer Science 2020-02-24 Liang Mi , Wen Zhang , Yalin Wang

We use guiding principles from nonequilibrium thermodynamics to develop an admissible set of 13 moment equations for rarefied gas flows. The main benefits of our thermodynamic approach are an explicit entropy expression fulfilling an $H$…

Statistical Mechanics · Physics 2010-11-10 Hans Christian Öttinger

The maximum entropy principle from statistical mechanics states that a closed system attains an equilibrium distribution that maximizes its entropy. We first show that for graphs with fixed number of edges one can define a stochastic edge…

Disordered Systems and Neural Networks · Physics 2007-05-23 Jesse S. A. Bridgewater , P. Oscar Boykin , Vwani P. Roychowdhury

Stochastic optimal control usually requires an explicit dynamical model with probability distributions, which are difficult to obtain in practice. In this work, we consider the linear quadratic regulator (LQR) problem of unknown linear…

Optimization and Control · Mathematics 2023-01-18 Feiran Zhao , Keyou You

We consider the problem of sampling from a distribution governed by a potential function. This work proposes an explicit score based MCMC method that is deterministic, resulting in a deterministic evolution for particles rather than a…

Machine Learning · Statistics 2023-10-03 Hong Ye Tan , Stanley Osher , Wuchen Li

Problem definition: A key challenge in supervised learning is data scarcity, which can cause prediction models to overfit to the training data and perform poorly out of sample. A contemporary approach to combat overfitting is offered by…

Optimization and Control · Mathematics 2025-10-10 Reza Belbasi , Aras Selvi , Wolfram Wiesemann

We study a class of distributionally robust games where agents are allowed to heterogeneously choose their risk aversion with respect to distributional shifts of the uncertainty. In our formulation, heterogeneous Wasserstein ball…

Optimization and Control · Mathematics 2025-12-08 Zifan Wang , Georgios Pantazis , Sergio Grammatico , Michael M. Zavlanos , Karl H. Johansson

We study the problem of model aggregation within the Wasserstein space for probability measures on the real line. Given a fixed finite collection of candidate probability models, we consider the associated class of Wasserstein barycenters…

To directly simulate rare events using atomistic molecular dynamics is a significant challenge in computational biophysics. Well-established enhanced-sampling techniques do exist to obtain the thermodynamic functions for such systems. But…

Statistical Mechanics · Physics 2020-07-21 Dhiman Ray , Ioan Andricioaei

We propose a variational finite volume scheme to approximate the solutions to Wasserstein gradient flows. The time discretization is based on an implicit linearization of the Wasserstein distance expressed thanks to Benamou-Brenier formula,…

Numerical Analysis · Mathematics 2019-07-22 Clément Cancès , Thomas O. Gallouët , Gabriele Todeschi

This paper targets the task with discrete and periodic class labels ($e.g.,$ pose/orientation estimation) in the context of deep learning. The commonly used cross-entropy or regression loss is not well matched to this problem as they ignore…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiaofeng Liu , Yang Zou , Tong Che , Peng Ding , Ping Jia , Jane You , Kumar B. V. K

We consider approximating distributions within the framework of optimal mass transport and specialize to the problem of clustering data sets. Distances between distributions are measured in the Wasserstein metric. The main problem we…

Systems and Control · Computer Science 2013-10-04 Francesca P. Carli , Lipeng Ning , Tryphon T. Georgiou

We study distributionally robust online learning, where a risk-averse learner updates decisions sequentially to guard against worst-case distributions drawn from a Wasserstein ambiguity set centered at past observations. While this paradigm…

Machine Learning · Computer Science 2026-02-25 Guixian Chen , Salar Fattahi , Soroosh Shafiee

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel…

Optimization and Control · Mathematics 2019-10-22 Tobias Sutter , David Sutter , Peyman Mohajerin Esfahani , John Lygeros

We present a distributionally robust formulation of a stochastic optimization problem for non-i.i.d vector autoregressive data. We use the Wasserstein distance to define robustness in the space of distributions and we show, using duality…

Optimization and Control · Mathematics 2019-09-10 Xialiang Dou , Mihai Anitescu
‹ Prev 1 8 9 10 Next ›