English
Related papers

Related papers: Soft Quantization using Entropic Regularization

200 papers

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

We refer to recent inference methodology and formulate a framework for solving the distributionally robust optimization problem, where the true probability measure is inside a Wasserstein ball around the empirical measure and the radius of…

Mathematical Finance · Quantitative Finance 2023-06-28 Xin Hai , Kihun Nam

We develop a general framework for statistical inference with the 1-Wasserstein distance. Recently, the Wasserstein distance has attracted considerable attention and has been widely applied to various machine learning tasks because of its…

Statistics Theory · Mathematics 2022-02-16 Masaaki Imaizumi , Hirofumi Ota , Takuo Hamaguchi

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

Machine Learning · Computer Science 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright

Wasserstein distributionally robust control (WDRC) is an effective method for addressing inaccurate distribution information about disturbances in stochastic systems. It provides various salient features, such as an out-of-sample…

Systems and Control · Electrical Eng. & Systems 2022-09-08 Astghik Hakobyan , Insoon Yang

We address the problem of network quantization, that is, reducing bit-widths of weights and/or activations to lighten network architectures. Quantization methods use a rounding function to map full-precision values to the nearest quantized…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Dohyung kim , Junghyup Lee , Bumsub Ham

In this paper, we explore a static setting for the assessment of risk in the context of mathematical finance and actuarial science that takes into account model uncertainty in the distribution of a possibly infinite-dimensional risk factor.…

Risk Management · Quantitative Finance 2024-08-13 Max Nendel , Alessandro Sgarabottolo

We consider machine learning, particularly regression, using locally-differentially private datasets. The Wasserstein distance is used to define an ambiguity set centered at the empirical distribution of the dataset corrupted by local…

Machine Learning · Computer Science 2020-06-25 Farhad Farokhi

Method of parameterizing and smoothing the unknown underling distributions using Bernstein polynomials is proposed, verified and investigated. Any distribution with bounded and smooth enough density can be approximated by the proposed…

Methodology · Statistics 2015-06-23 Zhong Guan

This paper studies the problem of computing a linear approximation of quadratic Wasserstein distance $W_2$. In particular, we compute an approximation of the negative homogeneous weighted Sobolev norm whose connection to Wasserstein…

Numerical Analysis · Mathematics 2022-03-02 Philip Greengard , Jeremy G. Hoskins , Nicholas F. Marshall , Amit Singer

We consider a mean-field control problem in which admissible controls are required to be adapted to the common noise filtration. The main objective is to show how the mean-field control problem can be approximates by time consistent…

Optimization and Control · Mathematics 2025-09-19 Bruno Bouchard , Xiaolu Tan

Multi-stage stochastic optimization is a well-known quantitative tool for decision-making under uncertainty. It is broadly used in financial and investment planning, inventory control, and also natural disaster risk management. Theoretical…

Optimization and Control · Mathematics 2025-08-27 Anna Timonina-Farkas

Common measures of neural representational (dis)similarity are designed to be insensitive to rotations and reflections of the neural activation space. Motivated by the premise that the tuning of individual units may be important, there has…

Machine Learning · Computer Science 2023-11-17 Meenakshi Khosla , Alex H. Williams

This paper explores the process of optimal quantization for several types of discrete probability distributions. Quantization is a technique used to approximate a complex distribution with a smaller set of representative points, which is…

Probability · Mathematics 2025-07-16 Russel Cabasag , Samir Huq , Eric Mendoza , Mrinal Kanti Roychowdhury

We consider distributionally robust optimization problems where the uncertainty is modeled via a structured Wasserstein ambiguity set. Specifically, the ambiguity is restricted to product measures $P^{\otimes N}$, where $P$ lies within a…

Optimization and Control · Mathematics 2026-04-14 Andrey Kharitenko , Marta Fochesato , Anastasios Tsiamis , Niklas Schmid , John Lygeros

In this paper, we develop a two-stage data-driven approach to address the adjustable robust optimization problem, where the uncertainty set is adjustable to manage infeasibility caused by significant or poorly quantified uncertainties. In…

Optimization and Control · Mathematics 2025-05-29 Xiaoxing Ren , Alessio Moreschini , Zhongda Chu , Yulong Gao , Thomas Parisini

We study the decentralized distributed computation of discrete approximations for the regularized Wasserstein barycenter of a finite set of continuous probability measures distributedly stored over a network. We assume there is a network of…

Optimization and Control · Mathematics 2020-02-21 Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov , César A. Uribe , Angelia Nedić

The approximation ratio has become one of the dominant measures in mechanism design problems. In light of analysis of algorithms, we define the \emph{smoothed approximation ratio} to compare the performance of the optimal mechanism and a…

Computer Science and Game Theory · Computer Science 2017-06-23 Xiaotie Deng , Yansong Gao , Jie Zhang

Computing the Wasserstein barycenter of a set of probability measures under the optimal transport metric can quickly become prohibitive for traditional second-order algorithms, such as interior-point methods, as the support size of the…

Optimization and Control · Mathematics 2020-01-22 Dongdong Ge , Haoyue Wang , Zikai Xiong , Yinyu Ye

We study first-order optimality conditions for constrained optimization in the Wasserstein space, whereby one seeks to minimize a real-valued function over the space of probability measures endowed with the Wasserstein distance. Our…

Optimization and Control · Mathematics 2025-03-03 Nicolas Lanzetti , Saverio Bolognani , Florian Dörfler