English
Related papers

Related papers: Stability and Sample Complexity of Divergence Regu…

200 papers

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

In this paper, we address the problem of robust stability for uncertain sampled-data systems controlled by a discrete-time disturbance observer (DT-DOB). Unlike most of previous works that rely on the small-gain theorem, our approach is to…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Gyunghoon Park , Chanhwa Lee , Youngjun Joo , Hyungbo Shim

Tilt stability is a fundamental concept of variational analysis and optimization that plays a pivotal role in both theoretical issues and numerical computations. This paper investigates tilt stability of local minimizers for a general class…

Optimization and Control · Mathematics 2025-07-16 Boris S. Mordukhovich , Peipei Tang , Chengjing Wang

We study the problem of designing hard negative sampling distributions for unsupervised contrastive representation learning. We propose and analyze a novel min-max framework that seeks a representation which minimizes the maximum…

Machine Learning · Computer Science 2023-12-18 Ruijie Jiang , Prakash Ishwar , Shuchin Aeron

In this work, we propose a novel machine learning approach to compute the optimal transport map between two continuous distributions from their unpaired samples, based on the DeepParticle methods. The proposed method leads to a min-min…

Machine Learning · Statistics 2025-07-01 Yingyuan Li , Aokun Wang , Zhongjian Wang

We characterize the solution to the entropically regularized optimal transport problem by a well-posed ordinary differential equation (ODE). Our approach works for discrete marginals and general cost functions, and in addition to two…

Optimization and Control · Mathematics 2024-04-01 Joshua Zoen-Git Hiew , Luca Nenna , Brendan Pass

In this paper we wish to tackle stochastic programs affected by ambiguity about the probability law that governs their uncertain parameters. Using optimal transport theory, we construct an ambiguity set that exploits the knowledge about the…

Optimization and Control · Mathematics 2021-06-15 Adrián Esteban-Pérez , Juan M. Morales

We derive limit distributions for certain empirical regularized optimal transport distances between probability distributions supported on a finite metric space and show consistency of the (naive) bootstrap. In particular, we prove that the…

Statistics Theory · Mathematics 2019-05-02 Marcel Klatt , Carla Tameling , Axel Munk

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

Optimization and Control · Mathematics 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

In 2012, Pflug and Pichler proved, under regularity assumptions, that the value function in Multistage Stochastic Programming (MSP) is Lipschitz continuous w.r.t. the Nested Distance, which is a distance between scenario trees (or discrete…

Optimization and Control · Mathematics 2021-07-22 Zheng Qu , Benoît Tran

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

In optimal transport, quadratic regularization is a sparse alternative to entropic regularization: the solution measure tends to have small support. Computational experience suggests that the support decreases monotonically to the…

Optimization and Control · Mathematics 2025-04-16 Alberto González-Sanz , Marcel Nutz , Andrés Riveros Valdevenito

As the complexity of modern control systems increases, it becomes challenging to derive an accurate model of the uncertainty that affects their dynamics. Wasserstein Distributionally Robust Optimization (DRO) provides a powerful framework…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

Distributionally robust optimization has been shown to offer a principled way to regularize learning models. In this paper, we find that Tikhonov regularization is distributionally robust in an optimal transport sense (i.e., if an adversary…

Optimization and Control · Mathematics 2022-10-05 Jiajin Li , Sirui Lin , Jose Blanchet , Viet Anh Nguyen

In this paper, we want to establish some general results in the Lorentzian optimal transport theory that have well-known Riemannian counterparts. As a first result, we will provide non-trivial assumptions on the measures to ensure strong…

Optimization and Control · Mathematics 2026-01-15 Alec Metsch

We study the multi-marginal partial optimal transport (POT) problem between $m$ discrete (unbalanced) measures with at most $n$ supports. We first prove that we can obtain two equivalence forms of the multimarginal POT problem in terms of…

Machine Learning · Statistics 2022-02-25 Khang Le , Huy Nguyen , Tung Pham , Nhat Ho

Transport systems on networks are crucial in various applications, but face a significant risk of being adversely affected by unforeseen circumstances such as disasters. The application of entropy-regularized optimal transport (OT) on graph…

Machine Learning · Computer Science 2025-05-07 Koshi Oishi , Yota Hashizume , Tomohiko Jimbo , Hirotaka Kaji , Kenji Kashima

We establish weak limits for the empirical entropy regularized optimal transport cost, the expectation of the empirical plan and the conditional expectation. Our results require only uniform boundedness of the cost function and no…

Statistics Theory · Mathematics 2023-05-18 Alberto González-Sanz , Shayan Hundrieser

We obtain new transport-entropy inequalities and, as a by-product, new deviation estimates for the laws of two kinds of discrete stochastic approximation schemes. The first one refers to the law of an Euler like discretization scheme of a…

Probability · Mathematics 2013-02-01 Max Fathi , Noufel Frikha

We analyze continuous optimal transport problems in the so-called Kantorovich form, where we seek a transport plan between two marginals that are probability measures on compact subsets of Euclidean space. We consider the case of…

Optimization and Control · Mathematics 2020-10-28 Christian Clason , Dirk A. Lorenz , Hinrich Mahler , Benedikt Wirth