English
Related papers

Related papers: Convergence of Noise-Free Sampling Algorithms with…

200 papers

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, the canonical Euler Maruyama discretization of the Langevin diffusion process, referred as Unadjusted Langevin Algorithm (ULA),…

Computation · Statistics 2021-07-28 Dao Nguyen , Xin Dang , Yixin Chen

As the complexity of modern control systems increases, it becomes challenging to derive an accurate model of the uncertainty that affects their dynamics. Wasserstein Distributionally Robust Optimization (DRO) provides a powerful framework…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

Wasserstein gradient flows provide a powerful means of understanding and solving many diffusion equations. Specifically, Fokker-Planck equations, which model the diffusion of probability measures, can be understood as gradient descent over…

Machine Learning · Computer Science 2021-10-26 Petr Mokrov , Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Evgeny Burnaev

Inverse multiobjective optimization provides a general framework for the unsupervised learning task of inferring parameters of a multiobjective decision making problem (DMP), based on a set of observed decisions from the human expert.…

Optimization and Control · Mathematics 2020-10-01 Chaosheng Dong , Bo Zeng

In previous work, we introduced a method for determining convergence rates for integration methods for the kinetic Langevin equation for $M$-$\nabla$Lipschitz $m$-log-concave densities [arXiv:2302.10684, 2023]. In this article, we exploit…

Numerical Analysis · Mathematics 2023-06-16 Benedict Leimkuhler , Daniel Paulin , Peter A. Whalley

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

We study the Frank-Wolfe algorithm for constrained optimization problems with relatively smooth objectives. Building upon our previous work, we propose a fully adaptive variant of the Frank-Wolfe method that dynamically adjusts the step…

Optimization and Control · Mathematics 2025-08-27 A. A. Vyguzov , F. S. Stonyakin

The Wasserstein barycenter problem is to compute the average of $m$ given probability measures, which has been widely studied in many different areas; however, real-world data sets are often noisy and huge, which impedes its applications in…

Machine Learning · Computer Science 2023-12-27 Xu Wang , Jiawei Huang , Qingyuan Yang , Jinpeng Zhang

Distributionally robust control (DRC) aims to effectively manage distributional ambiguity in stochastic systems. While most existing works address inaccurate distributional information in fully observable settings, we consider a partially…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Astghik Hakobyan , Insoon Yang

Optimal Transport (OT) provides a useful geometric framework to estimate the permutation matrix under unsupervised cross-lingual word embedding (CLWE) models that pose the alignment task as a Wasserstein-Procrustes problem. However, linear…

Computation and Language · Computer Science 2022-12-06 Prince O Aboagye , Yan Zheng , Michael Yeh , Junpeng Wang , Zhongfang Zhuang , Huiyuan Chen , Liang Wang , Wei Zhang , Jeff Phillips

Locally stationary (LSPs) constitute an essential modeling paradigm for capturing the nuanced dynamics inherent in time series data whose statistical characteristics, including mean and variance, evolve smoothly across time. In this paper,…

Statistics Theory · Mathematics 2025-08-29 Jan Nino G. Tinio , Mokhtar Z. Alaya , Salim Bouzebda

We introduce an efficient and scalable method for density-based multi-material topology optimization, integrating classical mirror descent techniques with point-wise polytopal design constraints. Such constraints arise naturally in this…

Numerical Analysis · Mathematics 2026-05-15 Peter Gangl , Brendan Keith , Dohyun Kim , Boyan S. Lazarov , Thomas M. Surowiec

This brief note aims to introduce the recent paradigm of distributional robustness in the field of shape and topology optimization. Acknowledging that the probability law of uncertain physical data is rarely known beyond a rough…

Optimization and Control · Mathematics 2023-01-13 Charles Dapogny , Franck Iutzeler , Andrea Meda , Boris Thibert

We propose a randomized nonmonotone block proximal gradient (RNBPG) method for minimizing the sum of a smooth (possibly nonconvex) function and a block-separable (possibly nonconvex nonsmooth) function. At each iteration, this method…

Optimization and Control · Mathematics 2015-03-24 Zhaosong Lu , Lin Xiao

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are batch methods designed mainly based on the convex optimization, say, the…

Machine Learning · Statistics 2018-02-01 Ke Ma , Jinshan Zeng , Jiechao Xiong , Qianqian Xu , Xiaochun Cao , Wei Liu , Yuan Yao

Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W2-distance rely on stringent assumptions about…

Machine Learning · Statistics 2025-12-12 Marta Gentiloni-Silveri , Antonio Ocello

We present a Distributionally Robust Optimization (DRO) approach to estimate a robustified regression plane in a linear regression setting, when the observed samples are potentially contaminated with adversarially corrupted outliers. Our…

Machine Learning · Statistics 2018-05-14 Ruidi Chen , Ioannis Ch. Paschalidis

This paper presents a novel stochastic optimisation methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed…

Applications · Statistics 2024-03-12 Charlesquin Kemajou Mbakam , Marcelo Pereyra , Jean-François Giovannelli

Wasserstein distributionally robust optimization (DRO) aims to find robust and generalizable solutions by hedging against data perturbations in Wasserstein distance. Despite its recent empirical success in operations research and machine…

Machine Learning · Computer Science 2022-05-03 Rui Gao

Distributionally Robust Optimization (DRO) has enabled to prove the equivalence between robustness and regularization in classification and regression, thus providing an analytical reason why regularization generalizes well in statistical…

Optimization and Control · Mathematics 2020-07-15 Esther Derman , Shie Mannor