English
Related papers

Related papers: Stochastic mirror descent for nonparametric adapti…

200 papers

We introduce a new family of particle evolution samplers suitable for constrained domains and non-Euclidean geometries. Stein Variational Mirror Descent and Mirrored Stein Variational Gradient Descent minimize the Kullback-Leibler (KL)…

Machine Learning · Statistics 2022-04-26 Jiaxin Shi , Chang Liu , Lester Mackey

We consider the problem of simultaneously learning to linearly combine a very large number of kernels and learn a good predictor based on the learnt kernel. When the number of kernels $d$ to be combined is very large, multiple kernel…

Machine Learning · Computer Science 2015-03-20 Arash Afkanpour , András György , Csaba Szepesvári , Michael Bowling

We consider the problem of sampling from constrained distributions, which has posed significant challenges to both non-asymptotic analysis and algorithmic design. We propose a unified framework, which is inspired by the classical mirror…

Machine Learning · Computer Science 2021-01-01 Ya-Ping Hsieh , Ali Kavis , Paul Rolland , Volkan Cevher

We study the problem of differentially-private (DP) stochastic (convex-concave) saddle-points in the $\ell_1$ setting. We propose $(\varepsilon, \delta)$-DP algorithms based on stochastic mirror descent that attain nearly…

Optimization and Control · Mathematics 2025-11-17 Tomás González , Cristóbal Guzmán , Courtney Paquette

Training generative models to sample from unnormalized density functions is an important and challenging task in machine learning. Traditional training methods often rely on the reverse Kullback-Leibler (KL) divergence due to its…

Machine Learning · Computer Science 2025-03-05 Jiajun He , Wenlin Chen , Mingtian Zhang , David Barber , José Miguel Hernández-Lobato

This paper studies the policy mirror descent (PMD) method, which is a general policy optimization framework in reinforcement learning and can cover a wide range of policy gradient methods by specifying difference mirror maps. Existing…

Optimization and Control · Mathematics 2026-01-01 Wenye Li , Hongxu Chen , Jiacai Liu , Ke Wei

In a first part, we present a mathematical analysis of a general methodology of a probabilistic learning inference that allows for estimating a posterior probability model for a stochastic boundary value problem from a prior probability…

Machine Learning · Statistics 2022-06-08 Christian Soize

Diffusion models for continuous state spaces based on Gaussian noising processes are now relatively well understood from both practical and theoretical perspectives. In contrast, results for diffusion models on discrete state spaces remain…

Machine Learning · Computer Science 2026-04-02 Giovanni Conforti , Alain Durmus , Le-Tuyet-Nhi Pham , Gael Raoul

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

In maximum-likelihood quantum state tomography, both the sample size and dimension grow exponentially with the number of qubits. It is therefore desirable to develop a stochastic first-order method, just like stochastic gradient descent for…

Quantum Physics · Physics 2022-11-24 Chung-En Tsai , Hao-Chung Cheng , Yen-Huan Li

We consider centralized and distributed mirror descent algorithms over a finite-dimensional Hilbert space, and prove that the problem variables converge to an optimizer of a possibly nonsmooth function when the step sizes are square…

Optimization and Control · Mathematics 2018-05-07 Thinh T. Doan , Subhonmesh Bose , D. Hoa Nguyen , Carolyn L. Beck

Learning-to-optimize (L2O) is an emerging research area in large-scale optimization with applications in data science. Recently, researchers have proposed a novel L2O framework called learned mirror descent (LMD), based on the classical…

Optimization and Control · Mathematics 2024-05-13 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Carola-Bibiane Schönlieb

The usual approach to developing and analyzing first-order methods for non-smooth (stochastic or deterministic) convex optimization assumes that the objective function is uniformly Lipschitz continuous with parameter $M_f$. However, in many…

Optimization and Control · Mathematics 2018-08-15 Haihao Lu

Nonnegative matrix factorization (NMF) is a standard linear dimensionality reduction technique for nonnegative data sets. In order to measure the discrepancy between the input data and the low-rank approximation, the Kullback-Leibler (KL)…

Optimization and Control · Mathematics 2021-05-12 Le Thi Khanh Hien , Nicolas Gillis

In this paper, we propose to solve a regularized distributionally robust learning problem in the decentralized setting, taking into account the data distribution shift. By adding a Kullback-Liebler regularization function to the robust…

Machine Learning · Computer Science 2022-09-13 Chaouki Ben Issaid , Anis Elgabli , Mehdi Bennis

We consider risk-averse convex stochastic programs expressed in terms of extended polyhedral risk measures. We derive computable confidence intervals on the optimal value of such stochastic programs using the Robust Stochastic Approximation…

Optimization and Control · Mathematics 2016-09-06 Vincent Guigues

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, it seems to be a considerable restriction when the potentials are often required to be smooth (gradient Lipschitz). This paper…

Computation · Statistics 2022-02-23 Dao Nguyen

The stochastic mirror descent (SMD) algorithm is a general class of training algorithms, which includes the celebrated stochastic gradient descent (SGD), as a special case. It utilizes a mirror potential to influence the implicit bias of…

Machine Learning · Computer Science 2022-10-28 Taylan Kargin , Fariborz Salehi , Babak Hassibi

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

Statistics Theory · Mathematics 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

The Kullback-Leibler (KL) divergence is frequently used in data science. For discrete distributions on large state spaces, approximations of probability vectors may result in a few small negative entries, rendering the KL divergence…