English
Related papers

Related papers: Dual Block Gradient Ascent for Entropically Regula…

200 papers

We present a time-parallelization method that enables to accelerate the computation of quantum optimal control algorithms. We show that this approach is approximately fully efficient when based on a gradient method as optimization solver:…

Optimization and Control · Mathematics 2016-05-04 Mohamed-Kamel Riahi , Julien Salomon , S. J. Glaser , D Sugny

In this paper we extend the adaptive gradient descent (AdaGrad) algorithm to the optimal distributed control of parabolic partial differential equations with uncertain parameters. This stochastic optimization method achieves an improved…

Optimization and Control · Mathematics 2021-10-22 Yanzhao Cao , Somak Das , Hans-Werner van Wyk

In this paper we study the convex problem of optimizing the sum of a smooth function and a compactly supported non-smooth term with a specific separable form. We analyze the block version of the generalized conditional gradient method when…

Optimization and Control · Mathematics 2015-09-28 Amir Beck , Edouard Pauwels , Shoham Sabach

Entropy regularized Markov decision processes have been widely used in reinforcement learning. This paper is concerned with the primal-dual formulation of the entropy regularized problems. Standard first-order methods suffer from slow…

Optimization and Control · Mathematics 2023-06-13 Haoya Li , Hsiang-fu Yu , Lexing Ying , Inderjit Dhillon

Entropy regularization is an efficient technique for encouraging exploration and preventing a premature convergence of (vanilla) policy gradient methods in reinforcement learning (RL). However, the theoretical understanding of…

Machine Learning · Computer Science 2024-07-16 Yuhao Ding , Junzi Zhang , Hyunin Lee , Javad Lavaei

This paper investigates accelerating the convergence of distributed optimization algorithms on non-convex problems. We propose a distributed primal-dual stochastic gradient descent~(SGD) equipped with "powerball" method to accelerate. We…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Colleen P. Bailey

Variational problems that involve Wasserstein distances and more generally optimal transport (OT) theory are playing an increasingly important role in data sciences. Such problems can be used to form an examplar measure out of various…

Machine Learning · Computer Science 2018-11-15 Marco Cuturi , Gabriel Peyré

We implement, optimize, and validate the linear-scaling Kubo-Greenwood quantum transport simulation on graphics processing units by examining resonant scattering in graphene. We consider two practical representations of the Kubo-Greenwood…

Mesoscale and Nanoscale Physics · Physics 2014-02-14 Zheyong Fan , Andreas Uppstu , Topi Siro , Ari Harju

Using convex optimization, we propose entanglement-assisted quantum error correction procedures that are optimized for given noise channels. We demonstrate through numerical examples that such an optimized error correction method achieves…

Quantum Physics · Physics 2010-10-28 Soraya Taghavi , Todd A. Brun , Daniel A. Lidar

In order to circumvent the difficulties in solving numerically the discrete optimal transport problem, in which one minimizes the linear target function $P\mapsto\langle C,P\rangle:=\sum_{i,j}C_{ij}P_{ij}$, Cuturi introduced a variant of…

Optimization and Control · Mathematics 2020-11-30 Daiji Tsutsui

Functional lifting methods provide a tool for approximating solutions of difficult non-convex problems by embedding them into a larger space. In this work, we investigate a mathematically rigorous formulation based on embedding into the…

Optimization and Control · Mathematics 2020-07-07 Thomas Vogt , Roland Haase , Danielle Bednarski , Jan Lellmann

A gradient enhanced ADMM algorithm for optimal transport on general surfaces is proposed in this paper. Based on Benamou and Brenier's dynamical formulation, we combine gradient recovery techniques on surfaces with the ADMM algorithm, not…

Numerical Analysis · Mathematics 2024-06-25 Guozhi Dong , Hailong Guo , Chengrun Jiang , Zuoqiang Shi

Optimization theory has been widely studied in academia and finds a large variety of applications in industry. The different optimization models in their discrete and/or continuous settings have catered to a rich source of research…

Quantum Physics · Physics 2026-03-16 Debbie Lim , Joao F. Doriguello , Patrick Rebentrost

We consider an optimal transport problem on the unit simplex whose solutions are given by gradients of exponentially concave functions and prove two main results. First, we show that the optimal transport is the large deviation limit of a…

Probability · Mathematics 2020-07-07 Soumik Pal , Ting-Kam Leonard Wong

We study Benamou's domain decomposition algorithm for optimal transport in the entropy regularized setting. The key observation is that the regularized variant converges to the globally optimal solution under very mild assumptions. We prove…

Optimization and Control · Mathematics 2021-11-23 Mauro Bonafini , Bernhard Schmitzer

We develop multi-step gradient methods for network-constrained optimization of strongly convex functions with Lipschitz-continuous gradients. Given the topology of the underlying network and bounds on the Hessian of the objective function,…

Optimization and Control · Mathematics 2015-06-12 Euhanna Ghadimi , Iman Shames , Mikael Johansson

In this paper we propose distributed dual gradient algorithms for linearly constrained separable convex problems and analyze their rate of convergence under different assumptions. Under the strong convexity assumption on the primal…

Optimization and Control · Mathematics 2014-02-04 Ion Necoara , Valentin Nedelcu

A gradient-enhanced functional tensor train cross approximation method for the resolution of the Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control of nonlinear dynamics is presented. The procedure uses samples…

Numerical Analysis · Mathematics 2023-02-23 Sergey Dolgov , Dante Kalise , Luca Saluzzi

We develop an iterative, numerically exact approach for the treatment of nonequilibrium quantum transport and dissipation problems that avoids the real-time sign problem associated with standard Monte Carlo techniques. The method requires a…

Mesoscale and Nanoscale Physics · Physics 2015-05-19 Dvira Segal , Andrew J. Millis , David R. Reichman

The Coordinate Ascent Variational Inference scheme is a popular algorithm used to compute the mean-field approximation of a probability distribution of interest. We analyze its random scan version, under log-concavity assumptions on the…

Machine Learning · Statistics 2024-09-24 Hugo Lavenant , Giacomo Zanella