English
Related papers

Related papers: An entropy penalized approach for stochastic contr…

200 papers

Solving linear programs by using entropic penalization has recently attracted new interest in the optimization community, since this strategy forms the basis for the fastest-known algorithms for the optimal transport problem, with many…

Optimization and Control · Mathematics 2018-06-07 Jonathan Weed

In this paper, we propose a new policy iteration algorithm to compute the value function and the optimal controls of continuous time stochastic control problems. The algorithm relies on successive approximations using linear-quadratic…

Optimization and Control · Mathematics 2024-09-09 Dylan Possamaï , Ludovic Tangpi

We study an optimal control problem under uncertainty, where the target function is the solution of an elliptic partial differential equation with random coefficients, steered by a control function. The robust formulation of the…

Numerical Analysis · Mathematics 2019-10-23 Philipp A. Guth , Vesa Kaarnioja , Frances Y. Kuo , Claudia Schillings , Ian H. Sloan

We provide a dynamic programming principle for stochastic optimal control problems with expectation constraints. A weak formulation, using test functions and a probabilistic relaxation of the constraint, avoids restrictions related to a…

Optimization and Control · Mathematics 2012-12-21 Bruno Bouchard , Marcel Nutz

In many problems in optimal control, one seeks to minimise an objective function subject to constraints on the velocity of the system. Imposing these constraints directly -- the ``hard-constrained'' approach -- is often analytically and…

Optimization and Control · Mathematics 2026-04-27 Rufus Lawrence , Aleš Wodecki , Johannes Aspman , Jakub Mareček

Following [21, 23], the present work investigates a new relative entropy-regularized algorithm for solving the optimal transport on a graph problem within the randomized shortest paths formalism. More precisely, a unit flow is injected into…

Machine Learning · Computer Science 2021-09-21 Sylvain Courtain , Guillaume Guex , Ilkka Kivimaki , Marco Saerens

We consider a class of constrained optimization problems with a possibly nonconvex non-Lipschitz objective and a convex feasible set being the intersection of a polyhedron and a possibly degenerate ellipsoid. Such problems have a wide range…

Optimization and Control · Mathematics 2016-04-08 Xiaojun Chen , Zhaosong Lu , Ting Kei Pong

Choosing decision variables deterministically (deterministic decision-making) can be regarded as a particular case of choosing decision variables probabilistically (probabilistic decision-making). It is necessary to investigate whether…

Optimization and Control · Mathematics 2023-09-18 Xun Shen , Yuhu Wu , Satoshi Ito , Jun-ichi Imura

The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear mapping over the set of admissible…

Optimization and Control · Mathematics 2015-02-26 Dante Kalise , Axel Kröner , Karl Kunisch

We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying MDPs controlled by the underlying…

Optimization and Control · Mathematics 2024-08-27 Sihan Zeng , Thinh T. Doan , Justin Romberg

In this work, we consider a constrained convex problem with linear inequalities and provide an inexact penalty re-formulation of the problem. The novelty is in the choice of the penalty functions, which are smooth and can induce a non-zero…

Optimization and Control · Mathematics 2020-05-04 Tatiana Tatarenko , Angelia Nedich

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

The optimal control of problems that are constrained by partial differential equations with uncertainties and with uncertain controls is addressed. The Lagrangian that defines the problem is postulated in terms of stochastic functions, with…

Optimization and Control · Mathematics 2012-11-19 Eveline Rosseel , Garth N. Wells

We consider the P1/P1 or P1b/P1 finite element approximations to the Stokes equations in a bounded smooth domain subject to the slip boundary condition. A penalty method is applied to address the essential boundary condition $u\cdot n = g$…

Numerical Analysis · Mathematics 2015-05-26 Takahito Kashiwabara , Issei Oikawa , Guanyu Zhou

Optimal stopping is the problem of determining when to stop a stochastic system in order to maximize reward, which is of practical importance in domains such as finance, operations management and healthcare. Existing methods for…

Optimization and Control · Mathematics 2022-03-28 Xinyi Guan , Velibor V. Mišić

In this paper, we address two minimal controllability problems, where the goal is to determine a minimal subset of state variables in a linear time-invariant system to be actuated to ensure controllability under additional constraints.…

Optimization and Control · Mathematics 2016-04-20 Sergio Pequito , Guilherme Ramos , Soummya Kar , A. Pedro Aguiar , Jaime Ramos

We consider the general nonlinear optimization problem where the objective function has an additional term defined by the $ \ell_0 $-quasi-norm in order to promote sparsity of a solution. This problem is highly difficult due to its…

Optimization and Control · Mathematics 2023-12-27 Christian Kanzow , Felix Weiß

We consider the problem of optimal sparse output feedback controller synthesis for continuous linear time invariant systems when the feedback gain is static and subject to specified structural constraints. Introducing an additional term…

Optimization and Control · Mathematics 2015-06-23 Reza Arastoo , Nader Motee , Mayuresh V. Kothare

In this paper, we focus on a method based on optimal control to address the optimization problem. The objective is to find the optimal solution that minimizes the objective function. We transform the optimization problem into optimal…

Optimization and Control · Mathematics 2023-09-12 Yeming Xu , Ziyuan Guo , Hongxia Wang , Huanshui Zhang

Optimally combining frequency control with self-consumption can increase revenues from battery storage systems installed behind-the-meter. This work presents an optimized control strategy that allows a battery to be used simultaneously for…

Optimization and Control · Mathematics 2018-01-01 Jonas Engels , Bert Claessens , Geert Deconinck